"No one is harder on a talented person than the person themselves" - Linda Wilkinson ; "Trust your guts and don't follow the herd" ; "Validate direction not destination" ;

November 10, 2020

Session - ODSC East Talk - Challenges of machine learning development

Code - Link

Key Notes
  • Automated and Scalable Infra for ML 


ML Automation Steps
  • Data Pipeline
  • ML Team
  • Production / Deploy / Feedback Mechanism

Key Challenge is integration of all stages of development
  • Reproducibility via docker
  • Scaling via Kubernetes

Reproducibility
  • Share insights
  • Deploy Code

Automation process
  • Data pipeline
  • Feature generation

Production
  • Monitoring
  • Logging
  • Packaging

End to End workflow of Development to Production




Infra 
  • Deploy
  • Monitor
  • Train
  • Scale it on cloud

Data Pipeline process

Keep Thinking!!!

No comments: