Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at [ Ссылка ]

From Bash Scripts to Kubeflow and GitOps: Our Journey to Operationalizing ML at Scale - Luca Grazioli & Dennis Ohrndorf, DHL Data & Analytics

Our talk delves into our journey of operationalizing data science workloads at scale using Kubeflow and GitOps. We outline our challenges with bash scripts and how we moved to a standardized project delivery approach using Kubeflow. We highlight the improvements achieved in developer onboarding and solutions support. We will unveil our MLOps architecture, featuring Kserve for API creation and Kubeflow pipelines for batch predictions delivery. We will also discuss our use of Kubeflow as platform for reproducible ML experiments. We explore how this stack needs a support of diverse professional experiences and subteams to support aduring scale up when dealing with growing teams (e.g platform/MLOps Engineers, Data Scientists and Data Engineers). We also describe our GitOps approach and how we’re integrating it within the Kubeflow ecosystem, starting from tracking every object in Git repositories, and then moving to complete project deployments leveraging GitHub actions and ArgoCD.

свернуть