Airbnb lists more than 6M properties across more than 100,000 cities and towns spanning 220 countries. LLMs are a strategic opportunity for Airbnb across multiple use cases. Airbnb's ML Platform team wanted to augment their existing ML platform to enable internal teams to effectively and efficiently use open source LLMs. This is difficult because LLMs present scalability challenges that push the boundaries of existing tooling.
Working with Ray, the Airbnb team is seeing improvements in developer productivity, and significantly better performance. Beyond that, they're now able to better utilize A100 GPUs on AWS for their training workloads, providing long term efficiency and cost savings for these strategic LLM applications. This session will describe before and after states and share real-world benchmarks demonstrating cloud efficiency, comparing Sagemaker to Ray, and also describe some of the applications that this work enables.
Find the slide deck here: [ Ссылка ]
About Anyscale
---
Anyscale is the AI Application Platform for developing, running, and scaling AI.
[ Ссылка ]
If you're interested in a managed Ray service, check out:
[ Ссылка ]
About Ray
---
Ray is the most popular open source framework for scaling and productionizing AI workloads. From Generative AI and LLMs to computer vision, Ray powers the world’s most ambitious AI workloads.
[ Ссылка ]
#llm #machinelearning #ray #deeplearning #distributedsystems #python #genai
