Modal Labs leverages OCI for efficient AI deployments

Modal Labs is using Oracle Cloud Infrastructure (OCI) AI infrastructure to enhance the speed and cost-effectiveness of inferencing, fine-tuning, and batch processing for its customers. By utilising OCI, Modal Labs gains access to various OCI Compute bare metal instances known for their significant price-performance advantages.

Erik Bernhardsson, founder and CEO of Modal, highlighted the benefits provided by Oracle's infrastructure. “OCI provides the scale and performance we need to run large AI workloads faster, without incurring excessive compute costs,” he said. “Oracle is hard to beat when it comes to price, performance, and the level of support it provides. With Modal on OCI, our customers can scale up hundreds of nodes and down to zero within seconds, while only paying for what they use and reducing their reliance on fragmented solutions.”

Modal accelerates the development and deployment of AI models by allowing data and engineering teams to run code in the cloud without configuring or setting up the necessary infrastructure. The platform is particularly beneficial for developers using generative AI to create new applications, such as those for composing music or designing novel protein structures, as it delivers fast and reliable GPUs. By tapping into OCI's resources, developers working on Modal can ship code, get AI models into production, and test applications at a much faster pace.

Mahesh Thiagarajan, executive vice president of Oracle Cloud Infrastructure, spoke on the common challenges faced by organisations in AI deployment. “A lack of technology infrastructure and GPU availability often leads to a loss in production and higher costs for organisations trying to deploy AI,” he stated. “OCI AI infrastructure provides the highest-tier performance and value for all AI workloads across Oracle’s distributed cloud, so customers can easily deploy AI infrastructure wherever they need it.”

OCI AI infrastructure is designed to accelerate AI deployments by offering high-performance capabilities that can reliably handle the most demanding AI workloads. OCI bare metal GPU instances are equipped to power applications such as natural language processing, computer vision, and recommendation systems. Additionally, Oracle’s dedicated engineering support team collaborates with customers from planning to launch to help ensure the success of AI initiatives.

By leveraging OCI’s infrastructure, Modal Labs has observed significant performance improvements. This shift enables Modal to more efficiently meet the varying demands of developers building on its platform, improving its customers' overall user experience and outcomes.

Modal Labs' use of Oracle Cloud Infrastructure highlights the increasing importance of scalable and cost-effective solutions in the AI space. By utilising OCI’s advanced capabilities, Modal Labs is enhancing its ability to support complex AI workloads and streamline model deployment. This partnership underscores the role of robust cloud infrastructure in accelerating technological advancements and optimising performance for diverse applications.