crusoe maia

Achieving 60 t/s with DBRX in 15 minutes

In this blog, we’ll show you how to quickly and cheaply test out the latest model from Databricks, DBRX-Instruct, a massive MoE that measures in at 36B active parameters and 132B total parameters. With open-source models becoming larger and larger (the largest Llama3 clocking in at 405B parameters), the challenge and costs to run are even more pronounced. Luckily, we can easily run distributed inference at high-performance on low-cost NVIDIA L40S instances with Crusoe Cloud. An L40S.8x instance is ~$10/hour (as opposed to an H100.8x which can cost $37.60/hr). For fast experimentation, we care mostly about $/hour and developer time. Please reference the GitHub tutorial for the complete code accompanying this tutorial.

Read More

Nadav Eiron Joins Crusoe as Senior Vice President of Cloud Engineering

SAN FRANCISCO, CA  / April 3, 2024 / Business Wire / -- Crusoe Energy Systems LLC (“Crusoe”) announced today that Nadav Eiron has joined the company as a Senior Vice President to lead the Cloud Engineering team in Crusoe’s San Francisco office. Eiron will lead Crusoe’s efforts to scale its Cloud platform, purpose-built for artificial intelligence and high-performance computing workloads. With decades of experience at Google and IBM, Eiron will keep Crusoe at the forefront of architecture and usability innovation across cloud infrastructure, artificial intelligence, and team leadership.

Read More

Nadav Eiron Joins Crusoe as Senior Vice President of Cloud Engineering

SAN FRANCISCO, CA  / April 3, 2024 / Business Wire / -- Crusoe Energy Systems LLC (“Crusoe”) announced today that Nadav Eiron has joined the company as a Senior Vice President to lead the Cloud Engineering team in Crusoe’s San Francisco office. Eiron will lead Crusoe’s efforts to scale its Cloud platform, purpose-built for artificial intelligence and high-performance computing workloads. With decades of experience at Google and IBM, Eiron will keep Crusoe at the forefront of architecture and usability innovation across cloud infrastructure, artificial intelligence, and team leadership.

Read More