Artificial Intelligence

|

By Lottie

|

October 2023

Discover How ZenML is Revolutionising Open-source AI Integration

Image

In our latest Mini Tech Roundup, we're placing the spotlight on ZenML. This groundbreaking framework is swiftly rising to prominence, becoming a pivotal player in integrating open-source artificial intelligence tools. Providing a seamless platform, ZenML allows data scientists, machine-learning engineers, and platform engineers to collaborate on creating AI models tailored to their specific needs.

ZenML: Empowering Tailored AI Solutions

What makes ZenML so compelling is its capability to empower businesses to design their unique AI models. Although it might not be feasible for most companies to rival something as vast as GPT-4, they can certainly develop niche models to address their distinct requirements. This could pave the way for reduced reliance on leading API providers, such as OpenAI and Anthropic.

Louis Coppey, from VC firm Point Nine, highlighted, "As the initial excitement surrounding big players like OpenAI subsides, ZenML will be the tool that facilitates organisations in creating their custom tech stack."

ZenML's Funding and Origins

Earlier this year, ZenML boosted its finances with an extension of its seed round, courting investments from Point Nine and Crane. This Munich-based startup has successfully secured a whopping $6.4 million since its establishment.

The inception of ZenML has an interesting backstory. Co-founders Adam Probst and Hamza Tahir once partnered in developing ML pipelines for industry-specific needs. Their daily endeavours in crafting and integrating machine-learning models led to the birth of ZenML. Their aim? To design a system adaptable enough to cater to a myriad of circumstances, thereby eliminating redundant efforts.

For budding engineers venturing into the realm of machine learning, ZenML offers a head start with its modular structure. The team at ZenML refers to this domain as MLOps, drawing parallels with DevOps, but with a specialised focus on ML.

ZenML's Versatile Framework

Adam Probst, the CEO of ZenML, explained their approach, "Our goal is to amalgamate various open-source tools, each honing a specific step in the machine learning pipeline construction. We're building these on top of major platforms like AWS and Google, as well as in-house solutions."

At ZenML's core lies the concept of pipelines. Once formulated, these pipelines can be executed locally or deployed via open-source platforms such as Airflow or Kubeflow. Furthermore, they're designed to harness managed cloud services like EC2, Vertex Pipelines, and SageMaker, while also being compatible with notable ML tools from Hugging Face, MLflow, TensorFlow, PyTorch, and others.

The company's commitment to open-source is evident. Their framework, initially launched on GitHub, quickly gained traction with over 3,000 stars. Additionally, ZenML's cloud version featuring managed servers is set to introduce continuous integration and deployment triggers soon.

Already, several firms, including Rivian, Playtika, and Leroy Merlin, are leveraging ZenML for diverse applications, ranging from e-commerce recommendations to medical image recognition.

Enjoying what you're reading?

See our work

Rethinking AI: Specialised Models Over One-Size-Fits-All

A significant shift is on the horizon, with many companies currently tapping into OpenAI's API for various AI functionalities. While OpenAI and other large-scale models have their place, they often prove to be overly complex and costly for niche needs.

Echoing this sentiment, Probst remarked, "OpenAI, and similar massive models developed behind closed doors, cater to generalised scenarios, not specialised ones. Hence, they're often over-qualified and pricier than required."

Sam Altman, OpenAI's CEO, shared a similar perspective during a Q&A session earlier this year, emphasising the importance of both broad and specialised models in the future AI landscape.

Regulatory, ethical, and legal considerations further intensify the pivot towards specialised AI. Especially in Europe, legislative shifts might nudge companies towards AI models honed on precise datasets for specific applications.

Hamza Tahir shed light on the imminent future, "With enterprises transitioning from concepts to actual production, the coming years are monumental for AI. Most probably, the future will witness a blend of open-source foundational models refined on proprietary data."

Emphasising the significance of MLOps, Tahir concluded, "We firmly believe that the vast majority of AI applications will be powered by specialised, cost-effective, in-house trained models."

Stay Updated on Cutting-Edge Tech News

Enjoyed this insight? Make sure to subscribe to our Tech Roundup, where we share the most thrilling tech news from around the globe. Stay in the loop and ahead of the curve by clicking here.