Announcing Support for Google's New Open-Source Gemma Models

We are excited to announce support for Google's newly released open-source Gemma natural language models within TitanML's Takeoff inference server!

The Gemma models come in two sizes - a 2 billion parameter model and a 7 billion parameter model. The Gemma models can be freely used and distributed by being open-sourced.

Our customers can now leverage the power of Google's state-of-the-art natural language capabilities within their secure environments. Whether a healthcare organization, financial institution, or other industry dealing with sensitive data, they can deploy Gemma locally in their VPC, on-prem data center, or other private cloud infrastructure through Takeoff.

The multiple Gemma model sizes allow cost-effective deployment that meets your application performance needs. The smaller 2 billion parameter model is more affordable to run with low latency for real-time use cases. The 7 billion parameter model offers higher accuracy and capability for more complex applications.

We look forward to seeing what our customers build using Google's new Gemma models for conversational AI chatbots, content generation, search, analytics, and more through Takeoff's flexible deployment options.

Please reach out to explore how TitanML can power your AI applications.