Tetrate and Bloomberg Unveil Open Source Envoy AI Gateway

Feb 25, 2025
Tetrate and Bloomberg have released the first stable version of the open source Envoy AI Gateway, built on CNCF's Envoy Gateway project, to enhance enterprise AI integration.

Tetrate and Bloomberg have released the first stable version of the open source Envoy AI Gateway, built on CNCF's Envoy Gateway project, announced in a press release. This initiative aims to expand Envoy's capabilities and accelerate generative AI application development.

The Envoy AI Gateway, now available for download on GitHub, provides a unified API interface for developers integrating applications with generative AI services. It supports integrations with AWS Bedrock and OpenAI, offering features like upstream authorization and usage rate limiting based on word tokens.

Bloomberg is utilizing the Envoy AI Gateway to scale its generative AI application development, managing GenAI services through a consistent API. This approach simplifies development and enhances the company's ability to deliver innovative AI services.

Future enhancements for the Envoy AI Gateway include Google Gemini 2.0 integration, provider and model fallback logic, prompt templating, and semantic caching. These features aim to ensure service continuity and reduce costs associated with LLM interactions.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like Enterprise AI Brief or Daily AI Brief.

Also, consider following us on social media:

Enterprise AI AI Brief AI Brief (X)
Free newsletter

Enterprise AI Brief

Weekly report on AI business applications, enterprise software releases, automation tools, and industry implementations.

Guide
Hosted Speech Recognition APIs

Hosted Speech Recognition APIs

Industry analysis

2025 Global Business Services Agenda: Gen AI Takes Center Stage

The Hackett Group

This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.

Read more

You may also like

Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.