Tetrate and Bloomberg Unveil Open Source Envoy AI Gateway
Tetrate and Bloomberg have released the first stable version of the open source Envoy AI Gateway, built on CNCF's Envoy Gateway project, announced in a press release. This initiative aims to expand Envoy's capabilities and accelerate generative AI application development.
The Envoy AI Gateway, now available for download on GitHub, provides a unified API interface for developers integrating applications with generative AI services. It supports integrations with AWS Bedrock and OpenAI, offering features like upstream authorization and usage rate limiting based on word tokens.
Bloomberg is utilizing the Envoy AI Gateway to scale its generative AI application development, managing GenAI services through a consistent API. This approach simplifies development and enhances the company's ability to deliver innovative AI services.
Future enhancements for the Envoy AI Gateway include Google Gemini 2.0 integration, provider and model fallback logic, prompt templating, and semantic caching. These features aim to ensure service continuity and reduce costs associated with LLM interactions.
We hope you enjoyed this article.
Consider subscribing to one of several newsletters we publish like Enterprise AI Brief.
Also, consider following us on social media:
More from: Enterprise
Subscribe to Daily AI Brief
Daily report covering major AI developments and industry news, with both top stories and complete market updates
Market report
2025 Generative AI in Professional Services Report
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read more