Tencent and Inferact Partner on Hy4 Serving and vLLM Support

Nov 11, 2026
Inferact, founded by the creators of vLLM, serves Tencent Hy4 in production and co leads native vLLM support for the open weight Hy4 Preview.

Tencent and Inferact, the company founded by the creators of vLLM, are collaborating on production serving for Hy4, Tencent's newest flagship model, and native vLLM support for Hy4 Preview, the companies announced on Inferact's website. Inferact already serves live Hy4 traffic for long context reasoning, tool use, multimodal inputs and conversations with multiple turns.

Tencent controls the model checkpoint, serving requirements and validation standards. Inferact manages capacity, routing, caching, monitoring and failure recovery while testing the service against Tencent's API contract, performance targets and model quality requirements.

The companies co lead native vLLM integration for Hy4 Preview, an open weight mixture of experts model. Tencent contributes the architecture and reference behavior, while Inferact develops the engine support for model loading, parallel execution, cache management and parsing. Hy4 Preview's public serving path supports a context window exceeding one million tokens, speculative decoding and distributed execution.

The teams are also developing validation coverage, deployment configurations, performance guidance and reproducible serving recipes. Findings from production use can be incorporated into Hy4 Preview's public implementation or upstreamed into vLLM.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like Enterprise AI Brief or Daily AI Brief.

Also, consider following us on social media:

Free newsletter

Enterprise AI Brief

Weekly report on AI business applications, enterprise software releases, automation tools, and industry implementations.

Market report

2025 Generative AI in Professional Services Report

Thomson Reuters

This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.

Read more
Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.