Tencent and Inferact Partner on Hy4 Serving and vLLM Support
Tencent and Inferact, the company founded by the creators of vLLM, are collaborating on production serving for Hy4, Tencent's newest flagship model, and native vLLM support for Hy4 Preview, the companies announced on Inferact's website. Inferact already serves live Hy4 traffic for long context reasoning, tool use, multimodal inputs and conversations with multiple turns.
Tencent controls the model checkpoint, serving requirements and validation standards. Inferact manages capacity, routing, caching, monitoring and failure recovery while testing the service against Tencent's API contract, performance targets and model quality requirements.
The companies co lead native vLLM integration for Hy4 Preview, an open weight mixture of experts model. Tencent contributes the architecture and reference behavior, while Inferact develops the engine support for model loading, parallel execution, cache management and parsing. Hy4 Preview's public serving path supports a context window exceeding one million tokens, speculative decoding and distributed execution.
The teams are also developing validation coverage, deployment configurations, performance guidance and reproducible serving recipes. Findings from production use can be incorporated into Hy4 Preview's public implementation or upstreamed into vLLM.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Enterprise AI Brief or Daily AI Brief.
Also, consider following us on social media:
More from Enterprise
Nov 11 Orange Adds Claude, Gemini, Mistral and GPT to New Apps Nov 11 Databricks Plans $3 Billion Europe and Middle East Investment Nov 10 Zendesk Launches Outcome AI Platform With Unlimited Seats and Outcome-Based Pricing Nov 10 Google Cloud Launches Gemini for Healthcare With HCA, Northwell and Optum Nov 10 Anthropic launches Claude Meetings to join video calls and work on tasks live, plus Whiteboards and SheetsEnterprise AI Brief
Weekly report on AI business applications, enterprise software releases, automation tools, and industry implementations.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
DeepSeek Open Sources DeepInfer Inference Framework
llm-d 1.0 Adds Controls for In House AI Inference
Liquid AI Releases LFM2.5-24B-A2B for Local AI Agents
IBM open sources vLLM plugin for runtime model controls
Liquid AI Releases LFM3, Six Open-Weight Models for On-Device AI
Daily AI Brief: the AI news that matters, in your inbox.