Myrtle.ai's VOLLO Sets Record in Financial ML Inference Benchmark
Myrtle.ai announced in a press release that its VOLLO inference accelerator achieved new record performance in the STAC-ML (Markets) Inference benchmark for financial applications. The audited results, presented at the STAC Summit in London, showed VOLLO reaching latencies as low as 2 microseconds at the 99th percentile, halving its previous record.
The benchmark evaluates latency, throughput, and efficiency for systems processing market data in real time. VOLLO outperformed all previously audited systems across three benchmark models, demonstrating consistent low latency suitable for trading, risk analysis, and quoting.
The tested configuration used a Silicom FBAP4@VP18-2L0S PCIe accelerator card with an AMD Versal Premium VP1802 Adaptive SoC, installed in a Supermicro AS-2015CS-TNR server. According to Myrtle.ai, this hardware combination supports deterministic inference performance for complex models.
VOLLO has been deployed in production trading environments and allows machine learning developers to compile models using standard tools and run them on FPGA-based systems. Full benchmark details are available in the STAC Report (SUT ID MRTL260323).
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Finance AI Weekly or Daily AI Brief.
Also, consider following us on social media:
More from Finance
Nov 19 Arizona opens criminal investigation into OpenAI over what it calls rogue AI agents in banks Nov 19 Citi tells customers they are on their own if third-party AI agents misuse their accounts Nov 18 Klarna launches an AI concierge that books, shops and drafts emails Nov 18 Singapore sets up sandbox for AI agent payments under new national AI missions for finance Nov 18 Payhawk raises $280 million at a $2 billion valuation to build an AI-agent finance platformFinance AI Weekly
Weekly newsletter about AI in finance. Covers AI-driven trading, fintech innovations, and data analytics transforming markets
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
Luminal raises $25 million to run AI inference on chips beyond Nvidia's
IBM open sources vLLM plugin for runtime model controls
Microsoft releases seven MAI models at Ignite, led by MAI Code 2, and opens licensed weights
Tohoku University and AISIN Build AI Chip With 65.7 Millisecond Startup
FuriosaAI Raises $620 Million to Scale Inference Chip Production
Daily AI Brief: the AI news that matters, in your inbox.