LF AI & Data Foundation Launches Vortex Project for Enhanced Data Access

August 07, 2025
The LF AI & Data Foundation has announced the Vortex Project, a new columnar storage format designed to improve data access for AI and analytics, with contributions from industry leaders like Microsoft and Snowflake.

The LF AI & Data Foundation has announced the launch of the Vortex Project, an innovative columnar storage format aimed at enhancing data access for AI and analytics applications. Announced in a press release, Vortex is designed to bridge the gap between cloud storage and heterogeneous computing environments, offering seamless data handling across memory, disk, and network formats.

Contributed by SpiralDB, Vortex is supported by major industry players including Microsoft, Snowflake, and NVIDIA. The project aims to address the limitations of legacy storage formats by providing a platform optimized for multimodal data, wide schemas, and GPU-based workloads. Vortex promises significant performance improvements, such as 100x faster random access reads and 10-20x faster scans compared to existing formats like Apache Parquet.

Vortex's architecture is designed to be extensible, allowing for the integration of new compression techniques and ensuring it remains at the forefront of storage technology. The project also features native integrations with key open-source data tools, enhancing its utility in modern data systems. The LF AI & Data Foundation encourages broad participation from the global open-source community to further develop and optimize Vortex for diverse workloads.

We hope you enjoyed this article.

Consider subscribing to one of our newsletters like Silicon Brief or Daily AI Brief.

Also, consider following us on social media:

AI Chips & Datacenters AI Brief AI Brief (X)

More from: Data Centers

08/11
SK Hynix Projects 30% Annual Growth in AI Memory Market
08/09
SoftBank Acquires Ohio Plant for AI Data Center Project
08/09
ChemTreat Introduces CTSolutions D2C for AI Data Center Cooling
08/08
Deutsche Telekom Plans AI Data Center with Nvidia and Brookfield
08/08
Oracle Launches Globally Distributed Exadata Database on Exascale Infrastructure

Subscribe to Silicon Brief

Weekly coverage of AI hardware developments including chips, GPUs, cloud platforms, and data center technology.

AI Token Webinar

Whitepaper

Governing the Future: A Strategic Framework for AI Adoption in Financial Institutions

This whitepaper explores the transformative impact of artificial intelligence on the financial industry, focusing on the governance challenges and regulatory demands faced by banks. It provides a strategic framework for AI adoption, emphasizing the importance of a unified AI approach to streamline compliance and reduce operational costs. The document offers actionable insights and expert recommendations for banks with fewer than 2,000 employees to become leaders in compliant, customer-centric AI.

Read more

You May Also Like