Tencent Cloud Unveils GooseFS 2.0 for Enhanced AI Data Management

Tencent Cloud has launched GooseFS 2.0, a data accelerator aimed at optimizing AI workloads, announced in a press release. This upgrade is designed to support various AI scenarios by enhancing computing, metadata, and server-side accelerations, thereby improving performance and accessibility from data lakes.

GooseFS 2.0 maximizes hardware performance through short-circuit reads and metadata memory acceleration, achieving single-link speeds at the GBps level. It addresses hotspot distribution challenges with secondary caching, balancing cache space usage with high QPS/bandwidth capabilities to improve large model distribution efficiency.

The new architecture also incorporates hierarchical metadata management technology, enabling horizontal scaling of file clusters and achieving millions-level metadata IOPS. Additionally, cross-node hard links provide disaster recovery capabilities at the second level, even with metadata scales in the tens of billions.