Z.ai Releases Open-Source GLM Models with Advanced Reasoning

Zhipu AI has announced the open-sourcing of its GLM model series, including the 32B and 9B models, under the MIT license, as stated in a press release. These models, which include base, reasoning, and rumination variants, are now accessible for free on the new z.ai website.

The GLM-4-32B-0414 base model, featuring 32 billion parameters, is designed to compete with larger mainstream models. It has been pre-trained on 15 terabytes of high-quality data, focusing on reasoning, and employs advanced techniques like rejection sampling and reinforcement learning to enhance its performance in tasks such as engineering code generation and function calls.

The GLM-Z1-32B-0414 reasoning model builds on the base model with advanced reasoning capabilities, showing significant improvements in mathematical reasoning and complex problem-solving. It matches the performance of much larger models in certain tasks, demonstrating its efficiency and capability.

Additionally, the GLM-Z1-9B-0414 model offers impressive performance for its size, making it suitable for resource-constrained environments. The rumination model, GLM-Z1-Rumination-32B-0414, represents a step towards exploring the future of AGI, capable of handling complex, open-ended problems through a multi-step deliberation process.