OpenAI Reports Major GPT-6 Coding Gains in COBOL and Fortran
OpenAI reports in a company blog post that its latest models perform better at coding in languages with limited training data, including COBOL, Fortran and Visual Basic. The company created two evaluations covering the construction of new software and the migration of existing COBOL programs.
In MultiLangBench, models must build a SQLite compatible database engine in 20 programming languages. GPT-6 Astra recorded an average test pass rate of 87.4%, compared with 26.8% for GPT-5.6 Sol. Its scores included 72.1% for COBOL, 83.5% for Fortran and 89.4% for Visual Basic. GPT-6 Luna reached 40.3% at an estimated average API cost of $0.77 per sample, about 78% below GPT-5.6 Sol.
A separate evaluation tested migrations from COBOL to C++, Java, Kotlin, Python or Rust while requiring identical observable outputs. GPT-6.1 Sol reached 86.6% accuracy at low reasoning effort, up from 5.4% for GPT-5.6 Sol, while costing 39% less. Accuracy rose to 97.9% with more reasoning. OpenAI also released the MultiLangBench setup and test suite on GitHub, and said migrations of production software still require expert review and testing.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Daily AI Brief or AI Programming Weekly.
Also, consider following us on social media:
AI Programming Weekly
Weekly news about AI tools for software engineers, AI enabled IDE's and much more.
Whitepaper
Tensordyne Napier: What If One Rack Could Do the Work of Nine?
Tensordyne
This Tensordyne whitepaper presents Napier, an inference-focused AI processor and rack-scale system based on the company’s TDN Math logarithmic number system. It examines infrastructure requirements for large mixture-of-experts and agentic models, compares major inference architecture approaches, and details the TDN AIP processor, TDN72 pod, TDN Link fabric, and Napier Ultra configuration. The paper reports simulation-based performance, cost, and accuracy-validation results, including Tensordyne’s projected comparison of one Napier rack with a nine-rack Nvidia Rubin plus Groq deployment; the chip is reported as taped out and in fabrication.
Read moreYou may also like
OpenAI Releases GPT-6.1 Sol at One Fifth of Astra Token Pricing
LILT Launches AURORA Multilingual AI Leaderboard
OpenAI Rolls Out GPT-6 and Intelligent UI in ChatGPT
Unitree Founder Says GPT-6 Could Accelerate Robotics Breakthrough
UK Safety Test Finds GPT-6 Astra Conducted Simulated Supply Chain Attacks
Daily AI Brief: the AI news that matters, in your inbox.