EasyGeorgian publishes the second edition of its Georgian AI Benchmark | EasyGeorgian
All press releases

Tbilisi, Georgia

EasyGeorgian publishes the second edition of its Georgian AI Benchmark

EasyGeorgian has published the second edition of the Georgian AI Benchmark, an open test of how well AI models read and write Georgian. Six current models (Claude Fable 5.1, Claude Opus 5.5, Gemini 3.1 Pro, Gemini 3.8 Flash, GPT-6 Astra and Grok 4.7) were tested on 3,298 items built from Georgian that Georgians wrote: news articles, forum posts and decisions of the Constitutional Court of Georgia published in September and October 2026, after the models’ training cutoffs, together with the Georgian Academy of Sciences’ explanatory dictionary. No AI model wrote or checked any of the answers.

The results draw a clear line between reading and writing. Every model now reads Georgian almost perfectly, restoring 96 to 98 percent of half-deleted words in news articles. Writing is harder. Given a word’s dictionary form inside a real sentence, the best model wrote the exact form the Georgian author used 90 percent of the time and the weakest 83 percent. Verbs, which in Georgian carry the subject, often the object and the tense, are where every model slips most, and informal Georgian of the kind people write in forums and messages is harder still. GPT-6 Astra, Gemini 3.1 Pro and Gemini 3.8 Flash are statistically tied for first place.

The second edition replaces the first, published in July 2026, which scored the leading systems at 99.4 out of 100. Its questions were written by one AI model and checked by another, so it could not measure above the models that built it.

“Our first edition let AI check AI, and that can never find what AI gets wrong,” says Lasse. “This time the answer key is Georgian that Georgians wrote, and the picture is clear. AI reads Georgian well. If you are going to learn a sentence from it, have a Georgian read it first.”

The full results, method, public items, model answers and code are free to use under a CC-BY licence at easygeorgian.com/georgian-ai-benchmark.

About EasyGeorgian

EasyGeorgian is a Georgian language learning platform operated by EasyGeorgian Development LLC, a company registered in Georgia and run from Tbilisi. It was founded by Lasse N., a Dane who moved to Tbilisi in 2021, and Tamar N., who is Georgian. The platform combines structured audio lessons, comprehensible input listening and spaced-repetition flashcards, and its courses are one-time purchases. More at easygeorgian.com.

Media inquiries

Write to [email protected]. Logos, photos and the quick facts are on the press page.