EasyGeorgian publishes the first public benchmark of how well AI speaks Georgian

EasyGeorgian has published the Georgian AI Benchmark 2026, the first public evaluation dedicated to how well AI models handle the Georgian language. Eight leading models and Google Translate were tested on 230 original tasks covering translation in both directions, grammar, verb conjugation and the official romanization standard.

Georgian is spoken by around four million people, uses its own alphabet and has a verb system that is famously difficult. It is also absent from the standard multilingual AI benchmarks, which means nobody had measured how well the current generation of AI actually speaks it.

The results split into three clear tiers. Gemini 3.1 Pro and Claude Fable 5 tied at the top, with Gemini 3.5 Flash statistically alongside them. The GPT models and Grok form a strong second tier with one consistent weakness, romanized Georgian. Budget models scored far lower on grammar, and the failures land where learners would predict: case endings, verb forms and confident invention. One model stated that Georgian has five grammatical cases. It has seven.

“For understanding Georgian, the top models are now genuinely reliable, and that is new,” says Lasse. “For producing Georgian, the picture is much more uneven, and a beginner cannot tell the difference between a correct answer and a confident wrong one. That is exactly why the benchmark needed to exist.”

The complete dataset is free under a CC BY license, including test items, model outputs, judge decisions, scoring code and methodology. EasyGeorgian re-runs the benchmark as new models are released. The full results are at easygeorgian.com/georgian-ai-benchmark.

About EasyGeorgian

EasyGeorgian is a Georgian language learning platform operated by EasyGeorgian Development LLC, a company registered in Georgia and run from Tbilisi. It was founded by Lasse N., a Dane who moved to Tbilisi in 2021, and Tamar N., who is Georgian. The platform combines structured audio lessons, comprehensible input listening and spaced-repetition flashcards, and its courses are one-time purchases. More at easygeorgian.com.