Skip to main content

Best AI models for regex automata

Ranked by accuracy on the meo “regex automata” domain — one of eleven un-leaked, contamination-resistant domains. Per-domain strength reveals where a model genuinely reasons versus where it pattern-matches; the leaders differ sharply by domain.

Ranking 82 models across the meo-tested roster · as of 2026-10-19.

#ModelLabaccuracy
1OpenAI: GPT-5.5openai100%
2Google: Gemini 4 Argongoogle100%
3Anthropic: Claude Opus 5.5anthropic100%
4OpenAI: GPT-5.5 Proopenai100%
5OpenAI: GPT-6.1 Solopenai100%
6Anthropic: Claude Fable 5anthropic100%
7Anthropic: Claude Opus 4.8anthropic100%
8inclusionAI: Ring-2.6-1Tinclusionai100%
9Google: Gemini 3.5 Flashgoogle100%
10DeepSeek: DeepSeek V4 Flash 0423deepseek100%
11Qwen: Qwen3.7 Maxqwen100%
12MoonshotAI: Kimi K3moonshotai100%
13DeepSeek: DeepSeek V4 Pro 0423deepseek100%
14Google: Gemini 3.1 Pro Previewgoogle100%
15SpaceXAI: Grok 4.7x-ai100%
16Qwen: Qwen3.5-Flashqwen100%
17OpenAI: GPT-5 Miniopenai100%
18SpaceXAI: Grok 4.3x-ai100%
19Xiaomi: MiMo-V2.5xiaomi100%
20Z.ai: GLM 5.1z-ai100%
21Z.ai: GLM 5.2z-ai94%
22NVIDIA: Nemotron 3 Ultranvidia94%
23OpenAI: GPT-5.4 Nanoopenai94%
24Qwen: Qwen3.6 Flashqwen94%
25MoonshotAI: Kimi K2.7 Codemoonshotai94%
26Qwen: Qwen3.7 Plusqwen94%
27ByteDance Seed: Seed 1.6bytedance-seed94%
28Google: Gemma 4 31Bgoogle94%
29MiniMax: MiniMax M3minimax88%
30MoonshotAI: Kimi K2.6moonshotai88%
31OpenAI: GPT-5.1-Codex-Miniopenai88%
32Qwen: Qwen3 VL 30B A3B Instructqwen88%
33Nex AGI: Nex-N2-Pro (free)nex-agi88%
34Qwen: Qwen3 VL 235B A22B Instructqwen88%
35Qwen: Qwen3 VL 30B A3B Thinkingqwen88%
36Baidu: ERNIE 4.5 VL 424B A47B baidu88%
37Qwen: Qwen3 VL 32B Instructqwen81%
38OpenAI: GPT-4.1 Miniopenai81%
39Qwen: Qwen3 VL 8B Thinkingqwen81%
40Google: Gemini 3.1 Flash Lite Previewgoogle81%
41ByteDance Seed: Seed 1.6 Flashbytedance-seed81%
42Google: Gemini 2.5 Flash Litegoogle81%
43Google: Gemma 4 26B A4B google81%
44NVIDIA: Nemotron 3 Nano Omni (free)nvidia81%
45Owl Alphaopenrouter75%
46Xiaomi: MiMo-V2.5-Proxiaomi75%
47Z.ai: GLM 4.6Vz-ai75%
48Mistral: Mistral Small 4mistralai75%
49Qwen: Qwen3.5 Plus 2026-02-15qwen69%
50Perceptron: Perceptron Mk1perceptron69%
51Google: Gemini 3.1 Flash Litegoogle69%
52Mistral: Ministral 3 8B 2512mistralai69%
53OpenAI: GPT-5 Nanoopenai69%
54Google: Gemma 3 27Bgoogle69%
55Qwen: Qwen2.5 VL 72B Instructqwen69%
56Qwen: Qwen3 VL 8B Instructqwen63%
57StepFun: Step 3.7 Flashstepfun63%
58Arcee AI: Trinity Large Thinkingarcee-ai63%
59Mistral: Mistral Large 3 2512mistralai56%
60MiniMax: MiniMax-01minimax56%
61OpenAI: GPT-4.1 Nanoopenai56%
62Tencent: Hy3 previewtencent50%
63Mistral: Mistral Small 3.2 24Bmistralai50%
64OpenAI: GPT-4o-miniopenai50%
65Mistral: Ministral 3 14B 2512mistralai44%
66Meta: Llama 4 Maverickmeta-llama44%
67Meta: Llama 4 Scoutmeta-llama44%
68ByteDance Seed: Seed-2.0-Litebytedance-seed44%
69Perplexity: Sonarperplexity38%
70Qwen: Qwen3.6 Plusqwen38%
71ByteDance Seed: Seed-2.0-Minibytedance-seed38%
72Qwen: Qwen3.5-27Bqwen31%
73Mistral: Ministral 3 3B 2512mistralai31%
74Anthropic: Claude 3 Haikuanthropic31%
75Google: Gemma 3 12Bgoogle25%
76Qwen: Qwen3.6 35B A3Bqwen25%
77Google: Gemma 3 4Bgoogle25%
78NVIDIA: Nemotron Nano 12B 2 VL (free)nvidia25%
79Amazon: Nova Lite 1.0amazon19%
80Qwen: Qwen3.5-35B-A3Bqwen19%
81Meta: Llama 3.2 11B Vision Instructmeta-llama19%
82Qwen: Qwen3.5-9Bqwen13%

← All rankingsMethodology & 𝕍 →