Union Alpha and Laguna Lead an Incomplete Test
AI-моделиLLMтестирование моделей
What the first model run revealed
I would not call this a ranking yet, but the initial picture is already interesting: Union Alpha and Laguna-S-2.1 performed better than the rest. The primary source is not a model card or a standardized benchmark, but a developer’s notes from a published discussion about a real, unfinished test run.
The test included Union Alpha, Nex-N2.5-Pro, Dots-3-Note, Laguna-S-2.1, Cohere North-mini-code, Nemotron-3-Ultra, Gemma-4-31B, and GLM-5.2. The latter ran without tool calling and with a 32K context window. The run had to be stopped because of a thunderstorm and computers being disconnected from power, so the results only reflect the state of testing at that point.
Union Alpha was slow, but it kept working. Laguna-S-2.1 looked convincing in terms of quality, yet an unstable provider let it down. This is an important distinction: in a practical setting, a model that answers slightly worse but remains predictably available can sometimes be more useful than a stronger model behind an unreliable API.
Nex-N2.5-Pro received a cautious assessment as promising. Cohere North-mini-code appeared weak, Dots-3-Note broke down with large contexts, and no conclusion could be reached about Nemotron-3-Ultra because its provider was unstable. Gemma-4-31B and GLM-5.2 performed poorly in this run, although the specific reasons were not examined separately.
The discussion also raised a hypothesis that another system, JEV, may be based on Qwen 2.5 14B, with the 32K window cited as an indirect clue. This is an OSINT reconstruction rather than a confirmed architecture. The participant had not tested JEV at that point.
Why stability matters more than a neat model list
The main practical takeaway is simple: a run like this measures not only a model’s intelligence, but the entire path to its answer. Provider quality, latency, long-context retention, and tool-calling availability can shift results more dramatically than differences in abstract generation quality.
Union Alpha wins this preliminary round not on speed, but because it continued responding. Laguna-S-2.1 looks like a strong candidate, but unreliable access makes it risky for long-running agent tasks. Dots-3-Note has already exposed a more specific boundary: problems emerge as context grows.
In the next run, I would first separate model errors from provider errors, then repeat the same tasks at a fixed context length. Otherwise, a weak API can easily be mistaken for a weak LLM, and an occasional good answer for consistent quality.
This is not a final verdict, but a useful snapshot of engineering reality: models are selected as part of a whole system, and the name on an endpoint often says less than its behavior after several hours of work.