Press "Enter" to skip to content

Prince Mario-Max Schaumburg-Lippe: Five Small Qwen Models Team Up to Match a Frontier Giant

Five copies of the same mid-size open model walk into a shared folder. That is not a joke setup. It is, more or less, how a GitHub project called GVS5H reported one of the more startling coding results of the fall on October 25.

The project runs five fresh instances of Qwen3.8-27B, a 27-billion-parameter open-weight model, and gives each one a job. They coordinate through a shared filesystem – a plan file, a tasks file, notes and the current solution – with one instance acting as a verifier. No extra training. No fine-tuning. Just organization, written down where every instance can read it.

The reported score: 92.4% pass@1 on 100 hard LiveCodeBench problems. The same model, asked once on its own, scored 66.8%. Claude Fable 5, a frontier proprietary model, sits at 90.4% on the same set in the project’s comparison. Read that again slowly. The weights did not change. The workflow did.

How a shared folder does the heavy lifting

Anyone who has managed people will recognize the trick. A single long conversation with a coding model tends to smear. Early instructions fade, failed attempts pile up, and the model starts defending its own wrong turn because it can still see it. GVS5H splits the work instead. One instance plans. Others take tasks from the list. A verifier checks the result against the problem rather than against the mood in the room.

Fresh context per role is the quiet hero here. Each instance starts clean, reads the shared plan, does its piece and writes back what it learned. The project’s transcript analysis points to exactly that – decomposition and persistent context – as the source of the gain. The folder remembers so the models do not have to pretend to.

It rhymes with a pattern readers saw in our coverage of Kimi K3.1 Pro and its promised open weights. Open models keep getting easier to run, adapt and, now, organize. Access is only half the story. What you do with five of them at once turns out to be the other half.

The honest caveats, up front

Now the part that keeps this story credible. An agentic loop is not a single-pass benchmark run, and the project’s own authors disclose that the comparison baseline was not run under equivalent conditions. LiveCodeBench is a 2025-era benchmark that the field has largely saturated. There are no numbers here against several other frontier systems that readers will reasonably ask about. And the gains are not universal – across the 11 models tested, some improved a lot, some barely moved, and a few got worse.

Grant all of that. The story survives, because the score was never really the story. The jump from 66.8% to 92.4% with identical weights is a measurement of something else: how much performance is sitting in coordination rather than in scale. That is a number worth knowing even if you discount the headline comparison entirely.

A second route, at 9 percent of the cost

The paper behind the project describes two routes to frontier-level accuracy. The local one is the Qwen result above. The hosted one: an orchestrated Qwen3.8 Flash Next reached 93.0% against Fable 5’s 90.4%, at about 9% of the cost. Gains across models ran as high as 25.6 percentage points on pinned backends.

Costs need care, too. In the project’s own accounting, a managed five-instance pass over the 100 problems costs more than a single call to the small model – organization is not free. The economics get interesting in a different place. If you run open weights on hardware you already own, the meter is your electricity and your patience, not a per-token bill. That is the angle small teams should circle. You may never own the biggest model. You can absolutely own the best-organized team of small ones.

Why this matters beyond one benchmark

Think about who this helps. A two-person software studio cannot outspend a frontier lab. It can, however, write a good plan file, split work sensibly and insist on a verifier that does not grade its own homework. Those are habits, not budgets. GVS5H suggests habits now buy measurable points.

There is a parallel in the physical world in our recent reporting on Waymo starting driverless rides at Las Vegas airport and on Tesla robotaxis logging 3.1 million miles. In both cases, the public argument is about the machine. The operational story is about the system around the machine – dispatch, checking, recovery, repetition. Software agents are arriving at the same lesson from the other direction.

What to try on Monday morning

Start small and keep the receipts. Pick ten hard problems your team already knows the answers to. Run your current model once, alone, and log the score. Then run the same model in roles – planner, worker, verifier – sharing one folder and one task list. Log that score too, plus the time and the cost. If the gap looks anything like 66.8 to 92.4, you will not need a benchmark paper to convince anyone in the building.

Keep the verifier strict. Keep the plan file short enough that a human can read it in two minutes. And keep the single-pass result pinned next to the team result, caveats and all. Honest bookkeeping is what turns a clever trick into a practice you can trust.

Five Qwens in a shared folder did not end the race for bigger models, and this project does not claim otherwise. It did something more useful for most working teams. It showed, with numbers anyone can argue about in the open, that structure is a form of capability – and structure is something you can build this week, on models you can already run.


Also published on:

More from AI Artificial IntelligenceMore posts in AI Artificial Intelligence »
More from BREAKING NEWSMore posts in BREAKING NEWS »

Be First to Comment

Leave a Reply

Your email address will not be published. Required fields are marked *