Head to head

Beam vs Nemotron 3 Ultra

13:1

Beam wins 13 of 15 shared benchmarks

1 tie

Verdict

Against NVIDIA's Nemotron 3 Ultra, another US open model, Beam is clearly stronger: it wins 13 of 15 shared benchmarks, ties on AA-LCR and trails only on IFBench. The biggest gaps are on Terminal-Bench, BrowseComp and SWE-Bench Pro.

Benchmark by benchmark

Benchmark	Beam	Nemotron 3 Ultra	Difference
SWE-Bench Pro v1	65.5	46.4	+19.1
Terminal-Bench v2.1	80.1	56.4	+23.7
SWE-Bench Multilingual	78.0	67.7	+10.3
SWE-Bench Verified	80.9	70.7	+10.2
Humanity's Last Exam (no tools)	36.2	26.7	+9.5
SciCode	49.7	44.6	+5.1
CritPt (AA)	16.3	3.1	+13.2
GPQA Diamond	90.5	87.0	+3.5
MCP Atlas	78.7	63.1	+15.6
τ³ banking	38.0	22.6	+15.4
BrowseComp (context mgmt)	77.4	44.4	+33.0
AA-LCR (long context)	79.3	79.3	0.0
LongBench v2	65.5	61.9	+3.6
IFBench	79.7	81.7	-2.0
AA Omniscience index (public split)	13.0	8.6	+4.4

All scores are from Reflection's announcement (October 8, 2026 revision). Scores for Nemotron 3 Ultra are as cited by Reflection from Artificial Analysis and DataCurve.

The two models

	Beam	Nemotron 3 Ultra
Developer	Reflection AI	NVIDIA
Based in	United States	United States
Parameters (total / active)	501B / 23B	550B / 55B
Weights	Apache 2.0, promised for later in October 2026	OpenMDW-1.1
Released	October 5, 2026	June 4, 2026
How to access	Waitlisted beta API; weights coming	Hugging Face, NVIDIA NIM