Nvidia’s new OpenWeight Nemotron 3 combines three different architectures to beat GPT-OSS and QUEN at super throughput

Multi-agent systems, designed to handle long-horizon tasks like software engineering or cybersecurity triaging, can generate up to 15 times the token volume of standard chat – jeopardizing their cost-effectiveness in handling enterprise tasks.

But today, Nvidia asked for help solving this problem Release of Nemotron 3 SuperA 120-billion-parameter hybrid model with postulated weights hugging face.

By merging disparate architectural philosophies – state-space models, transformers, and a novel “latent” mix—experts’ design – Nvidia is attempting to provide the specialized depth needed for agentic workflows without the typical bloat of dense logic models, and all while being available for commercial use under a mostly open weight.

Triple Hybrid Architecture

At the core of the Nemotron 3 Super is a sophisticated architectural triad that balances memory efficiency with precise logic. The model uses a Hybrid Mamba-Transformers BackboneWhich combines Mamba-2 layers with strategic transformer attention layers.

To understand the implications for enterprise production, consider the “needle in a haystack” problem. Mamba-2 layers act like a “fast-travel” highway system, handling the vast majority of sequence processing with linear-time complexity. This allows the model to maintain a huge 1-million-token context window without exploding the memory footprint of the KV cache. However, pure state-space models often struggle with associative recall.

To fix this, Nvidia has strategically inserted Transformer attention layers as “global anchors”, ensuring that the model can accurately retrieve specific facts hidden deep within a codebase or a stack of financial reports.

Beyond the spine, the model introduces Latent Mix of Experts (LatentMoE). Traditional mixture-of-experts (MOE) designs root tokens for experts in their full latent dimension, which poses a computational bottleneck as the model scales. LatentMoE solves this by interpolating tokens into a compressed space before sending them to experts.

This “expert compression” allows the model to consult four times more experts for the exact same computational cost. This granularity is important for agents who must switch between Python syntax, SQL logic, and conversational logic in a single step.

Multi-token prediction (MTP) is further accelerating the model. While standard models predict one next token, MTP predicts multiple future tokens simultaneously. It serves as an “underlying draft model”, enabling native speculative decoding that can provide up to 3x wall-clock speedup for structured generation tasks such as code or tool calls.

blackwell benefits

For enterprises, the most significant technological leap forward in Nemotron 3 Super is its optimization for the Nvidia Blackwell GPU platform. By originally pre-training in NVFP4 (4-bit floating point), Nvidia has achieved a breakthrough in production efficiency.

On Blackwell, the model produces inferences up to 4 times faster than 8-bit models running on the previous Hopper architecture, with no loss in accuracy.

In practical demonstration, the Nemotron 3 is a specialized device for super-agentic reasoning.

It is currently ranked No. 1 on the Deep Research Benchmark, a benchmark measuring AI’s ability to perform thorough, multi-step research across large document sets.

It also demonstrates significant throughput gains, achieving up to 2.2x more throughput than gpt-oss-120B and 7.5x more than Qwen3.5-122B in high-volume settings.

Custom ‘Open’ license – commercial use but with important warnings

Release of Nemotron 3 Super under nvidia open model license agreement (Updated October 2025) Provides a permissive framework for enterprise adoption, although it has separate “security” clauses that differentiate it from pure open-source licenses such as MIT or Apache 2.0.

Key provisions for enterprise users:

• Commercial Utility: The license explicitly states that the models are “commercially usable” and grants a perpetual, worldwide, royalty-free license to sell and distribute products built on the models.

• Ownership of Output: Nvidia makes no claims on the output generated by the model; Responsibility for—and ownership of—those outputs rests entirely with the user.

• Derivative works: Enterprises are free to create and own “derivative models” (exact versions), provided they include the required attribution notices: “Licensed by Nvidia Corporation under the Nvidia Open Model License.”

“Red Lines”:

Licenses include two important expiration triggers that production teams should monitor:

1. Safety Railing: If a user bypasses or circumvents the model’s “guardrails” (technical limitations or security hyperparameters) without implementing a “substantially identical” replacement appropriate for the use case, the license automatically terminates.

2. Litigation Trigger: If a user files a copyright or patent lawsuit against Nvidia alleging that the model infringes their IP, their license to use the model is immediately terminated.

This structure allows Nvidia to foster a commercial ecosystem while protecting itself from “IP trolling” and ensuring that the model’s security features are not stripped out for malicious use.

‘The team really cooked’

The release has generated significant discussion within the developer community. Chris Alexiuk, a senior product research engineer at Nvidia, introduced the launch on X under his handle @llm_wizard As a “Super Day” emphasizing the speed and transparency of the model. “Model is: Fast. Model is: Smart. Model is: The most open model ever,” Chris highlighted the release of 10 trillion tokens of not only weights, but also training data and recipes.

Industry adoption reflects this enthusiasm:

• Cloud and Hardware: The model is being positioned as a nvidia nim microservicesAllows it to be run on-premises via Dell AI Factory Or hpeAs well as on Google Cloud, Oracle, and soon, AWS and Azure.

• Production Agent: companies like code rabbit (Software Development) and grptile are integrating models to handle large-scale codebase analysis, while industry leaders prefer siemens And palantir It is being deployed to automate complex workflows in manufacturing and cybersecurity.

As Kari Brisky, Nvidia VP of AI software, said: “As companies move beyond chatbots to multi-agent applications, they face a context explosion.”

The Nemotron 3 Super is Nvidia’s answer to that explosion – a model that delivers the “brainpower” of a 120b parameter system with the operational efficiency of a much smaller specialist. For enterprises, the message is clear: “thinking” is ultimately diminishing.