NVIDIA expands Agent Toolkit: enterprise agents with your data and a secure runtime

NVIDIA has added new building blocks to its open-source Agent Toolkit. They're meant to feed enterprise AI agents with company data, limit what they can access and make their behavior observable.

Tools Oct 21, 2026 4 min read Source: NVIDIA Blog
Illustrative image, AI-generated

What it's about

On October 21, 2026, NVIDIA expanded its open-source Agent Toolkit. An AI agent is a program that doesn't just answer questions but carries out tasks on its own, such as querying data or triggering actions. NVIDIA's rationale for the expansion: agents are only as useful as what they know, and only as trustworthy as the boundaries they operate within. The toolkit is meant to help companies customize agents, feed them company data, monitor them and keep them under control.

What the toolkit contains

According to NVIDIA, the toolkit has five parts:

  • Agent Knowledge Foundation (new), with CUDA-X libraries, meaning GPU-accelerated software building blocks from NVIDIA
  • Open models, including Nemotron Retriever and the new Kumo family
  • OpenShell, a secure runtime for agents
  • NemoClaw, blueprints (reference designs) for secure, specialized agents
  • Tools and skills such as NeMo Relay and NeMo Compass

NVIDIA argues that anyone who wants to build agents that do real work needs an open stack of models, harness (the control layer around the model), runtime, data and tools.

Agent Knowledge Foundation: making company data usable

The Foundation is meant to turn raw data into knowledge agents can use: find relevant information, understand what it means for the business and derive predictions from it. According to NVIDIA, this works without moving data, rebuilding existing workflows or changing governance rules.

It includes the CUDA-X libraries cuDF (dataframes), cuGraph (graphs), cuML (machine learning), cuOpt (optimization) and cuVS (vector search). New is the Auto-Ontology library. An ontology is a structured description of concepts and their relationships. The library translates raw data into business concepts such as customers, products and orders, and maps how they relate to each other.

Also included are the open models Nemotron Retriever and the Kumo Structured models: Kumo Tabular, Kumo Relational, Kumo Time Series and Kumo Forecast. They help agents find the right company information and make predictions. The sources don't give parameter counts, licenses or download locations.

Security and optimization

OpenShell draws the line on what agents can access and do. The NemoClaw blueprints provide templates for specialized, secure agents. The newest blueprint, for agent optimization, is meant to offer a step-by-step entry point for making agents better over time.

Who's using it (claims from NVIDIA)

Company Usage according to NVIDIA
Palantir / NVIDIA supply chain Agent Knowledge Foundation via Foundry, Ontology and AIP, to deploy specialized agents and predict outcomes
Databricks Kumo Anomaly with Databricks Genie Ontology for context-aware agents
Snowflake Kumo Engine and Kumo Relational in Snowflake Notebooks
Amazon OpenSearch Service With the embedding model, better relevance with fewer search steps and virtually no added latency
SAP Fine-tuned reranker almost 3x faster
ServiceNow Better reranking quality with nearly a quarter less latency
Zoom Better document understanding, search relevance and context retrieval

Other companies building on the Foundation, according to NVIDIA, include AWS, ClickHouse, Cloudera, Cohesity, Dassault Systèmes, Dell, Elastic, Exa, IBM, NetApp, Oracle, Perplexity, Starburst and VAST Data. A session at GTC Berlin covers the topic.

Our take

The announcement shows NVIDIA's strategy of offering not just chips but a full software stack for enterprise agents. A blockchain.news report places it in a series of earlier expansions in 2026, such as BioNeMo, Omniverse and PhysicsNeMo. The benefits are mainly for companies that want to run agents on their own data and value control. The caveat: all performance figures and deployment examples come from NVIDIA itself and haven't been independently verified. It's also unclear how openly the individual components are licensed and how tightly the stack ties you to NVIDIA hardware, since the CUDA-X libraries are built for NVIDIA GPUs.

Sources

#nvidia#agents#enterprise#open-source#nemotron
Read the original source

Ask the AI assistant

Questions about this article, installation or background? Our assistant knows this page and runs on our own machine, not in someone else's cloud.

Connecting …

The Assistant is an AI (Gemma 4) and can make mistakes – please check important details against the source. Questions are used only to generate an answer and are deleted after one hour. Please don't enter any personal data.

Comments

What do you think? Already tried it? Write it here, no sign-up needed.

  1. Loading comments …

Comments are public. Links aren't allowed, and we delete abusive posts. You can delete your own comment at any time in this browser. Learn more in the Privacy Policy.