Skip to main content

Ctrl+K

NVIDIA NeMo Microservices Documentation

NVIDIA NeMo Microservices Documentation

Table of Contents

NeMo Microservices (in progress)

Getting Started
Quickstart Installation
Core Concepts
- Workspaces
Studio (old)
Core Concepts (old)

Example Applications (in progress)

About
Create custom evaluations using synthetic data
Build an end-to-end data flywheel
(TBD) Fine-tune models using synthetic data
(TBD) Deploy inference endpoints for agents

Models and Inference

About
Tutorials
- Deploy Models
- Run Inference

Design Synthetic Data (in progress)

About
Quickstart
Tutorials
- The Basics
- Seeding
Migrating from Standalone Library
API Reference

Guardrail Models (in progress)

Overview
About
Tutorials
Terminology
Observability

Evaluate Models (In Progress)

About
Tutorials
- Run an Evaluation
- Run an LLM Judge Eval
Metrics
Benchmarks
- Custom
- Agentic
- Industry
- Manage Jobs
- Results

Fine-tune Models (not started)

About
Tutorials
Model Catalog
Manage Targets
Manage Configs
Manage Jobs

Synthesize Safe Data (Beta)

Overview
Getting Started
About
Tutorials

Audit Model Safety (Beta) (not started)

About
Tutorials
Manage Targets
Manage Configs
Manage Audit Jobs
Viewing Audit Job Results
Reference

Platform (in progress)

About
Workspaces
Authorization
- Concepts
- Managing Access
Deploying to Kubernetes
Entity Storage
Files
Data Storage
Observability
Secrets
Security

Reference (in progress)

Release Notes
System Requirements
API Reference
SDK Reference
CLI Reference
Helm Chart
Troubleshooting
EULA
OSS License Acknowledgements

To-be-deleted: Old and currently unused

NVIDIA Distribution in Llama Stack
Tenant Configuration Options
MLFlow Customizer Secrets (Still needed?)
Infrastructure Configurations
Install Individually
Overview of NeMo Microservices
Key Features
Deploy NeMo Auditor with Docker
About Getting Started with NeMo Microservices
Jupyter Notebooks
Install NeMo Microservices Python SDK
Demo Cluster Setup
- Developer Setup Requirements
- Minikube
  - Set Up Using NeMo Platform Deployment Script
  - Set Up Manually
Beginner Platform Tutorials
Datasets
Entity Fields Reference
Models
Namespaces
Projects
Entity Management Tutorials
- Set Up Organizational Entities
- Create Dataset Files
Custom Resource Definitions
Feature Details
NeMo Studio Feature Overview
How NeMo Studio Works
Install and Launch NeMo Studio
Reference
Reference

Core Concepts

Core Concepts#

Learn about the foundational concepts that underpin the NeMo microservices platform.

Workspaces

Isolation boundaries for teams, users, or environments.

previous

Quickstart Installation

next

Workspaces

Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.