Install NeMo Microservices Helm Chart#

Tip

Note: This setup is the full enterprise platform, meant for advanced use. If you’re just getting started, check out Getting Started instead — it’s faster and easier to explore the basics.

To deploy the NeMo Microservices Platform, follow these steps after completing the Prerequisites.

  1. Add the NeMo Microservices Helm Chart to your local Helm repositories.

    helm repo add nmp https://helm.ngc.nvidia.com/nvidia/nemo-microservices \
       --username='$oauthtoken' \
       --password=$NGC_API_KEY
    
    helm repo update
    
  2. Review the default values in the NeMo Microservices Helm Chart reference.

    To override the default values, create a custom values file. Review the following while creating your custom values file.

  3. Install the Volcano scheduler before installing the chart. This is required for the NeMo Customizer microservices.

    kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/v1.9.0/installer/volcano-development.yaml
    
  4. Install the chart using your values.yaml file:

    helm install nemo nmp/nemo-microservices-helm-chart -f values.yaml
    

    The installation process takes approximately 10 minutes for image downloads, container startup, and communication establishment. The time it takes might vary depending on the speed of your network connection. Pods might appear in pending or restarting states during the installation process.

  5. Verify the pod status:

    kubectl get pods
    

To upgrade the deployment with new configurations, use the following command:

helm upgrade nemo nmp/nemo-microservices-helm-chart -f values.yaml

To uninstall the deployment, use the following command:

helm uninstall nemo