Skip to content

Add NVIDIA (build.nvidia.com / NIM) as a supported model provider #3356

Description

@aheritier

Summary

Add first-class support for NVIDIA (NIM / build.nvidia.com) as an OpenAI-compatible model provider via the alias map.

Why

NVIDIA provides access to Nemotron and many other open models through build.nvidia.com (with a free tier) and supports on-prem/self-hosted deployment via NVIDIA NIM. OpenAI-compatible API makes hosted access a simple alias addition, with a configurable base URL for on-prem NIM.

Resources

Definition of Done

  • Alias entry added: "nvidia": {APIType: "openai", BaseURL: "https://integrate.api.nvidia.com/v1", TokenEnvVar: "NVIDIA_API_KEY"}
  • Unit test added; asserts alias resolves and IsCatalogProvider("nvidia") is true
  • Provider appears in model catalog via CatalogProviders()
  • On-prem NIM usage via custom base_url documented
  • task test and task lint pass
  • Example YAML config using an NVIDIA model added

Metadata

Metadata

Labels

area/modelsLLM model integrations and model providersarea/providersFor features/issues/fixes related to LLM providers (Bedrock, LiteLLM, Qwen, custom, etc.)

Fields

No fields configured for Enhancement.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions