NVIDIA
NVIDIA NIM provides optimized inference microservices for AI models with enterprise-grade performance and scalability.
NVIDIA
NVIDIA NIM provides optimized inference microservices for AI models with enterprise-grade performance and scalability.
Authentication
API KeyAdd your NVIDIA API key from Organization → Integrations → AI Vendors. Keys are encrypted at rest and scoped to your organization.
Available Models
79 enabled models across 3 categories.
Text75
google/codegemma-1.1-7bchatModel, languageModel, completionModel
google/codegemma-7bchatModel, languageModel, completionModel
meta/codellama-70bchatModel, languageModel, completionModel
mistralai/codestral-22b-instruct-v0.1chatModel, languageModel, completionModel
functionCalling
nvidia/cosmos-nemotron-34bchatModel, languageModel, completionModel
reasoning, imageInput, vision
deepseek-ai/deepseek-coder-6.7b-instructchatModel, languageModel, completionModel
functionCalling
deepseek-ai/deepseek-r1chatModel, languageModel, completionModel
reasoning
deepseek-ai/deepseek-r1-0528chatModel, languageModel, completionModel
functionCalling, reasoning
deepseek-ai/deepseek-v3.1chatModel, languageModel, completionModel
functionCalling, reasoning
deepseek-ai/deepseek-v3.1-terminuschatModel, languageModel, completionModel
functionCalling, reasoning
deepseek-ai/deepseek-v3.2chatModel, languageModel, completionModel
functionCalling, reasoning
deepseek-ai/deepseek-v4-flashchatModel, languageModel, completionModel
functionCalling, reasoning
deepseek-ai/deepseek-v4-prochatModel, languageModel, completionModel
functionCalling, reasoning
mistralai/devstral-2-123b-instruct-2512chatModel, languageModel, completionModel
functionCalling, reasoning
google/gemma-2-27b-itchatModel, languageModel, completionModel
functionCalling
google/gemma-2-2b-itchatModel, languageModel, completionModel
functionCalling
google/gemma-3-12b-itchatModel, languageModel, completionModel
functionCalling
google/gemma-3-1b-itchatModel, languageModel, completionModel
functionCalling, imageInput, vision
google/gemma-3-27b-itchatModel, languageModel, completionModel
functionCalling, reasoning, imageInput, vision
google/gemma-3n-e2b-itchatModel, languageModel, completionModel
functionCalling, imageInput, vision
google/gemma-3n-e4b-itchatModel, languageModel, completionModel
functionCalling, imageInput, vision
google/gemma-4-31b-itchatModel, languageModel, completionModel
functionCalling, reasoning, imageInput, vision
z-ai/glm4.7chatModel, languageModel, completionModel
functionCalling, reasoning
z-ai/glm5chatModel, languageModel, completionModel
functionCalling, reasoning
z-ai/glm-5.1chatModel, languageModel, completionModel
functionCalling, reasoning
openai/gpt-oss-120bchatModel, languageModel, completionModel
reasoning
moonshotai/kimi-k2-instruct-0905chatModel, languageModel, completionModel
functionCalling
moonshotai/kimi-k2.5chatModel, languageModel, completionModel
functionCalling, reasoning, imageInput, vision
moonshotai/kimi-k2-instructchatModel, languageModel, completionModel
functionCalling, reasoning
moonshotai/kimi-k2-thinkingchatModel, languageModel, completionModel
functionCalling, reasoning
meta/llama-3.1-405b-instructchatModel, languageModel, completionModel
functionCalling
meta/llama-3.1-70b-instructchatModel, languageModel, completionModel
functionCalling
nvidia/llama-3.1-nemotron-51b-instructchatModel, languageModel, completionModel
functionCalling
nvidia/llama-3.1-nemotron-70b-instructchatModel, languageModel, completionModel
functionCalling
nvidia/llama-3.1-nemotron-ultra-253b-v1chatModel, languageModel, completionModel
functionCalling, reasoning
meta/llama-3.2-11b-vision-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
meta/llama-3.2-1b-instructchatModel, languageModel, completionModel
functionCalling
meta/llama-3.3-70b-instructchatModel, languageModel, completionModel
functionCalling
nvidia/llama-3.3-nemotron-super-49b-v1chatModel, languageModel, completionModel
nvidia/llama-3.3-nemotron-super-49b-v1.5chatModel, languageModel, completionModel
meta/llama3-70b-instructchatModel, languageModel, completionModel
functionCalling
meta/llama3-8b-instructchatModel, languageModel, completionModel
functionCalling
nvidia/llama3-chatqa-1.5-70bchatModel, languageModel, completionModel
functionCalling
meta/llama-4-maverick-17b-128e-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
meta/llama-4-scout-17b-16e-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
nvidia/llama-embed-nemotron-8bchatModel, languageModel, completionModel
mistralai/mamba-codestral-7b-v0.1chatModel, languageModel, completionModel
minimaxai/minimax-m2.1chatModel, languageModel, completionModel
functionCalling, reasoning
minimaxai/minimax-m2.5chatModel, languageModel, completionModel
functionCalling, reasoning
minimaxai/minimax-m2.7chatModel, languageModel, completionModel
functionCalling, reasoning
mistralai/ministral-14b-instruct-2512chatModel, languageModel, completionModel
functionCalling, imageInput, vision
mistralai/mistral-large-2-instructchatModel, languageModel, completionModel
functionCalling
mistralai/mistral-large-3-675b-instruct-2512chatModel, languageModel, completionModel
functionCalling, imageInput, vision
mistralai/mistral-small-3.1-24b-instruct-2503chatModel, languageModel, completionModel
functionCalling
nvidia/nemoretriever-ocr-v1chatModel, languageModel, completionModel
imageInput, vision
nvidia/nemotron-3-nano-30b-a3bchatModel, languageModel, completionModel
functionCalling, reasoning
nvidia/nemotron-3-super-120b-a12bchatModel, languageModel, completionModel
functionCalling, reasoning
nvidia/nemotron-4-340b-instructchatModel, languageModel, completionModel
functionCalling
nvidia/nvidia-nemotron-nano-9b-v2chatModel, languageModel, completionModel
functionCalling, reasoning
microsoft/phi-3.5-moe-instructchatModel, languageModel, completionModel
functionCalling
microsoft/phi-3.5-vision-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
microsoft/phi-3-medium-128k-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
microsoft/phi-3-medium-4k-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
microsoft/phi-3-small-128k-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
microsoft/phi-3-small-8k-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
microsoft/phi-3-vision-128k-instructchatModel, languageModel, completionModel
functionCalling, imageInput, vision
qwen/qwen2.5-coder-32b-instructchatModel, languageModel, completionModel
functionCalling
qwen/qwen2.5-coder-7b-instructchatModel, languageModel, completionModel
functionCalling
qwen/qwen3-235b-a22bchatModel, languageModel, completionModel
functionCalling, reasoning
qwen/qwen3.5-397b-a17bchatModel, languageModel, completionModel
functionCalling, reasoning, imageInput, vision
qwen/qwen3-coder-480b-a35b-instructchatModel, languageModel, completionModel
functionCalling
qwen/qwen3-next-80b-a3b-instructchatModel, languageModel, completionModel
functionCalling
qwen/qwen3-next-80b-a3b-thinkingchatModel, languageModel, completionModel
functionCalling, reasoning
qwen/qwq-32bchatModel, languageModel, completionModel
reasoning
stepfun-ai/step-3.5-flashchatModel, languageModel, completionModel
functionCalling, reasoning
Image1
black-forest-labs/flux.1-devimage, imageModel
Sound3
nvidia/parakeet-tdt-0.6b-v2transcription
microsoft/phi-4-mini-instructtranscription
functionCalling, reasoning, imageInput, vision
openai/whisper-large-v3transcription