Skip to main content

Inference

Decentralized AI inference network providing access to open-source language models at competitive pricing.

Inference

Decentralized AI inference network providing access to open-source language models at competitive pricing.

Authentication

Auth Type
API Key
Platform Key
Not configured
Self-serve
Available

Add your Inference API key from Organization → Integrations → AI Vendors. Keys are encrypted at rest and scoped to your organization.

Available Models

9 enabled models across 1 category.

Text9

Google Gemma 3google/gemma-3

chatModel, languageModel, completionModel

functionCalling, imageInput, vision

Llama 3.1 8B Instructmeta/llama-3.1-8b-instruct

chatModel, languageModel, completionModel

functionCalling

Llama 3.2 11B Vision Instructmeta/llama-3.2-11b-vision-instruct

chatModel, languageModel, completionModel

functionCalling, imageInput, vision

Llama 3.2 1B Instructmeta/llama-3.2-1b-instruct

chatModel, languageModel, completionModel

functionCalling

Llama 3.2 3B Instructmeta/llama-3.2-3b-instruct

chatModel, languageModel, completionModel

functionCalling

Mistral Nemo 12B Instructmistral/mistral-nemo-12b-instruct

chatModel, languageModel, completionModel

functionCalling

Osmosis Structure 0.6Bosmosis/osmosis-structure-0.6b

chatModel, languageModel, completionModel

functionCalling

Qwen 2.5 7B Vision Instructqwen/qwen-2.5-7b-vision-instruct

chatModel, languageModel, completionModel

functionCalling, imageInput, vision

Qwen 3 Embedding 4Bqwen/qwen3-embedding-4b

chatModel, languageModel, completionModel