Inference.net Provider

Inference.net is a platform for running large language models in the cloud.

Available Models

llama-3.1-8b-instruct
meta-llama/Meta-Llama-3.1-8B-Instruct
nebius/llama-3.1-8b-instruct

Context: 128k

$0.02 in/$0.06 out

llama-3.2-11b-instruct
meta-llama/llama-3.2-11b-instruct/fp-16
inference.net/llama-3.2-11b-instruct

Context: 128k

$0.07 in/$0.33 out

    Inference.net - LLM Gateway