Skip to content

Llama 3.1 Sonar 8B Online

llama-3.1-sonar-small-128k-online

Llama 3.1 Sonar 8B Online by Perplexity.

Context
127.1K tokens
Endpoint
Get API KeyCompare

Pricing

Input$0.20 / 1M
Output$0.20 / 1M
Cache Write (5m)$0.20 / 1M
Cache Write (1h)$0.20 / 1M
Cache Read$0.20 / 1M
Web Search$0 / 1M

Quick Start

Select an endpoint and copy a working example for this model.

Endpoint
python
from openai import OpenAI client = OpenAI(    api_key="YOUR_API_KEY",    base_url="https://api.apertis.ai/v1") response = client.chat.completions.create(    model="llama-3.1-sonar-small-128k-online",    messages=[        {"role": "user", "content": "Hello!"}    ],    max_tokens=1024,    temperature=0.7) print(response.choices[0].message.content) # Optional: Enable context compression to reduce token usage# response = client.chat.completions.create(#     model="llama-3.1-sonar-small-128k-online",#     messages=[{"role": "user", "content": "Hello!"}],#     extra_body={"compression": {"enabled": True, "model": "gpt-4.1-mini"}}# )

Supported Parameters

API docs
Common7 params
modelmessagesmax_tokenstemperaturetop_pstreamtools
Extended4 params
reasoning_effortstream_optionsthinkingextra_body

Cursor IDE Model IDs

Use these namespaced identifiers in Cursor IDE to avoid conflicts with built-in models.

llama-3.1-sonar-small-128k-online

Compare with Other Models

See how this model compares to others from the same provider.