Qwen3.8 2.4T A95B

Qwen3.8 2.4T A95B is the open-weight release of the Qwen3.8 generation: a sparse Mixture-of-Experts model that runs 95 billion of its 2.4 trillion parameters per token. It is built for coding, research and long-horizon agent workflows.

Model	Context	Input / Output ($/1M)	Cached input ($/1M)
qwen/qwen3.8-2.4t-a95b	262,144	2.00 / 6.00	0.20

curl "$LLMTR_BASE_URL/v1/chat/completions" \
  -H "Authorization: Bearer llmtr-your_key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen/qwen3.8-2.4t-a95b",
    "messages": [
      { "role": "user", "content": "Find the race condition in this function." }
    ],
    "max_tokens": 8192
  }'

Relationship to Qwen3.8-Max

The catalog carries two rows from this generation and neither substitutes for the other:

	qwen/qwen3.8-2.4t-a95b	qwen/qwen3.8-max
Release	Open weight	Closed, provider-hosted
Context	262,144	1,000,000
Input types	Text only	Text, image, video
Can reasoning be turned off	No	Yes
Input / Output ($/1M)	2.00 / 6.00	2.00 / 6.00

Name the model id explicitly; neither row forwards to the other.

Reasoning is always on

The model reasons step by step before answering and returns that chain separately in reasoning_content. content carries the final answer.

This cannot be turned off. Requests that try to disable reasoning are rejected by the provider. The :fast suffix, "reasoning": false and similar controls that work on other models do not silence reasoning here.

The practical consequence: reasoning tokens are output and are billed inside completion_tokens. Even a short question can spend a few hundred reasoning tokens, so keep max_tokens generous. If it is too low the budget is consumed during reasoning and you are left with an empty content and finish_reason: "length".

reasoning_effort is not supported on this model

The provider appears to accept seven levels, but the levels have no measurable effect: on the same prompt, xhigh can produce shorter reasoning than none, and repeating a single level varies more than the difference between levels.

Rather than offer a control that does nothing, LLMTR rejects the parameter with a 400. For models that genuinely implement levelled control, see Reasoning Effort.

Tool calling

Tool calling is native. All three forms of tool_choice work — auto, required and a named function — and the returned tool_calls arguments are valid JSON.

curl "$LLMTR_BASE_URL/v1/chat/completions" \
  -H "Authorization: Bearer llmtr-your_key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen/qwen3.8-2.4t-a95b",
    "messages": [{ "role": "user", "content": "Look up order 12345." }],
    "tools": [{
      "type": "function",
      "function": {
        "name": "lookup_order",
        "description": "Look up an order by id",
        "parameters": {
          "type": "object",
          "properties": { "orderId": { "type": "string" } },
          "required": ["orderId"]
        }
      }
    }],
    "tool_choice": "auto"
  }'

You can feed the tool result back with a role: "tool" message and continue the conversation. See Tool Calling for details.

Structured output

response_format accepts both json_object and json_schema:

{
  "response_format": {
    "type": "json_schema",
    "json_schema": {
      "name": "capital",
      "schema": {
        "type": "object",
        "properties": {
          "country": { "type": "string" },
          "capital": { "type": "string" }
        },
        "required": ["country", "capital"]
      }
    }
  }
}

Prompt caching

Repeated prompt prefixes are cached automatically; no extra parameter is needed. The cache warms on the first call and hits on subsequent ones.

Tokens read from cache are reported in usage.prompt_tokens_details.cached_tokens and billed at $0.20 per 1M instead of the input rate — one tenth of the normal input price.

Measured example: an identical 19,627-token prefix returned 17,952 tokens from cache on the second call. If you work with a long, fixed system prompt, keeping that prefix byte-identical across requests lowers cost noticeably.

Limits

• Context is 262,144 tokens. A request whose input plus output exceeds it is rejected with a 400.
• There is no separate output ceiling. No limit is applied to max_tokens beyond the context window.
• Text only. Image, audio and video input are not accepted; requests carrying an image are rejected.

Data residency

This model runs on third-party infrastructure outside Turkey. Prompts and completions may be logged by the provider. It is not an LLMTR model hosted in Turkey. For Turkey-hosted models see LLMTR Qwen.