News icon

Batch Inference is now generally available on Runpod Serverless

Qwen

Qwen3.8 27B

Qwen's 27B-parameter open vision-language model with a 256K-token context, ready to serve on Runpod Serverless with vLLM or on a Pod.

Vision + language
Text generation
27B · 256K context

Qwen3.8 27B

Specifications

Provider
Qwen
Modality
Vision + language
Task
Text generation
Parameters
27B
Active parameters
Context
256K tokens
Precision
BF16
Weights
56
License
apache-2.0
Released
2026-08-04
Endpoint ID
Weights on Hugging Face
Qwen/Qwen3.8-27B

Frequently asked questions

How do I deploy Qwen3.8 27B on Runpod?

Deploy the vLLM worker from the Runpod Hub as a Serverless endpoint and set MODEL_NAME to Qwen/Qwen3.8-27B. The endpoint is OpenAI-compatible and scales to zero when idle. You can also run vLLM on a Pod.

What GPU do I need to run Qwen3.8 27B?

Start with H100 (80 GB VRAM). The weights take about 56 GB; longer contexts and more concurrent requests need extra memory for the KV cache.

How much does Qwen3.8 27B cost on Runpod?

Serverless endpoints and Pods bill per second for the GPU you choose. A Serverless endpoint costs nothing while scaled to zero.

qwen-qwen3-8-27b
Qwen/Qwen3.8-27B
Vision + language
2026-08-04 17:00
H100