ai/devstral-small
Verified Publisher
Agentic coding LLM (24B) fine-tuned from Mistral-Small-3.1 with a 128K context window
Model
4
10K+
ai/devstral-small repository overview
Devstral Small 1.1
GGUF version by Unsloth
Description
Devstral Small 1.1 is an agentic coding LLM (24B) fine-tuned from Mistral-Small-3.1 with a 128K context window. It’s designed for software engineering agents and supports Mistral-style tool/function calling. Text-only. Apache-2.0 on this Unsloth GGUF release.
Characteristics
| Attribute | Details |
|---|---|
| Provider | Mistral AI |
| Architecture | Llama |
| Cutoff date | 2023-10-01 |
| Languages | Multilingual (24 languages) |
| Tool calling | ✅ |
| Input modalities | Text |
| Output modalities | Text |
| License | Apache 2.0 |
Available model variants
| Model variant | Parameters | Quantization | Context window | VRAM¹ | Size |
|---|---|---|---|---|---|
ai/devstral-small:24Bai/devstral-small:24B-UD-Q4_K_XLai/devstral-small:latest | 23.57 B | MOSTLY_Q4_K_M | 131K tokens | 14.63 GiB | 13.54 GB |
¹: VRAM estimated based on model characteristics.
latest→24B
Use this AI model with Docker Model Runner
docker model run ai/devstral-small
Considerations
- Text-only: the underlying vision encoder was removed before fine-tuning. Don’t expect image inputs to work.
Benchmark performance
| Category | Metric | Devstral Small 1.1 |
|---|---|---|
| SWE-Bench | ||
| SWE-Bench Verified (OpenHands scaffold) | 53.6% |
Links
Tag summary
Content type
Model
Digest
sha256:9b7df34c6…
Size
14.4 GB
Last updated
9 months ago
docker model pull ai/devstral-small:24BThis week's pulls
Pulls:
70
Jun 1 to Jun 7