Mistral 3 Small (24B AWQ)
Invoke Mistral 3 Small, a 24B-parameter large language model with a 32k-token context length, and send it a tool-calling request.
Mistral 3 Small is a large language model with 24 billion parameters, built for conversational agents, text generation, and tool calling. It reads text, returns text, and accepts tool definitions in the request. AI Inference runs it under the id casperhansen-mistral-small-24b-instruct-2501-awq.
Model details
The model id is the string that selects this model, and it is the first argument Azion.AI.run takes. The HuggingFace repository holds the model card.
| Detail | Value |
|---|---|
| Model name | Mistral 3 Small |
| Version | 24B AWQ |
| Model category | Large Language Model (LLM) |
| Model id | casperhansen-mistral-small-24b-instruct-2501-awq |
| Size | 24B parameters |
| HuggingFace model | casperhansen/mistral-small-24b-instruct-2501-awq |
| OpenAI-compatible endpoint | OpenAI Chat API |
| License | Apache 2.0 |
Capabilities
These values belong to the model and are not part of the request body. For the fields every chat request accepts, with their types, defaults, and bounds, refer to Model invocation.
| Capability | Value |
|---|---|
| Input data | Text |
| Context length | 32k tokens |
| Tool calling | Yes |
| Supports LoRA | No |
Usage
A function invokes the model with Azion.AI.run, passing the id as the first argument and an OpenAI-compatible request body as the second. The examples below use that binding. To send the same body to the OpenAI-compatible HTTP endpoint instead, refer to Model invocation.
Chat completion
This request carries a system message and a user message, and caps the length of the answer with max_tokens:
The model answers with one entry in choices, and the generated text sits at choices[0].message.content:
Tool calling
A tool-calling request adds a tools array to the body. Each entry sets type to function and carries a function object holding the name the model calls, a description of what it does, and its parameters in JSON Schema form:
When the model selects a tool, it returns content as null, names the call in tool_calls with the arguments it chose, and sets finish_reason to tool_calls: