The Mixtral-8x22B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts. This model natively supports function calling, which allows you to call functions directly from the model's output.
The Mixtral-8x22B-Instruct-v0.1 is an advanced machine learning model designed for specific instructional tasks, offering a nuanced understanding of text inputs to generate precise and contextually relevant outputs. Its architecture incorporates multiple layers of transformers, optimizing it for parsing complex instructions and delivering high-quality, actionable responses.
Additionally, Mixtral-8x22B-Instruct-v0.1 features enhanced adaptability, allowing it to fine-tune responses based on user feedback, which improves performance over time without the need for extensive retraining.
Model Developers: Mistral
Input Models: input text only.
Output Models: generate text only.
Context Length: 65536
License: Apache 2.0
Request and Response
Request
curl -X 'POST' \
'https://api.magicapi.dev/api/v1/bridgeml/mistralai8x22/bridgeml/mistralai8x22' \
-H 'accept: application/json' \
-H 'x-magicapi-key: API_KEY' \
-H 'Content-Type: application/json' \
-d '{
"messages": [
{
"role": "user",
"content": "hello"
},
{
"role": "assistant",
"content": "Use voice of customer from a G2 review to write an ad for GitLab."
}
],
"temperature": 1,
"max_tokens": 256,
"top_p": 1,
"frequency_penalty": 0,
"stream": false
}'
Response
{
"id": "mistralai/Mixtral-8x22B-Instruct-v0.1-98b993cd-91c5-4660-825a-cd0dabd0eb79",
"object": "text_completion",
"created": 1718783618,
"model": "mistralai/Mixtral-8x22B-Instruct-v0.1",
"choices": [
{
"message": {
"role": "assistant",
"content": "🌟 Discover GitLab, Your Ultimate DevOps Solution! 🌟\n\nCan't stand slow and disorganized development cycles? You're not alone! Thousands of businesses like yours are turning to GitLab for a faster, smoother, and more unified DevOps experience!\n\n\"GitLab simplifies and streamlines our software development process, helps us to keep an eye on code quality and security, and fuels our continuous integration efforts. The tools it provides make it an essential part of our engineering pipeline.\" —G2 review by an IT manager.\n\n🧱 Why settle for just a source code management tool when you can have an all-in-one platform that covers the entire software development lifecycle?\n\n🏃♂️ Explore these fantastic features that have helped our users accelerate innovation:\n\n✅ Reliable version control\n✅ Scalable CI/CD\n✅ Built-in code quality and security\n✅ On-premises or SaaS offerings for flexibility\n✅ Robust collaboration features for teams\n\n🔒 Still unsure? Here's our promise to you:\n\n",
"tool_calls": null,
"tool_call_id": null
},
"index": 0,
"finish_reason": "length",
"logprobs": null
}
],
"usage": {
"prompt_tokens": 71,
"completion_tokens": 256,
"total_tokens": 327
}
}
