Mistral
Mixtral 8x7B Instruct v0.1
mistralai/mixtral-8x7b-instruct-v0.1
A pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters.
Instruct model fine-tuned by Mistral. #moe
Community
Open Source
Context Window
32,768
Using Mixtral 8x7B Instruct v0.1 with Python API
Using Mixtral 8x7B Instruct v0.1 with OpenAI compatible API
import openai
client = openai.Client(
api_key= '{your_api_key}',
base_url="https://api.model.box/v1",
)
response = client.chat.completions.create(
model="mistralai/mixtral-8x7b-instruct-v0.1",
messages: [
{
role: 'user',
content:
'introduce your self',
},
]
)
print(response)