How to use from the
Use from the
MLX library
# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("baa-ai/MiniMax-M2.7-RAM-203GB-MLX")

prompt = "Write a story about Einstein"
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True
)

text = generate(model, tokenizer, prompt=prompt, verbose=True)

MiniMax-M2.7 — 203 GB (MLX)

Earlier build of the MiniMax-M2.7 mixed-precision MLX family, by baa.ai.

Current builds

For updated builds with HumanEval results and recommended inference settings, see:

Usage

from mlx_lm import load, generate

model, tokenizer = load("baa-ai/MiniMax-M2.7-RAM-203GB-MLX")
response = generate(model, tokenizer, prompt="Hello!", max_tokens=512)
print(response)

License

Inherited from the upstream MiniMax-M2.7 license: non-commercial use permitted; commercial use requires written authorization from MiniMax.


Quantized by baa.ai

Downloads last month
36
Safetensors
Model size
229B params
Tensor type
U32
·
F32
·
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for baa-ai/MiniMax-M2.7-RAM-203GB-MLX

Quantized
(114)
this model