tok/s
estimated
The closest options:
Tweak your specs above to see what changes.
Check what's the best model you can run locally!
We auto-detect what we can from your browser; everything else is a best guess. Tweak any value below to see what else could run.
Apple Silicon:
LM Studio also runs MLX models. Filter the catalog with lms get --mlx.
Ollama also runs MLX models. Look for tags ending in -mlx.
The commands on this page use GGUF via llama.cpp and Metal.
The closest options:
Tweak your specs above to see what changes.