MLX Model Test Report

Generated 2026-02-25 21:49 · AFM MLX Backend · v0.9.5

mlx-model-test.sh --prompts Scripts/test-vlm-media.txt

Test Runs
8
Passed
8
Failed
0
Best tok/s
83.5
Fastest
mlx-community/Qwen3.5-35B-A3B-4bit @ image-ocr

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Model / Config Status Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 mlx-community/Qwen3.5-35B-A3B-4bit @ image-ocr image-ocr
--vlm		 OK 0.7 1.0 977 11.7
83.5
 Read all the text in this image. Output it exactly as writte...
2 mlx-community/Qwen3.5-35B-A3B-4bit @ image-system-prompt image-system-prompt
--vlm		 OK 0.7 1.0 1156 13.9
83.2
 Describe the animal in this image. What breed might it be?
3 mlx-community/Qwen3.5-35B-A3B-4bit @ image-describe image-describe
--vlm		 OK 0.7 2.0 968 11.87
81.5
 Describe this image in detail.
4 mlx-community/Qwen3.5-35B-A3B-4bit @ image-stop image-stop
--vlm		 OK 0.7 1.0 1008 12.61
79.9
 Describe this image in detail
5 mlx-community/Qwen3.5-35B-A3B-4bit @ image-guided-json image-guided-json
--vlm		 OK 0.7 1.0 525 6.93
75.8
 Analyze this image and return a JSON object with the followi...
6 mlx-community/Qwen3.5-35B-A3B-4bit @ image-greedy image-greedy
--vlm		 OK 0.0 1.0 467 6.18
75.6
 What is in this image? Reply in one sentence.
7 mlx-community/Qwen3.5-35B-A3B-4bit @ image-question image-question
--vlm		 OK 0.7 1.0 197 3.2
61.5
 What animal is in this image? Answer in one word.
8 mlx-community/Qwen3.5-35B-A3B-4bit @ video-describe video-describe
--vlm		 OK 0.7 1.0 729 14.78
49.3
 Describe what happens in this video.

Full Responses

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-ocr 977 tokens · 83.5 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-system-prompt 1156 tokens · 83.2 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-describe 968 tokens · 81.5 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-stop 1008 tokens · 79.9 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-guided-json 525 tokens · 75.8 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-greedy 467 tokens · 75.6 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-question 197 tokens · 61.5 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ video-describe 729 tokens · 49.3 tok/s