MLX Model Test Report

Generated 2026-02-26 16:32 · AFM MLX Backend · v0.9.5

mlx-model-test.sh --model mlx-community/Qwen3.5-35B-A3B-4bit --prompts Scripts/test-vlm-media.txt

Test Runs

Passed

Failed

Best tok/s

109.2

Fastest

mlx-community/Qwen3.5-35B-A3B-4bit @ llm-creative

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

#	Model / Config	Status	Temp	Load (s)	Tokens	Gen (s)	Tokens/sec	Prompt
1	mlx-community/Qwen3.5-35B-A3B-4bit @ llm-creative llm-creative	OK	0.7	1.0	512	4.69	109.2	Write a haiku about the ocean.
2	mlx-community/Qwen3.5-35B-A3B-4bit @ llm-factual llm-factual	OK	0.7	1.0	208	2.2	94.4	What is the capital of Japan? Answer in one sentence.
3	mlx-community/Qwen3.5-35B-A3B-4bit @ image-ocr image-ocr --vlm	OK	0.7	1.0	1934	22.49	86.0	Read all the text in this image. Output it exactly as writte...
4	mlx-community/Qwen3.5-35B-A3B-4bit @ image-system-prompt image-system-prompt --vlm	OK	0.7	1.0	1377	16.37	84.1	Describe the animal in this image. What breed might it be?
5	mlx-community/Qwen3.5-35B-A3B-4bit @ image-describe image-describe --vlm	OK	0.7	2.0	982	12.19	80.5	Describe this image in detail.
6	mlx-community/Qwen3.5-35B-A3B-4bit @ image-stop image-stop --vlm	OK	0.7	1.0	625	7.97	78.4	Describe this image in detail
7	mlx-community/Qwen3.5-35B-A3B-4bit @ image-guided-json image-guided-json --vlm	OK	0.7	1.0	580	7.65	75.8	Analyze this image and return a JSON object with the followi...
8	mlx-community/Qwen3.5-35B-A3B-4bit @ image-greedy image-greedy --vlm	OK	0.0	1.0	486	6.58	73.9	What is in this image? Reply in one sentence.
9	mlx-community/Qwen3.5-35B-A3B-4bit @ image-question image-question --vlm	OK	0.7	1.0	235	3.88	60.5	What animal is in this image? Answer in one word.
10	mlx-community/Qwen3.5-35B-A3B-4bit @ video-describe video-describe --vlm	OK	0.7	1.0	689	14.68	47.0	Describe what happens in this video.