MLX Model Test Report

Generated 2026-03-06 19:00 · AFM MLX Backend · v0.9.7

mlx-model-test.sh --model mlx-community/Qwen3.5-35B-A3B-4bit --prompts Scripts/test-llm-comprehensive.txt

Test Runs
190
Passed
190
Failed
0
Best tok/s
153.1
Fastest
mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Model / Config Status Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase stop-long-phrase OK 0.0 1.0 1143 7.47
153.1
Write a 3-paragraph essay about renewable energy. Start the ...
2 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline stop-double-newline OK 0.0 1.0 742 5.98
124.2
Write a short paragraph about the ocean. Then write a second...
3 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period stop-period OK 0.0 1.0 692 5.58
123.9
Tell me about the sun in three sentences.
4 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate stop-immediate OK 0.0 1.0 767 6.26
122.5
Explain what gravity is.
5 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 0.0 1.0 826 6.78
121.8
Name three primary colors and explain why they matter in des...
6 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline stop-double-newline OK 0.0 1.0 817 6.72
121.6
Name three primary colors and explain why they matter in des...
7 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline stop-newline OK 0.0 1.0 817 6.72
121.6
Name three primary colors and explain why they matter in des...
8 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max stop-four-max OK 0.0 1.0 818 6.73
121.5
Name three primary colors and explain why they matter in des...
9 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars stop-special-chars OK 0.0 1.0 824 6.8
121.2
Name three primary colors and explain why they matter in des...
10 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period stop-period OK 0.0 1.0 831 6.87
120.9
Name three primary colors and explain why they matter in des...
11 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate stop-immediate OK 0.0 1.0 817 6.78
120.5
Name three primary colors and explain why they matter in des...
12 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 0.0 1.0 1373 11.42
120.3
Generate a person record.
13 mlx-community/Qwen3.5-35B-A3B-4bit @ math math OK 0.0 7.0 1830 15.24
120.1
A store sells notebooks for $3.50 each. If you buy 5 or more...
14 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 0.0 1.0 1063 8.89
119.5
Describe the color blue with its hex code.
15 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema response-format-schema OK 0.0 1.0 1478 12.37
119.5
Generate a fictional person profile.
16 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw think-raw
--raw
OK 0.0 1.0 833 6.98
119.4
Solve step by step: If a train travels at 60 mph for 2.5 hou...
17 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 eli5 OK 0.7 1.0 1565 13.11
119.3
Tell me about quantum computing.
18 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 0.0 1.0 937 7.85
119.3
Describe Tokyo as a structured record with at least 3 landma...
19 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 1.0 2300 19.28
119.3
Explain the causes and consequences of the French Revolution...
20 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 0.7 1.0 4096 34.35
119.2
Write a limerick about a cat.
21 mlx-community/Qwen3.5-35B-A3B-4bit @ default default OK 0.7 1.0 615 5.16
119.1
Explain why the sky is blue in exactly 3 bullet points.
22 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json response-format-json OK 0.0 2.0 1303 10.94
119.1
Return a JSON object with keys "language", "year_created", a...
23 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv small-kv
--max-kv-size 2048
OK 0.7 1.0 913 7.67
119.1
Summarize the key ideas of machine learning in a few paragra...
24 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param tool-call-nullable-param OK 0.0 1.0 573 4.81
119.1
What is the weather in Chicago?
25 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp high-temp OK 1.5 1.0 620 5.21
119.1
Explain why the sky is blue in exactly 3 bullet points.
26 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 0.7 1.0 4096 34.4
119.1
Write a limerick about a cat.
27 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 1169 9.83
118.9
What is the weather in London and what time is it in Tokyo?
28 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode raw-mode
--raw
OK 0.7 1.0 1069 8.99
118.9
Think step by step: what is 17 * 23?
29 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 1.0 502 4.23
118.8
What is the weather in Tokyo?
30 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 1.0 1174 9.88
118.8
max_completion_tokens: 100
31 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized kv-quantized
--kv-bits 4
OK 0.7 2.0 959 8.08
118.7
Summarize the key ideas of machine learning in a few paragra...
32 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none tool-call-none OK 0.0 1.0 475 4.0
118.7
What is the current temperature in Berlin?
33 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 0.8 1.0 3968 33.44
118.7
Write a long essay about the history of bread making across ...
34 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p min-p
--min-p 0.05
OK 0.8 1.0 1087 9.16
118.6
Explain why the sky is blue in exactly 3 bullet points.
35 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output long-output OK 0.7 1.0 1992 16.8
118.6
Write a detailed recipe for chocolate chip cookies with ingr...
36 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming no-streaming
--no-streaming
OK 0.7 1.0 2465 20.8
118.5
Write a short poem about the moon.
37 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 0.0 1.0 4096 34.57
118.5
List 10 planets or celestial objects, numbered 1 through 10,...
38 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist scientist OK 0.3 1.0 2231 18.84
118.4
Tell me about quantum computing.
39 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 0.7 1.0 2469 20.85
118.4
Write a 4-line poem about the ocean.
40 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal think-normal OK 0.0 1.0 833 7.04
118.3
Solve step by step: If a train travels at 60 mph for 2.5 hou...
41 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key stop-json-object-key OK 0.0 1.0 4096 34.64
118.3
Generate a JSON object with keys "name", "age", and "city" f...
42 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max stop-four-max OK 0.0 1.0 4096 34.65
118.2
List 10 facts about numbers, alternating between digit forma...
43 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 0.7 1.0 2469 20.89
118.2
Write a 4-line poem about the ocean.
44 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt long-prompt OK 0.0 1.0 831 7.04
118.1
Repeat after me exactly: The quick brown fox jumps over the ...
45 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 1.0 4096 34.68
118.1
What is the weather in Paris in celsius?
46 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate pirate OK 0.7 1.0 1434 12.15
118.0
Tell me about quantum computing.
47 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k top-k
--top-k 30
OK 0.8 1.0 558 4.73
118.0
Explain why the sky is blue in exactly 3 bullet points.
48 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 0.0 2.0 3652 30.97
117.9
Given this architecture, what are the top 3 performance bott...
49 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 0.0 1.0 356 3.02
117.9
Write a unit test for the timeout feature you just described...
50 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy greedy OK 0.0 7.0 546 4.63
117.9
Explain why the sky is blue in exactly 3 bullet points.
51 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output json-output OK 0.0 2.0 384 3.26
117.8
Respond with a valid JSON object containing keys "name", "ag...
52 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list numbered-list OK 0.0 1.0 489 4.15
117.8
List exactly 5 animals, one per line, numbered 1-5. No other...
53 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default prefill-default OK 0.0 1.0 3652 30.99
117.8
Given this architecture, what are the top 3 performance bott...
54 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual multilingual OK 0.3 1.0 650 5.52
117.8
Translate "Hello, how are you?" into French, Spanish, Japane...
55 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 0.0 2.0 3652 31.02
117.7
Given this architecture, what are the top 3 performance bott...
56 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 458 3.9
117.5
Search recursively for all Swift files under Sources/ with a...
57 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text response-format-text OK 0.0 1.0 370 3.15
117.4
Tell me the language Python, what year it was created, and w...
58 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate pirate OK 0.7 1.0 4096 34.91
117.3
Name three primary colors and explain why they matter in des...
59 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 2.0 4096 34.94
117.2
developer: You are a helpful coding assistant. Only respond ...
60 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose very-verbose
--very-verbose
OK 0.7 1.0 417 3.56
117.2
Hello, how are you?
61 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form long-form OK 0.7 1.0 4096 34.99
117.1
Write a detailed technical blog post explaining how Mixture-...
62 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate stop-system-pirate OK 0.0 1.0 4096 35.0
117.0
Name three primary colors and explain why they matter in des...
63 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p top-p
--top-p 0.9
OK 0.8 1.0 603 5.15
117.0
Explain why the sky is blue in exactly 3 bullet points.
64 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 2.0 437 3.74
116.9
Write a Python function that reverses a string.
65 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k top-k
--top-k 30
OK 0.8 1.0 2956 25.37
116.5
Name three primary colors and explain why they matter in des...
66 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 0.0 1.0 763 6.55
116.5
Generate a person profile for someone named Alice who is 30 ...
67 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist scientist OK 0.3 1.0 3639 31.25
116.4
Name three primary colors and explain why they matter in des...
68 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default prefill-default OK 0.0 1.0 2610 22.44
116.3
Name three primary colors and explain why they matter in des...
69 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param tool-call-array-param OK 0.0 2.0 279 2.4
116.2
Create three todo items: Buy milk, Call dentist, Fix bug #42...
70 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match stop-no-match OK 0.0 1.0 256 2.2
116.2
Explain the difference between TCP and UDP in a few sentence...
71 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 0.8 1.0 709 6.11
116.1
Explain why the sky is blue in exactly 3 bullet points.
72 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 eli5 OK 0.7 1.0 4096 35.28
116.1
Name three primary colors and explain why they matter in des...
73 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 0.0 2.0 2610 22.48
116.1
Name three primary colors and explain why they matter in des...
74 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p min-p
--min-p 0.05
OK 0.8 1.0 1404 12.1
116.1
Name three primary colors and explain why they matter in des...
75 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars special-chars OK 0.0 1.0 4028 34.71
116.0
Repeat these characters exactly: <tag> "quotes" 'apostrophes...
76 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized kv-quantized
--kv-bits 4
OK 0.7 2.0 1558 13.44
115.9
Name three primary colors and explain why they matter in des...
77 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 0.0 2.0 2610 22.53
115.8
Name three primary colors and explain why they matter in des...
78 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt minimal-prompt OK 0.7 1.0 2024 17.48
115.8
Name three primary colors and explain why they matter in des...
79 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp high-temp OK 1.5 1.0 1455 12.57
115.8
Name three primary colors and explain why they matter in des...
80 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format strict-format OK 0.0 1.0 334 2.89
115.6
Output EXACTLY 3 lines. Each line must contain exactly one w...
81 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming no-streaming
--no-streaming
OK 0.7 1.0 2177 18.86
115.4
Name three primary colors and explain why they matter in des...
82 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 0.7 1.0 1135 9.84
115.4
Name three primary colors and explain why they matter in des...
83 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered stop-system-numbered OK 0.0 1.0 874 7.58
115.3
What are the main benefits of exercise?
84 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 0.7 1.0 1501 13.02
115.3
Name three primary colors and explain why they matter in des...
85 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 0.8 1.0 1143 9.92
115.2
Name three primary colors and explain why they matter in des...
86 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 1.0 330 2.87
115.2
tools: [{"type":"function","function":{"name":"get_weather",...
87 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered stop-system-numbered OK 0.0 1.0 1455 12.65
115.0
Name three primary colors and explain why they matter in des...
88 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose verbose
--verbose
OK 0.7 1.0 364 3.16
115.0
Hello, how are you?
89 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt minimal-prompt OK 0.7 1.0 370 3.22
115.0
Hi
90 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 338 2.94
114.9
tools: [{"type":"function","function":{"name":"search_files"...
91 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python code-python OK 0.0 1.0 267 2.32
114.9
Write a function that finds all prime numbers up to n using ...
92 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 0.7 1.0 1135 9.88
114.8
Name three primary colors and explain why they matter in des...
93 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv small-kv
--max-kv-size 2048
OK 0.7 1.0 1282 11.18
114.7
Name three primary colors and explain why they matter in des...
94 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose verbose
--verbose
OK 0.7 1.0 1782 15.54
114.7
Name three primary colors and explain why they matter in des...
95 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 1.0 330 2.88
114.7
tools: [{"type":"function","function":{"name":"get_weather",...
96 mlx-community/Qwen3.5-35B-A3B-4bit @ default default OK 0.7 1.0 963 8.4
114.6
Name three primary colors and explain why they matter in des...
97 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 0.7 1.0 1501 13.1
114.6
Name three primary colors and explain why they matter in des...
98 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p top-p
--top-p 0.9
OK 0.8 1.0 1282 11.2
114.4
Name three primary colors and explain why they matter in des...
99 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode raw-mode
--raw
OK 0.7 1.0 1280 11.19
114.4
Name three primary colors and explain why they matter in des...
100 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 stop-seed-run2 OK 0.7 1.0 1135 9.97
113.8
Name three primary colors and explain why they matter in des...
101 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output long-output OK 0.7 1.0 992 8.73
113.6
Name three primary colors and explain why they matter in des...
102 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param tool-call-array-param OK 0.0 2.0 270 2.39
113.1
tools: [{"type":"function","function":{"name":"todowrite","d...
103 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 0.0 1.0 810 7.17
113.0
Name three primary colors and explain why they matter in des...
104 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key stop-json-object-key OK 0.0 1.0 851 7.54
112.8
Name three primary colors and explain why they matter in des...
105 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema response-format-schema OK 0.0 1.0 810 7.18
112.8
Name three primary colors and explain why they matter in des...
106 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs logprobs
--max-logprobs 5
OK 0.0 1.0 810 7.18
112.7
Name three primary colors and explain why they matter in des...
107 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw think-raw
--raw
OK 0.0 1.0 810 7.19
112.7
Name three primary colors and explain why they matter in des...
108 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs logprobs
--max-logprobs 5
OK 0.0 1.0 144 1.28
112.6
What is 1+1?
109 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 0.0 1.0 810 7.19
112.6
Name three primary colors and explain why they matter in des...
110 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none tool-call-none OK 0.0 1.0 810 7.19
112.6
Name three primary colors and explain why they matter in des...
111 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag stop-html-tag OK 0.0 1.0 810 7.19
112.6
Name three primary colors and explain why they matter in des...
112 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json response-format-json OK 0.0 2.0 810 7.2
112.6
Name three primary colors and explain why they matter in des...
113 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 stop-seed-run1 OK 0.7 1.0 1135 10.09
112.5
Name three primary colors and explain why they matter in des...
114 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 1.0 810 7.2
112.5
Name three primary colors and explain why they matter in des...
115 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 0.0 1.0 810 7.21
112.4
Name three primary colors and explain why they matter in des...
116 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param tool-call-array-param OK 0.0 2.0 810 7.21
112.3
Name three primary colors and explain why they matter in des...
117 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 0.0 1.0 810 7.21
112.3
Name three primary colors and explain why they matter in des...
118 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text response-format-text OK 0.0 1.0 810 7.21
112.3
Name three primary colors and explain why they matter in des...
119 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp stop-high-temp OK 1.0 1.0 937 8.35
112.3
Name three primary colors and explain why they matter in des...
120 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 810 7.21
112.3
Name three primary colors and explain why they matter in des...
121 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word stop-word OK 0.0 1.0 810 7.22
112.2
Name three primary colors and explain why they matter in des...
122 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 287 2.56
112.2
tools: [{"type":"function","function":{"name":"get_weather",...
123 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose very-verbose
--very-verbose
OK 0.7 1.0 989 8.81
112.2
Name three primary colors and explain why they matter in des...
124 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list numbered-list OK 0.0 1.0 810 7.22
112.2
Name three primary colors and explain why they matter in des...
125 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode stop-unicode OK 0.0 1.0 810 7.22
112.2
Name three primary colors and explain why they matter in des...
126 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars special-chars OK 0.0 1.0 810 7.23
112.1
Name three primary colors and explain why they matter in des...
127 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single stop-single OK 0.0 1.0 810 7.23
112.1
Name three primary colors and explain why they matter in des...
128 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase stop-long-phrase OK 0.0 1.0 810 7.23
112.0
Name three primary colors and explain why they matter in des...
129 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 0.0 1.0 810 7.23
112.0
Name three primary colors and explain why they matter in des...
130 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param tool-call-nullable-param OK 0.0 1.0 810 7.23
112.0
Name three primary colors and explain why they matter in des...
131 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 1.0 810 7.23
112.0
Name three primary colors and explain why they matter in des...
132 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi stop-multi OK 0.0 1.0 810 7.23
112.0
Name three primary colors and explain why they matter in des...
133 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word stop-word OK 0.0 1.0 1214 10.84
111.9
Name 5 programming languages and briefly describe each one.
134 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 0.8 1.0 1108 9.9
111.9
Name three primary colors and explain why they matter in des...
135 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 0.0 1.0 810 7.24
111.9
Name three primary colors and explain why they matter in des...
136 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 0.0 1.0 810 7.24
111.9
Name three primary colors and explain why they matter in des...
137 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal think-normal OK 0.0 1.0 810 7.24
111.9
Name three primary colors and explain why they matter in des...
138 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 810 7.24
111.8
Name three primary colors and explain why they matter in des...
139 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 1.0 810 7.24
111.8
Name three primary colors and explain why they matter in des...
140 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual multilingual OK 0.3 1.0 866 7.75
111.8
Name three primary colors and explain why they matter in des...
141 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output json-output OK 0.0 2.0 810 7.25
111.7
Name three primary colors and explain why they matter in des...
142 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 0.0 1.0 810 7.26
111.5
Name three primary colors and explain why they matter in des...
143 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt long-prompt OK 0.0 1.0 810 7.26
111.5
Name three primary colors and explain why they matter in des...
144 mlx-community/Qwen3.5-35B-A3B-4bit @ math math OK 0.0 7.0 810 7.27
111.5
Name three primary colors and explain why they matter in des...
145 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word stop-multi-word OK 0.0 1.0 810 7.27
111.4
Name three primary colors and explain why they matter in des...
146 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 0.0 1.0 810 7.29
111.1
Name three primary colors and explain why they matter in des...
147 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 0.0 1.0 83 0.75
110.9
Write a bash script that prints the current date inside a co...
148 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy greedy OK 0.0 7.0 810 7.32
110.7
Name three primary colors and explain why they matter in des...
149 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 0.0 1.0 134 1.21
110.3
Now add a --timeout flag to the CLI that sets a request time...
150 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format strict-format OK 0.0 1.0 810 7.37
110.0
Name three primary colors and explain why they matter in des...
151 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param tool-call-nullable-param OK 0.0 1.0 191 1.74
109.7
tools: [{"type":"function","function":{"name":"get_weather",...
152 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 2.0 810 7.42
109.2
Name three primary colors and explain why they matter in des...
153 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens stop-low-max-tokens OK 0.0 1.0 100 0.93
107.5
List 10 mountains, numbered 1 through 10, one per line.
154 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode stop-unicode OK 0.0 1.0 341 3.21
106.1
List 5 items about space using bullet points (•).
155 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi stop-multi OK 0.0 1.0 253 2.4
105.6
Write a Python hello world program in a code block, then wri...
156 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form long-form OK 0.7 1.0 1492 14.2
105.0
Name three primary colors and explain why they matter in des...
157 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars stop-special-chars OK 0.0 1.0 558 5.35
104.3
List 3 facts about the moon. Use **bold** markdown for empha...
158 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 0.0 1.0 149 1.43
103.9
Write a unit test for the timeout feature you just described...
159 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline stop-newline OK 0.0 1.0 173 1.7
101.7
What is the capital of France? Answer in one sentence.
160 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate stop-system-pirate OK 0.0 1.0 685 6.75
101.5
Tell me about treasure hunting on the high seas.
161 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 0.0 2.0 59 0.59
99.8
Read the file Sources/MacLocalAPI/main.swift and explain wha...
162 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match stop-no-match OK 0.0 1.0 256 2.62
97.6
Name three primary colors and explain why they matter in des...
163 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 0.0 2.0 103 1.06
97.4
Now add a --timeout flag to the CLI that sets a request time...
164 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output short-output OK 0.7 1.0 50 0.51
97.2
Describe the entire history of Rome.
165 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python code-python OK 0.0 1.0 32768 341.94
95.8
Name three primary colors and explain why they matter in des...
166 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift code-swift OK 0.0 1.0 32768 344.43
95.1
Write a Swift async function that fetches JSON from a URL us...
167 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word stop-multi-word OK 0.0 1.0 374 3.94
94.9
Write a 5-step recipe for making tea. Label each step as "St...
168 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 0.8 2.0 3857 40.91
94.3
Write a long essay about the history of bread making across ...
169 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 0.0 1.0 256 2.73
93.7
Name three primary colors and explain why they matter in des...
170 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 0.8 1.0 3781 40.49
93.4
Write a long essay about the history of bread making across ...
171 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 0.0 2.0 256 2.74
93.3
Name three primary colors and explain why they matter in des...
172 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 0.0 1.0 256 2.75
93.2
Name three primary colors and explain why they matter in des...
173 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 0.0 2.0 256 2.75
93.0
Name three primary colors and explain why they matter in des...
174 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 0.0 1.0 256 2.76
92.8
Name three primary colors and explain why they matter in des...
175 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 0.0 1.0 256 2.76
92.8
Name three primary colors and explain why they matter in des...
176 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 0.0 1.0 209 2.26
92.5
List 5 major world cities as a JSON array. Include Tokyo.
177 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift code-swift OK 0.0 1.0 32768 354.72
92.4
Name three primary colors and explain why they matter in des...
178 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 0.8 1.0 999 10.87
91.9
Name three primary colors and explain why they matter in des...
179 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 0.8 2.0 795 8.73
91.1
Name three primary colors and explain why they matter in des...
180 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 0.0 1.0 234 2.63
89.1
List 10 cities, numbered 1 through 10, one per line.
181 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 0.0 1.0 67 0.76
88.0
Read the file Sources/MacLocalAPI/main.swift and explain wha...
182 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 stop-seed-run2 OK 0.7 1.0 329 3.81
86.4
List 10 flowers, numbered 1 through 10, one per line.
183 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 0.0 1.0 245 2.84
86.2
List 10 countries, numbered 1 through 10, one per line.
184 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag stop-html-tag OK 0.0 1.0 239 2.78
86.0
Write an HTML unordered list of 5 fruits using <ul> and <li>...
185 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 stop-seed-run1 OK 0.7 1.0 329 3.85
85.5
List 10 flowers, numbered 1 through 10, one per line.
186 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single stop-single OK 0.0 1.0 199 2.4
82.9
List 10 fruits, numbered 1-10, one per line.
187 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 0.0 1.0 209 2.61
80.2
List 10 types of cheese, numbered 1 through 10, one per line...
188 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens stop-low-max-tokens OK 0.0 1.0 100 1.33
75.1
Name three primary colors and explain why they matter in des...
189 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp stop-high-temp OK 1.0 1.0 1859 24.78
75.0
List 10 random words, numbered 1 through 10, one per line.
190 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output short-output OK 0.7 1.0 50 0.92
54.2
Name three primary colors and explain why they matter in des...

Full Responses

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase 1143 tokens · 153.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline 742 tokens · 124.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period 692 tokens · 123.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate 767 tokens · 122.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma 826 tokens · 121.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline 817 tokens · 121.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline 817 tokens · 121.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max 818 tokens · 121.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars 824 tokens · 121.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period 831 tokens · 120.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate 817 tokens · 120.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple 1373 tokens · 120.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ math 1830 tokens · 120.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace 1063 tokens · 119.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema 1478 tokens · 119.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw 833 tokens · 119.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 1565 tokens · 119.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested 937 tokens · 119.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 2300 tokens · 119.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 4096 tokens · 119.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ default 615 tokens · 119.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json 1303 tokens · 119.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv 913 tokens · 119.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param 573 tokens · 119.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp 620 tokens · 119.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 4096 tokens · 119.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 1169 tokens · 118.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode 1069 tokens · 118.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 502 tokens · 118.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 1174 tokens · 118.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized 959 tokens · 118.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none 475 tokens · 118.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty 3968 tokens · 118.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ min-p 1087 tokens · 118.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-output 1992 tokens · 118.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming 2465 tokens · 118.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming 4096 tokens · 118.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ scientist 2231 tokens · 118.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded 2469 tokens · 118.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal 833 tokens · 118.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key 4096 tokens · 118.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max 4096 tokens · 118.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded 2469 tokens · 118.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt 831 tokens · 118.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 4096 tokens · 118.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ pirate 1434 tokens · 118.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-k 558 tokens · 118.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 3652 tokens · 117.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 356 tokens · 117.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ greedy 546 tokens · 117.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ json-output 384 tokens · 117.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list 489 tokens · 117.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default 3652 tokens · 117.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual 650 tokens · 117.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 3652 tokens · 117.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 458 tokens · 117.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text 370 tokens · 117.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ pirate 4096 tokens · 117.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 4096 tokens · 117.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose 417 tokens · 117.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-form 4096 tokens · 117.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate 4096 tokens · 117.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-p 603 tokens · 117.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 437 tokens · 116.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-k 2956 tokens · 116.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma 763 tokens · 116.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ scientist 3639 tokens · 116.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default 2610 tokens · 116.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param 279 tokens · 116.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match 256 tokens · 116.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers 709 tokens · 116.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 4096 tokens · 116.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 2610 tokens · 116.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ min-p 1404 tokens · 116.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars 4028 tokens · 116.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized 1558 tokens · 115.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 2610 tokens · 115.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt 2024 tokens · 115.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp 1455 tokens · 115.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format 334 tokens · 115.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming 2177 tokens · 115.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 1135 tokens · 115.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered 874 tokens · 115.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded 1501 tokens · 115.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty 1143 tokens · 115.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 330 tokens · 115.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered 1455 tokens · 115.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ verbose 364 tokens · 115.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt 370 tokens · 115.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 338 tokens · 114.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-python 267 tokens · 114.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 1135 tokens · 114.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv 1282 tokens · 114.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ verbose 1782 tokens · 114.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 330 tokens · 114.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ default 963 tokens · 114.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded 1501 tokens · 114.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-p 1282 tokens · 114.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode 1280 tokens · 114.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 1135 tokens · 113.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-output 992 tokens · 113.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param 270 tokens · 113.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup 810 tokens · 113.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key 851 tokens · 112.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema 810 tokens · 112.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs 810 tokens · 112.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw 810 tokens · 112.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs 144 tokens · 112.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi 810 tokens · 112.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none 810 tokens · 112.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag 810 tokens · 112.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json 810 tokens · 112.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 1135 tokens · 112.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 810 tokens · 112.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only 810 tokens · 112.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param 810 tokens · 112.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested 810 tokens · 112.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text 810 tokens · 112.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp 937 tokens · 112.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 810 tokens · 112.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word 810 tokens · 112.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 287 tokens · 112.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose 989 tokens · 112.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list 810 tokens · 112.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode 810 tokens · 112.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars 810 tokens · 112.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single 810 tokens · 112.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase 810 tokens · 112.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple 810 tokens · 112.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param 810 tokens · 112.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 810 tokens · 112.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi 810 tokens · 112.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word 1214 tokens · 111.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers 1108 tokens · 111.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge 810 tokens · 111.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming 810 tokens · 111.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal 810 tokens · 111.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 810 tokens · 111.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 810 tokens · 111.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual 866 tokens · 111.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ json-output 810 tokens · 111.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace 810 tokens · 111.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt 810 tokens · 111.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ math 810 tokens · 111.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word 810 tokens · 111.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value 810 tokens · 111.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi 83 tokens · 110.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ greedy 810 tokens · 110.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 134 tokens · 110.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format 810 tokens · 110.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param 191 tokens · 109.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 810 tokens · 109.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens 100 tokens · 107.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode 341 tokens · 106.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi 253 tokens · 105.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-form 1492 tokens · 105.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars 558 tokens · 104.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 149 tokens · 103.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline 173 tokens · 101.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate 685 tokens · 101.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 59 tokens · 99.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match 256 tokens · 97.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 103 tokens · 97.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ short-output 50 tokens · 97.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-python 32768 tokens · 95.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift 32768 tokens · 95.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word 374 tokens · 94.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty 3857 tokens · 94.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 256 tokens · 93.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty 3781 tokens · 93.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 256 tokens · 93.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 256 tokens · 93.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 256 tokens · 93.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 256 tokens · 92.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 256 tokens · 92.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value 209 tokens · 92.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift 32768 tokens · 92.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty 999 tokens · 91.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty 795 tokens · 91.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup 234 tokens · 89.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 67 tokens · 88.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 329 tokens · 86.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge 245 tokens · 86.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag 239 tokens · 86.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 329 tokens · 85.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single 199 tokens · 82.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only 209 tokens · 80.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens 100 tokens · 75.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp 1859 tokens · 75.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ short-output 50 tokens · 54.2 tok/s