MLX Model Test Report

Generated 2026-04-07 20:10 · AFM MLX Backend · v0.9.10-628c2bb

mlx-model-test.sh --model mlx-community/Qwen3.5-35B-A3B-4bit --prompts Scripts/test-llm-comprehensive.txt --smart 1:codex

Test Runs
190
Passed
190
Failed
0
Best tok/s
155.8
Fastest
mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Test Model / Config Status Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 102 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase stop-long-phrase OK 0.0 2.0 1143 7.34
155.8
Write a 3-paragraph essay about renewable energy. Start the ...
2 78 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline stop-double-newline OK 0.0 2.0 742 5.86
126.7
Write a short paragraph about the ocean. Then write a second...
3 82 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period stop-period OK 0.0 2.0 692 5.49
126.0
Tell me about the sun in three sentences.
4 108 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate stop-immediate OK 0.0 2.0 767 6.1
125.7
Explain what gravity is.
5 75 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline stop-newline OK 0.0 1.0 817 6.68
122.3
Name three primary colors and explain why they matter in des...
6 144 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 2.0 1174 9.63
121.9
max_completion_tokens: 100
7 132 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema response-format-schema OK 0.0 2.0 1478 12.16
121.6
Generate a fictional person profile.
8 136 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal think-normal OK 0.0 2.0 833 6.86
121.5
Solve step by step: If a train travels at 60 mph for 2.5 hou...
9 155 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 2.0 502 4.14
121.3
What is the weather in Tokyo?
10 130 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json response-format-json OK 0.0 1.0 1303 10.75
121.2
Return a JSON object with keys "language", "year_created", a...
11 60 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized kv-quantized
--kv-bits 4
OK 0.7 1.0 1148 9.47
121.2
Summarize the key ideas of machine learning in a few paragra...
12 138 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw think-raw
--raw
OK 0.0 2.0 833 6.88
121.2
Solve step by step: If a train travels at 60 mph for 2.5 hou...
13 161 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 1169 9.65
121.1
What is the weather in London and what time is it in Tokyo?
14 145 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 2.0 2300 19.0
121.1
Explain the causes and consequences of the French Revolution...
15 172 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none tool-call-none OK 0.0 2.0 475 3.93
121.0
What is the current temperature in Berlin?
16 170 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param tool-call-nullable-param OK 0.0 2.0 573 4.74
120.9
What is the weather in Chicago?
17 70 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode raw-mode
--raw
OK 0.7 2.0 1226 10.14
120.9
Think step by step: what is 17 * 23?
18 107 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate stop-immediate OK 0.0 2.0 817 6.77
120.8
Name three primary colors and explain why they matter in des...
19 100 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key stop-json-object-key OK 0.0 1.0 4096 33.98
120.5
Generate a JSON object with keys "name", "age", and "city" f...
20 81 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period stop-period OK 0.0 2.0 831 6.9
120.5
Name three primary colors and explain why they matter in des...
21 116 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max stop-four-max OK 0.0 1.0 4096 33.99
120.5
List 10 facts about numbers, alternating between digit forma...
22 140 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 0.7 2.0 2469 20.49
120.5
Write a 4-line poem about the ocean.
23 180 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual multilingual OK 0.3 2.0 856 7.11
120.5
Translate "Hello, how are you?" into French, Spanish, Japane...
24 77 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline stop-double-newline OK 0.0 2.0 817 6.79
120.4
Name three primary colors and explain why they matter in des...
25 109 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars stop-special-chars OK 0.0 2.0 824 6.85
120.4
Name three primary colors and explain why they matter in des...
26 30 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 eli5 OK 0.7 2.0 1316 10.94
120.3
Tell me about quantum computing.
27 92 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 0.0 2.0 4096 34.07
120.2
List 10 planets or celestial objects, numbered 1 through 10,...
28 34 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list numbered-list OK 0.0 2.0 489 4.07
120.2
List exactly 5 animals, one per line, numbered 1-5. No other...
29 148 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 2.0 437 3.64
120.2
Write a Python function that reverses a string.
30 142 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 0.7 1.0 2469 20.57
120.0
Write a 4-line poem about the ocean.
31 26 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate pirate OK 0.7 2.0 1406 11.71
120.0
Tell me about quantum computing.
32 28 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist scientist OK 0.3 2.0 2320 19.34
120.0
Tell me about quantum computing.
33 58 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv small-kv
--max-kv-size 2048
OK 0.7 1.0 1087 9.06
119.9
Summarize the key ideas of machine learning in a few paragra...
34 115 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max stop-four-max OK 0.0 1.0 818 6.82
119.9
Name three primary colors and explain why they matter in des...
35 62 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default prefill-default OK 0.0 1.0 3652 30.48
119.8
Given this architecture, what are the top 3 performance bott...
36 64 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 0.0 2.0 3652 30.48
119.8
Given this architecture, what are the top 3 performance bott...
37 147 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 2.0 4096 34.19
119.8
developer: You are a helpful coding assistant. Only respond ...
38 150 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose verbose
--verbose
OK 0.7 2.0 374 3.12
119.8
Hello, how are you?
39 54 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output long-output OK 0.7 2.0 1994 16.65
119.8
Write a detailed recipe for chocolate chip cookies with ingr...
40 158 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 2.0 4096 34.2
119.8
What is the weather in Paris in celsius?
41 66 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 0.0 2.0 3652 30.5
119.7
Given this architecture, what are the top 3 performance bott...
42 164 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 458 3.83
119.7
Search recursively for all Swift files under Sources/ with a...
43 2 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy greedy OK 0.0 2.0 546 4.57
119.5
Explain why the sky is blue in exactly 3 bullet points.
44 176 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt long-prompt OK 0.0 1.0 831 6.95
119.5
Repeat after me exactly: The quick brown fox jumps over the ...
45 68 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming no-streaming
--no-streaming
OK 0.7 2.0 4096 34.29
119.4
Write a short poem about the moon.
46 4 mlx-community/Qwen3.5-35B-A3B-4bit @ default default OK 0.7 2.0 648 5.43
119.4
Explain why the sky is blue in exactly 3 bullet points.
47 134 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text response-format-text OK 0.0 2.0 370 3.11
119.1
Tell me the language Python, what year it was created, and w...
48 12 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p min-p
--min-p 0.05
OK 0.8 1.0 637 5.35
119.0
Explain why the sky is blue in exactly 3 bullet points.
49 6 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp high-temp OK 1.5 3.0 545 4.58
118.9
Explain why the sky is blue in exactly 3 bullet points.
50 20 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 0.8 2.0 4096 34.49
118.8
Write a long essay about the history of bread making across ...
51 152 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose very-verbose
--very-verbose
OK 0.7 2.0 384 3.23
118.8
Hello, how are you?
52 50 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 0.0 1.0 356 3.0
118.7
Write a unit test for the timeout feature you just described...
53 117 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate stop-system-pirate OK 0.0 1.0 4096 34.51
118.7
Name three primary colors and explain why they matter in des...
54 186 mlx-community/Qwen3.5-35B-A3B-4bit @ math math OK 0.0 3.0 1830 15.45
118.5
A store sells notebooks for $3.50 each. If you buy 5 or more...
55 10 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k top-k
--top-k 30
OK 0.8 2.0 652 5.51
118.3
Explain why the sky is blue in exactly 3 bullet points.
56 32 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output json-output OK 0.0 2.0 384 3.25
118.1
Respond with a valid JSON object containing keys "name", "ag...
57 120 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered stop-system-numbered OK 0.0 1.0 874 7.4
118.1
What are the main benefits of exercise?
58 18 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 0.7 2.0 4096 34.73
117.9
Write a limerick about a cat.
59 167 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param tool-call-array-param OK 0.0 2.0 279 2.37
117.7
Create three todo items: Buy milk, Call dentist, Fix bug #42...
60 178 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars special-chars OK 0.0 1.0 4028 34.24
117.6
Repeat these characters exactly: <tag> "quotes" 'apostrophes...
61 106 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match stop-no-match OK 0.0 1.0 256 2.18
117.5
Explain the difference between TCP and UDP in a few sentence...
62 16 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 0.7 2.0 4096 34.87
117.5
Write a limerick about a cat.
63 63 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 0.0 2.0 2610 22.23
117.4
Name three primary colors and explain why they matter in des...
64 65 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 0.0 2.0 2610 22.31
117.0
Name three primary colors and explain why they matter in des...
65 61 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default prefill-default OK 0.0 1.0 2610 22.31
117.0
Name three primary colors and explain why they matter in des...
66 163 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 338 2.89
116.9
tools: [{"type":"function","function":{"name":"search_files"...
67 119 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered stop-system-numbered OK 0.0 1.0 1455 12.45
116.9
Name three primary colors and explain why they matter in des...
68 25 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate pirate OK 0.7 2.0 2383 20.39
116.9
Name three primary colors and explain why they matter in des...
69 8 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p top-p
--top-p 0.9
OK 0.8 1.0 624 5.34
116.8
Explain why the sky is blue in exactly 3 bullet points.
70 188 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form long-form OK 0.7 2.0 4096 35.11
116.7
Write a detailed technical blog post explaining how Mixture-...
71 173 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt minimal-prompt OK 0.7 1.0 4096 35.14
116.6
Name three primary colors and explain why they matter in des...
72 27 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist scientist OK 0.3 2.0 3144 26.97
116.6
Name three primary colors and explain why they matter in des...
73 154 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 2.0 330 2.83
116.5
tools: [{"type":"function","function":{"name":"get_weather",...
74 157 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 2.0 330 2.83
116.4
tools: [{"type":"function","function":{"name":"get_weather",...
75 141 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 0.7 1.0 1501 12.9
116.4
Name three primary colors and explain why they matter in des...
76 121 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp stop-high-temp OK 1.0 2.0 2229 19.17
116.3
Name three primary colors and explain why they matter in des...
77 190 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format strict-format OK 0.0 2.0 334 2.87
116.3
Output EXACTLY 3 lines. Each line must contain exactly one w...
78 14 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 0.8 2.0 699 6.03
115.8
Explain why the sky is blue in exactly 3 bullet points.
79 3 mlx-community/Qwen3.5-35B-A3B-4bit @ default default OK 0.7 2.0 2542 22.02
115.5
Name three primary colors and explain why they matter in des...
80 174 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt minimal-prompt OK 0.7 1.0 196 1.7
115.2
Hi
81 139 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 0.7 2.0 1501 13.04
115.1
Name three primary colors and explain why they matter in des...
82 59 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized kv-quantized
--kv-bits 4
OK 0.7 1.0 1257 10.93
115.0
Name three primary colors and explain why they matter in des...
83 7 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p top-p
--top-p 0.9
OK 0.8 1.0 1594 13.86
115.0
Name three primary colors and explain why they matter in des...
84 166 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param tool-call-array-param OK 0.0 2.0 270 2.35
115.0
tools: [{"type":"function","function":{"name":"todowrite","d...
85 125 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 stop-seed-run2 OK 0.7 1.0 1135 9.88
114.9
Name three primary colors and explain why they matter in des...
86 11 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p min-p
--min-p 0.05
OK 0.8 1.0 1607 14.01
114.7
Name three primary colors and explain why they matter in des...
87 160 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 287 2.51
114.3
tools: [{"type":"function","function":{"name":"get_weather",...
88 80 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word stop-word OK 0.0 1.0 1214 10.66
113.8
Name 5 programming languages and briefly describe each one.
89 83 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 0.0 1.0 810 7.14
113.5
Name three primary colors and explain why they matter in des...
90 123 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 stop-seed-run1 OK 0.7 2.0 1135 10.01
113.4
Name three primary colors and explain why they matter in des...
91 111 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag stop-html-tag OK 0.0 1.0 810 7.14
113.4
Name three primary colors and explain why they matter in des...
92 79 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word stop-word OK 0.0 1.0 810 7.15
113.3
Name three primary colors and explain why they matter in des...
93 56 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs logprobs
--max-logprobs 5
OK 0.0 2.0 144 1.27
113.3
What is 1+1?
94 129 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json response-format-json OK 0.0 1.0 810 7.15
113.3
Name three primary colors and explain why they matter in des...
95 33 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list numbered-list OK 0.0 2.0 810 7.15
113.3
Name three primary colors and explain why they matter in des...
96 175 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt long-prompt OK 0.0 1.0 810 7.16
113.2
Name three primary colors and explain why they matter in des...
97 17 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 0.7 2.0 1135 10.03
113.1
Name three primary colors and explain why they matter in des...
98 99 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key stop-json-object-key OK 0.0 1.0 851 7.53
113.0
Name three primary colors and explain why they matter in des...
99 73 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi stop-multi OK 0.0 1.0 810 7.17
113.0
Name three primary colors and explain why they matter in des...
100 177 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars special-chars OK 0.0 1.0 810 7.17
113.0
Name three primary colors and explain why they matter in des...
101 5 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp high-temp OK 1.5 3.0 1124 9.95
112.9
Name three primary colors and explain why they matter in des...
102 165 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param tool-call-array-param OK 0.0 2.0 810 7.18
112.8
Name three primary colors and explain why they matter in des...
103 168 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param tool-call-nullable-param OK 0.0 2.0 810 7.18
112.8
Name three primary colors and explain why they matter in des...
104 159 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 810 7.19
112.7
Name three primary colors and explain why they matter in des...
105 9 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k top-k
--top-k 30
OK 0.8 2.0 1722 15.28
112.7
Name three primary colors and explain why they matter in des...
106 151 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose very-verbose
--very-verbose
OK 0.7 2.0 1062 9.43
112.7
Name three primary colors and explain why they matter in des...
107 29 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 eli5 OK 0.7 2.0 1057 9.39
112.6
Name three primary colors and explain why they matter in des...
108 162 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 810 7.2
112.5
Name three primary colors and explain why they matter in des...
109 86 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 0.0 2.0 83 0.74
111.9
Write a bash script that prints the current date inside a co...
110 113 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode stop-unicode OK 0.0 2.0 810 7.26
111.6
Name three primary colors and explain why they matter in des...
111 171 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none tool-call-none OK 0.0 2.0 810 7.26
111.5
Name three primary colors and explain why they matter in des...
112 103 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word stop-multi-word OK 0.0 2.0 810 7.27
111.5
Name three primary colors and explain why they matter in des...
113 85 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 0.0 2.0 810 7.27
111.5
Name three primary colors and explain why they matter in des...
114 55 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs logprobs
--max-logprobs 5
OK 0.0 2.0 810 7.27
111.4
Name three primary colors and explain why they matter in des...
115 131 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema response-format-schema OK 0.0 2.0 810 7.27
111.4
Name three primary colors and explain why they matter in des...
116 143 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 2.0 810 7.27
111.4
Name three primary colors and explain why they matter in des...
117 91 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 0.0 2.0 810 7.27
111.4
Name three primary colors and explain why they matter in des...
118 135 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal think-normal OK 0.0 2.0 810 7.28
111.3
Name three primary colors and explain why they matter in des...
119 153 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 2.0 810 7.28
111.3
Name three primary colors and explain why they matter in des...
120 71 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single stop-single OK 0.0 2.0 810 7.28
111.3
Name three primary colors and explain why they matter in des...
121 69 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode raw-mode
--raw
OK 0.7 2.0 880 7.91
111.2
Name three primary colors and explain why they matter in des...
122 179 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual multilingual OK 0.3 2.0 881 7.92
111.2
Name three primary colors and explain why they matter in des...
123 15 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 0.7 2.0 1135 10.21
111.2
Name three primary colors and explain why they matter in des...
124 187 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form long-form OK 0.7 2.0 1035 9.31
111.2
Name three primary colors and explain why they matter in des...
125 156 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 2.0 810 7.29
111.2
Name three primary colors and explain why they matter in des...
126 101 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase stop-long-phrase OK 0.0 2.0 810 7.29
111.1
Name three primary colors and explain why they matter in des...
127 31 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output json-output OK 0.0 2.0 810 7.29
111.0
Name three primary colors and explain why they matter in des...
128 146 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 2.0 810 7.3
111.0
Name three primary colors and explain why they matter in des...
129 57 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv small-kv
--max-kv-size 2048
OK 0.7 1.0 679 6.12
110.9
Name three primary colors and explain why they matter in des...
130 87 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 0.0 1.0 810 7.31
110.9
Name three primary colors and explain why they matter in des...
131 89 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 0.0 2.0 810 7.32
110.7
Name three primary colors and explain why they matter in des...
132 133 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text response-format-text OK 0.0 2.0 810 7.33
110.4
Name three primary colors and explain why they matter in des...
133 137 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw think-raw
--raw
OK 0.0 2.0 810 7.34
110.3
Name three primary colors and explain why they matter in des...
134 19 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 0.8 2.0 1318 11.96
110.2
Name three primary colors and explain why they matter in des...
135 1 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy greedy OK 0.0 2.0 810 7.38
109.7
Name three primary colors and explain why they matter in des...
136 189 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format strict-format OK 0.0 2.0 810 7.39
109.5
Name three primary colors and explain why they matter in des...
137 149 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose verbose
--verbose
OK 0.7 2.0 701 6.4
109.5
Name three primary colors and explain why they matter in des...
138 185 mlx-community/Qwen3.5-35B-A3B-4bit @ math math OK 0.0 3.0 810 7.42
109.1
Name three primary colors and explain why they matter in des...
139 53 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output long-output OK 0.7 2.0 701 6.43
109.1
Name three primary colors and explain why they matter in des...
140 169 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param tool-call-nullable-param OK 0.0 2.0 191 1.77
108.1
tools: [{"type":"function","function":{"name":"get_weather",...
141 114 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode stop-unicode OK 0.0 2.0 341 3.16
108.0
List 5 items about space using bullet points (•).
142 128 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens stop-low-max-tokens OK 0.0 1.0 100 0.93
108.0
List 10 mountains, numbered 1 through 10, one per line.
143 67 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming no-streaming
--no-streaming
OK 0.7 2.0 614 5.69
107.9
Name three primary colors and explain why they matter in des...
144 48 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 0.0 2.0 134 1.25
107.5
Now add a --timeout flag to the CLI that sets a request time...
145 74 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi stop-multi OK 0.0 1.0 253 2.37
106.6
Write a Python hello world program in a code block, then wri...
146 110 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars stop-special-chars OK 0.0 2.0 558 5.29
105.5
List 3 facts about the moon. Use **bold** markdown for empha...
147 13 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 0.8 2.0 717 6.82
105.1
Name three primary colors and explain why they matter in des...
148 182 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python code-python OK 0.0 1.0 267 2.56
104.2
Write a function that finds all prime numbers up to n using ...
149 44 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 0.0 1.0 149 1.44
103.6
Write a unit test for the timeout feature you just described...
150 118 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate stop-system-pirate OK 0.0 1.0 685 6.69
102.4
Tell me about treasure hunting on the high seas.
151 76 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline stop-newline OK 0.0 1.0 173 1.73
99.9
What is the capital of France? Answer in one sentence.
152 46 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 0.0 1.0 59 0.6
98.2
Read the file Sources/MacLocalAPI/main.swift and explain wha...
153 104 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word stop-multi-word OK 0.0 2.0 374 3.82
97.9
Write a 5-step recipe for making tea. Label each step as "St...
154 42 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 0.0 1.0 103 1.06
97.0
Now add a --timeout flag to the CLI that sets a request time...
155 52 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output short-output OK 0.7 2.0 50 0.52
96.7
Describe the entire history of Rome.
156 105 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match stop-no-match OK 0.0 1.0 256 2.69
95.0
Name three primary colors and explain why they matter in des...
157 181 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python code-python OK 0.0 1.0 32768 347.24
94.4
Name three primary colors and explain why they matter in des...
158 184 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift code-swift OK 0.0 2.0 32768 351.93
93.1
Write a Swift async function that fetches JSON from a URL us...
159 47 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 0.0 2.0 256 2.75
93.0
Name three primary colors and explain why they matter in des...
160 49 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 0.0 1.0 256 2.77
92.5
Name three primary colors and explain why they matter in des...
161 41 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 0.0 1.0 256 2.77
92.4
Name three primary colors and explain why they matter in des...
162 22 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 0.8 3.0 3647 39.53
92.2
Write a long essay about the history of bread making across ...
163 24 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 0.8 2.0 4096 44.73
91.6
Write a long essay about the history of bread making across ...
164 90 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 0.0 2.0 234 2.61
89.8
List 10 cities, numbered 1 through 10, one per line.
165 21 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 0.8 3.0 1099 12.27
89.6
Name three primary colors and explain why they matter in des...
166 45 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 0.0 1.0 256 2.89
88.5
Name three primary colors and explain why they matter in des...
167 126 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 stop-seed-run2 OK 0.7 1.0 329 3.72
88.5
List 10 flowers, numbered 1 through 10, one per line.
168 43 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 0.0 1.0 256 2.9
88.3
Name three primary colors and explain why they matter in des...
169 124 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 stop-seed-run1 OK 0.7 2.0 329 3.74
88.1
List 10 flowers, numbered 1 through 10, one per line.
170 88 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 0.0 1.0 245 2.79
87.8
List 10 countries, numbered 1 through 10, one per line.
171 40 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 0.0 1.0 67 0.77
87.4
Read the file Sources/MacLocalAPI/main.swift and explain wha...
172 112 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag stop-html-tag OK 0.0 1.0 239 2.74
87.2
Write an HTML unordered list of 5 fruits using <ul> and <li>...
173 122 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp stop-high-temp OK 1.0 2.0 246 2.82
87.2
List 10 random words, numbered 1 through 10, one per line.
174 39 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 0.0 1.0 256 2.94
87.0
Name three primary colors and explain why they matter in des...
175 23 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 0.8 2.0 565 6.68
84.6
Name three primary colors and explain why they matter in des...
176 183 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift code-swift OK 0.0 2.0 32768 388.29
84.4
Name three primary colors and explain why they matter in des...
177 72 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single stop-single OK 0.0 2.0 199 2.36
84.2
List 10 fruits, numbered 1-10, one per line.
178 84 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 0.0 1.0 209 2.53
82.6
List 10 types of cheese, numbered 1 through 10, one per line...
179 38 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 0.0 2.0 34 0.46
74.2
Describe Tokyo as a structured record with at least 3 landma...
180 127 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens stop-low-max-tokens OK 0.0 1.0 100 1.4
71.5
Name three primary colors and explain why they matter in des...
181 51 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output short-output OK 0.7 2.0 50 1.12
44.8
Name three primary colors and explain why they matter in des...
182 36 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 0.0 1.0 10 0.25
39.9
Generate a person record.
183 37 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 0.0 2.0 26 0.98
26.4
Name three primary colors and explain why they matter in des...
184 98 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 0.0 1.0 7 0.27
25.9
Describe the color blue with its hex code.
185 35 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 0.0 1.0 13 0.74
17.6
Name three primary colors and explain why they matter in des...
186 97 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 0.0 1.0 15 0.89
16.9
Name three primary colors and explain why they matter in des...
187 93 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 0.0 1.0 12 0.74
16.3
Name three primary colors and explain why they matter in des...
188 94 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 0.0 1.0 3 0.2
15.1
List 5 major world cities as a JSON array. Include Tokyo.
189 96 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 0.0 1.0 3 0.21
14.0
Generate a person profile for someone named Alice who is 30 ...
190 95 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 0.0 1.0 3 0.67
4.5
Name three primary colors and explain why they matter in des...

Full Responses

#102 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase 1143 tokens · 155.8 tok/s

#78 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline 742 tokens · 126.7 tok/s

#82 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period 692 tokens · 126.0 tok/s

#108 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate 767 tokens · 125.7 tok/s

#75 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline 817 tokens · 122.3 tok/s

#144 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 1174 tokens · 121.9 tok/s

#132 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema 1478 tokens · 121.6 tok/s

#136 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal 833 tokens · 121.5 tok/s

#155 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 502 tokens · 121.3 tok/s

#130 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json 1303 tokens · 121.2 tok/s

#60 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized 1148 tokens · 121.2 tok/s

#138 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw 833 tokens · 121.2 tok/s

#161 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 1169 tokens · 121.1 tok/s

#145 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 2300 tokens · 121.1 tok/s

#172 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none 475 tokens · 121.0 tok/s

#170 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param 573 tokens · 120.9 tok/s

#70 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode 1226 tokens · 120.9 tok/s

#107 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate 817 tokens · 120.8 tok/s

#100 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key 4096 tokens · 120.5 tok/s

#81 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period 831 tokens · 120.5 tok/s

#116 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max 4096 tokens · 120.5 tok/s

#140 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded 2469 tokens · 120.5 tok/s

#180 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual 856 tokens · 120.5 tok/s

#77 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline 817 tokens · 120.4 tok/s

#109 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars 824 tokens · 120.4 tok/s

#30 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 1316 tokens · 120.3 tok/s

#92 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming 4096 tokens · 120.2 tok/s

#34 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list 489 tokens · 120.2 tok/s

#148 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 437 tokens · 120.2 tok/s

#142 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded 2469 tokens · 120.0 tok/s

#26 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate 1406 tokens · 120.0 tok/s

#28 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist 2320 tokens · 120.0 tok/s

#58 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv 1087 tokens · 119.9 tok/s

#115 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max 818 tokens · 119.9 tok/s

#62 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default 3652 tokens · 119.8 tok/s

#64 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 3652 tokens · 119.8 tok/s

#147 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 4096 tokens · 119.8 tok/s

#150 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose 374 tokens · 119.8 tok/s

#54 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output 1994 tokens · 119.8 tok/s

#158 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 4096 tokens · 119.8 tok/s

#66 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 3652 tokens · 119.7 tok/s

#164 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 458 tokens · 119.7 tok/s

#2 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy 546 tokens · 119.5 tok/s

#176 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt 831 tokens · 119.5 tok/s

#68 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming 4096 tokens · 119.4 tok/s

#4 mlx-community/Qwen3.5-35B-A3B-4bit @ default 648 tokens · 119.4 tok/s

#134 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text 370 tokens · 119.1 tok/s

#12 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p 637 tokens · 119.0 tok/s

#6 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp 545 tokens · 118.9 tok/s

#20 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty 4096 tokens · 118.8 tok/s

#152 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose 384 tokens · 118.8 tok/s

#50 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 356 tokens · 118.7 tok/s

#117 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate 4096 tokens · 118.7 tok/s

#186 mlx-community/Qwen3.5-35B-A3B-4bit @ math 1830 tokens · 118.5 tok/s

#10 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k 652 tokens · 118.3 tok/s

#32 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output 384 tokens · 118.1 tok/s

#120 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered 874 tokens · 118.1 tok/s

#18 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 4096 tokens · 117.9 tok/s

#167 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param 279 tokens · 117.7 tok/s

#178 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars 4028 tokens · 117.6 tok/s

#106 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match 256 tokens · 117.5 tok/s

#16 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 4096 tokens · 117.5 tok/s

#63 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 2610 tokens · 117.4 tok/s

#65 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 2610 tokens · 117.0 tok/s

#61 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default 2610 tokens · 117.0 tok/s

#163 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 338 tokens · 116.9 tok/s

#119 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered 1455 tokens · 116.9 tok/s

#25 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate 2383 tokens · 116.9 tok/s

#8 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p 624 tokens · 116.8 tok/s

#188 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form 4096 tokens · 116.7 tok/s

#173 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt 4096 tokens · 116.6 tok/s

#27 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist 3144 tokens · 116.6 tok/s

#154 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 330 tokens · 116.5 tok/s

#157 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 330 tokens · 116.4 tok/s

#141 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded 1501 tokens · 116.4 tok/s

#121 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp 2229 tokens · 116.3 tok/s

#190 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format 334 tokens · 116.3 tok/s

#14 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers 699 tokens · 115.8 tok/s

#3 mlx-community/Qwen3.5-35B-A3B-4bit @ default 2542 tokens · 115.5 tok/s

#174 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt 196 tokens · 115.2 tok/s

#139 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded 1501 tokens · 115.1 tok/s

#59 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized 1257 tokens · 115.0 tok/s

#7 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p 1594 tokens · 115.0 tok/s

#166 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param 270 tokens · 115.0 tok/s

#125 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 1135 tokens · 114.9 tok/s

#11 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p 1607 tokens · 114.7 tok/s

#160 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 287 tokens · 114.3 tok/s

#80 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word 1214 tokens · 113.8 tok/s

#83 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only 810 tokens · 113.5 tok/s

#123 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 1135 tokens · 113.4 tok/s

#111 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag 810 tokens · 113.4 tok/s

#79 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word 810 tokens · 113.3 tok/s

#56 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs 144 tokens · 113.3 tok/s

#129 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json 810 tokens · 113.3 tok/s

#33 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list 810 tokens · 113.3 tok/s

#175 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt 810 tokens · 113.2 tok/s

#17 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 1135 tokens · 113.1 tok/s

#99 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key 851 tokens · 113.0 tok/s

#73 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi 810 tokens · 113.0 tok/s

#177 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars 810 tokens · 113.0 tok/s

#5 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp 1124 tokens · 112.9 tok/s

#165 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-array-param 810 tokens · 112.8 tok/s

#168 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param 810 tokens · 112.8 tok/s

#159 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 810 tokens · 112.7 tok/s

#9 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k 1722 tokens · 112.7 tok/s

#151 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose 1062 tokens · 112.7 tok/s

#29 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 1057 tokens · 112.6 tok/s

#162 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 810 tokens · 112.5 tok/s

#86 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi 83 tokens · 111.9 tok/s

#113 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode 810 tokens · 111.6 tok/s

#171 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none 810 tokens · 111.5 tok/s

#103 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word 810 tokens · 111.5 tok/s

#85 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi 810 tokens · 111.5 tok/s

#55 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs 810 tokens · 111.4 tok/s

#131 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema 810 tokens · 111.4 tok/s

#143 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 810 tokens · 111.4 tok/s

#91 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming 810 tokens · 111.4 tok/s

#135 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal 810 tokens · 111.3 tok/s

#153 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 810 tokens · 111.3 tok/s

#71 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single 810 tokens · 111.3 tok/s

#69 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode 880 tokens · 111.2 tok/s

#179 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual 881 tokens · 111.2 tok/s

#15 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 1135 tokens · 111.2 tok/s

#187 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form 1035 tokens · 111.2 tok/s

#156 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 810 tokens · 111.2 tok/s

#101 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase 810 tokens · 111.1 tok/s

#31 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output 810 tokens · 111.0 tok/s

#146 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 810 tokens · 111.0 tok/s

#57 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv 679 tokens · 110.9 tok/s

#87 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge 810 tokens · 110.9 tok/s

#89 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup 810 tokens · 110.7 tok/s

#133 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text 810 tokens · 110.4 tok/s

#137 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw 810 tokens · 110.3 tok/s

#19 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty 1318 tokens · 110.2 tok/s

#1 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy 810 tokens · 109.7 tok/s

#189 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format 810 tokens · 109.5 tok/s

#149 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose 701 tokens · 109.5 tok/s

#185 mlx-community/Qwen3.5-35B-A3B-4bit @ math 810 tokens · 109.1 tok/s

#53 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output 701 tokens · 109.1 tok/s

#169 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-nullable-param 191 tokens · 108.1 tok/s

#114 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode 341 tokens · 108.0 tok/s

#128 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens 100 tokens · 108.0 tok/s

#67 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming 614 tokens · 107.9 tok/s

#48 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 134 tokens · 107.5 tok/s

#74 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi 253 tokens · 106.6 tok/s

#110 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars 558 tokens · 105.5 tok/s

#13 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers 717 tokens · 105.1 tok/s

#182 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python 267 tokens · 104.2 tok/s

#44 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 149 tokens · 103.6 tok/s

#118 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate 685 tokens · 102.4 tok/s

#76 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline 173 tokens · 99.9 tok/s

#46 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 59 tokens · 98.2 tok/s

#104 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word 374 tokens · 97.9 tok/s

#42 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 103 tokens · 97.0 tok/s

#52 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output 50 tokens · 96.7 tok/s

#105 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match 256 tokens · 95.0 tok/s

#181 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python 32768 tokens · 94.4 tok/s

#184 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift 32768 tokens · 93.1 tok/s

#47 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 256 tokens · 93.0 tok/s

#49 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 256 tokens · 92.5 tok/s

#41 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 256 tokens · 92.4 tok/s

#22 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty 3647 tokens · 92.2 tok/s

#24 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty 4096 tokens · 91.6 tok/s

#90 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup 234 tokens · 89.8 tok/s

#21 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty 1099 tokens · 89.6 tok/s

#45 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 256 tokens · 88.5 tok/s

#126 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 329 tokens · 88.5 tok/s

#43 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 256 tokens · 88.3 tok/s

#124 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 329 tokens · 88.1 tok/s

#88 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge 245 tokens · 87.8 tok/s

#40 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 67 tokens · 87.4 tok/s

#112 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag 239 tokens · 87.2 tok/s

#122 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp 246 tokens · 87.2 tok/s

#39 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 256 tokens · 87.0 tok/s

#23 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty 565 tokens · 84.6 tok/s

#183 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift 32768 tokens · 84.4 tok/s

#72 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single 199 tokens · 84.2 tok/s

#84 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only 209 tokens · 82.6 tok/s

#38 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested 34 tokens · 74.2 tok/s

#127 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens 100 tokens · 71.5 tok/s

#51 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output 50 tokens · 44.8 tok/s

#36 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple 10 tokens · 39.9 tok/s

#37 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested 26 tokens · 26.4 tok/s

#98 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace 7 tokens · 25.9 tok/s

#35 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple 13 tokens · 17.6 tok/s

#97 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace 15 tokens · 16.9 tok/s

#93 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value 12 tokens · 16.3 tok/s

#94 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value 3 tokens · 15.1 tok/s

#96 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma 3 tokens · 14.0 tok/s

#95 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma 3 tokens · 4.5 tok/s