MLX Model Test Report

Generated 2026-04-04 09:31 · AFM MLX Backend · v0.9.10-bc9de80

mlx-model-test.sh --model mlx-community/gemma-4-e4b-it-4bit --prompts Scripts/test-llm-comprehensive.txt --smart 1:claude

Test Runs
182
Passed
169
Failed
13
Best tok/s
103.5
Fastest
mlx-community/gemma-4-e4b-it-4bit @ stop-long-phrase

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Test Model / Config Status claude Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 102 mlx-community/gemma-4-e4b-it-4bit @ stop-long-phrase stop-long-phrase OK 5 0.0 2.0 471 4.55
103.5
Write a 3-paragraph essay about renewable energy. Start the ...
2 108 mlx-community/gemma-4-e4b-it-4bit @ stop-immediate stop-immediate OK 5 0.0 2.0 644 6.27
102.7
Explain what gravity is.
3 107 mlx-community/gemma-4-e4b-it-4bit @ stop-immediate stop-immediate OK 2 0.0 2.0 336 3.28
102.6
Name three primary colors and explain why they matter in des...
4 109 mlx-community/gemma-4-e4b-it-4bit @ stop-special-chars stop-special-chars OK 2 0.0 2.0 320 3.13
102.3
Name three primary colors and explain why they matter in des...
5 120 mlx-community/gemma-4-e4b-it-4bit @ stop-system-numbered stop-system-numbered OK 5 0.0 2.0 277 2.71
102.2
What are the main benefits of exercise?
6 95 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 5 0.0 2.0 326 3.2
101.8
Name three primary colors and explain why they matter in des...
7 114 mlx-community/gemma-4-e4b-it-4bit @ stop-unicode stop-unicode OK 4 0.0 2.0 402 4.02
100.0
List 5 items about space using bullet points (•).
8 132 mlx-community/gemma-4-e4b-it-4bit @ response-format-schema response-format-schema OK 2 0.0 2.0 1201 12.02
99.9
Generate a fictional person profile.
9 118 mlx-community/gemma-4-e4b-it-4bit @ stop-system-pirate stop-system-pirate OK 5 0.0 2.0 999 10.0
99.9
Tell me about treasure hunting on the high seas.
10 164 mlx-community/gemma-4-e4b-it-4bit @ tool-call-complex tool-call-complex OK 2 0.0 2.0 1007 10.09
99.8
Search recursively for all Swift files under Sources/ with a...
11 148 mlx-community/gemma-4-e4b-it-4bit @ developer-role developer-role OK 5 0.0 2.0 1082 10.84
99.8
Write a Python function that reverses a string.
12 161 mlx-community/gemma-4-e4b-it-4bit @ tool-call-multi tool-call-multi OK 2 0.0 2.0 440 4.41
99.7
What is the weather in London and what time is it in Tokyo?
13 136 mlx-community/gemma-4-e4b-it-4bit @ think-normal think-normal OK 5 0.0 3.0 562 5.64
99.7
Solve step by step: If a train travels at 60 mph for 2.5 hou...
14 144 mlx-community/gemma-4-e4b-it-4bit @ max-completion-tokens max-completion-tokens OK 2 0.0 2.0 289 2.9
99.6
max_completion_tokens: 100
15 138 mlx-community/gemma-4-e4b-it-4bit @ think-raw think-raw
--raw
OK 4 0.0 2.0 562 5.65
99.5
Solve step by step: If a train travels at 60 mph for 2.5 hou...
16 145 mlx-community/gemma-4-e4b-it-4bit @ max-completion-tokens max-completion-tokens OK 5 0.0 2.0 1755 17.63
99.5
Explain the causes and consequences of the French Revolution...
17 130 mlx-community/gemma-4-e4b-it-4bit @ response-format-json response-format-json OK 3 0.0 2.0 317 3.19
99.5
Return a JSON object with keys "language", "year_created", a...
18 134 mlx-community/gemma-4-e4b-it-4bit @ response-format-text response-format-text OK 5 0.0 2.0 317 3.2
99.2
Tell me the language Python, what year it was created, and w...
19 172 mlx-community/gemma-4-e4b-it-4bit @ tool-call-none tool-call-none OK 5 0.0 2.0 268 2.71
99.0
What is the current temperature in Berlin?
20 155 mlx-community/gemma-4-e4b-it-4bit @ tool-call-auto tool-call-auto OK 2 0.0 2.0 286 2.89
98.9
What is the weather in Tokyo?
21 106 mlx-community/gemma-4-e4b-it-4bit @ stop-no-match stop-no-match OK 3 0.0 3.0 256 2.59
98.9
Explain the difference between TCP and UDP in a few sentence...
22 158 mlx-community/gemma-4-e4b-it-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 2 0.0 2.0 281 2.84
98.9
What is the weather in Paris in celsius?
23 117 mlx-community/gemma-4-e4b-it-4bit @ stop-system-pirate stop-system-pirate OK 5 0.0 2.0 406 4.13
98.2
Name three primary colors and explain why they matter in des...
24 32 mlx-community/gemma-4-e4b-it-4bit @ json-output json-output OK 3 0.0 2.0 246 2.51
98.2
Respond with a valid JSON object containing keys "name", "ag...
25 170 mlx-community/gemma-4-e4b-it-4bit @ tool-call-nullable-param tool-call-nullable-param OK 2 0.0 2.0 286 2.92
98.1
What is the weather in Chicago?
26 113 mlx-community/gemma-4-e4b-it-4bit @ stop-unicode stop-unicode OK 5 0.0 2.0 368 3.76
98.0
Name three primary colors and explain why they matter in des...
27 115 mlx-community/gemma-4-e4b-it-4bit @ stop-four-max stop-four-max OK 2 0.0 2.0 368 3.76
97.9
Name three primary colors and explain why they matter in des...
28 133 mlx-community/gemma-4-e4b-it-4bit @ response-format-text response-format-text OK 5 0.0 2.0 368 3.76
97.9
Name three primary colors and explain why they matter in des...
29 146 mlx-community/gemma-4-e4b-it-4bit @ developer-role developer-role OK 5 0.0 2.0 368 3.76
97.9
Name three primary colors and explain why they matter in des...
30 129 mlx-community/gemma-4-e4b-it-4bit @ response-format-json response-format-json OK 2 0.0 2.0 368 3.76
97.8
Name three primary colors and explain why they matter in des...
31 131 mlx-community/gemma-4-e4b-it-4bit @ response-format-schema response-format-schema OK 2 0.0 2.0 368 3.76
97.8
Name three primary colors and explain why they matter in des...
32 162 mlx-community/gemma-4-e4b-it-4bit @ tool-call-complex tool-call-complex OK 5 0.0 2.0 368 3.76
97.8
Name three primary colors and explain why they matter in des...
33 165 mlx-community/gemma-4-e4b-it-4bit @ tool-call-array-param tool-call-array-param OK 3 0.0 2.0 368 3.76
97.8
Name three primary colors and explain why they matter in des...
34 159 mlx-community/gemma-4-e4b-it-4bit @ tool-call-multi tool-call-multi OK 5 0.0 2.0 368 3.76
97.7
Name three primary colors and explain why they matter in des...
35 156 mlx-community/gemma-4-e4b-it-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 5 0.0 2.0 368 3.77
97.7
Name three primary colors and explain why they matter in des...
36 143 mlx-community/gemma-4-e4b-it-4bit @ max-completion-tokens max-completion-tokens OK 5 0.0 2.0 368 3.77
97.7
Name three primary colors and explain why they matter in des...
37 152 mlx-community/gemma-4-e4b-it-4bit @ very-verbose very-verbose
--very-verbose
OK 5 0.7 2.0 247 2.53
97.7
Hello, how are you?
38 137 mlx-community/gemma-4-e4b-it-4bit @ think-raw think-raw
--raw
OK 4 0.0 2.0 368 3.77
97.7
Name three primary colors and explain why they matter in des...
39 135 mlx-community/gemma-4-e4b-it-4bit @ think-normal think-normal OK 5 0.0 3.0 368 3.77
97.6
Name three primary colors and explain why they matter in des...
40 171 mlx-community/gemma-4-e4b-it-4bit @ tool-call-none tool-call-none OK 5 0.0 2.0 368 3.77
97.6
Name three primary colors and explain why they matter in des...
41 153 mlx-community/gemma-4-e4b-it-4bit @ tool-call-auto tool-call-auto OK 5 0.0 2.0 368 3.77
97.5
Name three primary colors and explain why they matter in des...
42 111 mlx-community/gemma-4-e4b-it-4bit @ stop-html-tag stop-html-tag OK 5 0.0 2.0 368 3.77
97.5
Name three primary colors and explain why they matter in des...
43 167 mlx-community/gemma-4-e4b-it-4bit @ tool-call-array-param tool-call-array-param OK 2 0.0 2.0 179 1.84
97.3
Create three todo items: Buy milk, Call dentist, Fix bug #42...
44 150 mlx-community/gemma-4-e4b-it-4bit @ verbose verbose
--verbose
OK 5 0.7 2.0 232 2.39
97.1
Hello, how are you?
45 147 mlx-community/gemma-4-e4b-it-4bit @ developer-role developer-role OK 3 0.0 2.0 192 1.98
97.0
developer: You are a helpful coding assistant. Only respond ...
46 125 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run2 stop-seed-run2 OK 5 0.7 2.0 340 3.51
96.8
Name three primary colors and explain why they matter in des...
47 151 mlx-community/gemma-4-e4b-it-4bit @ very-verbose very-verbose
--very-verbose
OK 5 0.7 2.0 347 3.59
96.8
Name three primary colors and explain why they matter in des...
48 105 mlx-community/gemma-4-e4b-it-4bit @ stop-no-match stop-no-match OK 2 0.0 3.0 256 2.65
96.7
Name three primary colors and explain why they matter in des...
49 174 mlx-community/gemma-4-e4b-it-4bit @ minimal-prompt minimal-prompt OK 5 0.7 2.0 199 2.06
96.7
Hi
50 141 mlx-community/gemma-4-e4b-it-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 5 0.7 2.0 322 3.33
96.6
Name three primary colors and explain why they matter in des...
51 139 mlx-community/gemma-4-e4b-it-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 5 0.7 2.0 322 3.34
96.4
Name three primary colors and explain why they matter in des...
52 123 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run1 stop-seed-run1 OK 5 0.7 2.0 340 3.54
96.1
Name three primary colors and explain why they matter in des...
53 34 mlx-community/gemma-4-e4b-it-4bit @ numbered-list numbered-list OK 5 0.0 2.0 174 1.81
96.0
List exactly 5 animals, one per line, numbered 1-5. No other...
54 119 mlx-community/gemma-4-e4b-it-4bit @ stop-system-numbered stop-system-numbered OK 5 0.0 2.0 259 2.7
96.0
Name three primary colors and explain why they matter in des...
55 149 mlx-community/gemma-4-e4b-it-4bit @ verbose verbose
--verbose
OK 5 0.7 2.0 269 2.81
95.8
Name three primary colors and explain why they matter in des...
56 121 mlx-community/gemma-4-e4b-it-4bit @ stop-high-temp stop-high-temp OK 5 1.0 2.0 215 2.27
94.8
Name three primary colors and explain why they matter in des...
57 68 mlx-community/gemma-4-e4b-it-4bit @ no-streaming no-streaming
--no-streaming
OK 5 0.7 2.0 350 3.71
94.3
Write a short poem about the moon.
58 173 mlx-community/gemma-4-e4b-it-4bit @ minimal-prompt minimal-prompt OK 5 0.7 2.0 247 2.62
94.2
Name three primary colors and explain why they matter in des...
59 7 mlx-community/gemma-4-e4b-it-4bit @ top-p top-p
--top-p 0.9
OK 5 0.8 2.0 261 2.79
93.6
Name three primary colors and explain why they matter in des...
60 79 mlx-community/gemma-4-e4b-it-4bit @ stop-word stop-word OK 5 0.0 2.0 368 3.93
93.5
Name three primary colors and explain why they matter in des...
61 168 mlx-community/gemma-4-e4b-it-4bit @ tool-call-nullable-param tool-call-nullable-param OK 4 0.0 2.0 368 3.94
93.3
Name three primary colors and explain why they matter in des...
62 128 mlx-community/gemma-4-e4b-it-4bit @ stop-low-max-tokens stop-low-max-tokens OK 3 0.0 2.0 100 1.08
92.5
List 10 mountains, numbered 1 through 10, one per line.
63 85 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 5 0.0 2.0 368 4.08
90.3
Name three primary colors and explain why they matter in des...
64 110 mlx-community/gemma-4-e4b-it-4bit @ stop-special-chars stop-special-chars OK 5 0.0 2.0 288 3.21
89.6
List 3 facts about the moon. Use **bold** markdown for empha...
65 4 mlx-community/gemma-4-e4b-it-4bit @ default default OK 5 0.7 2.0 380 4.25
89.3
Explain why the sky is blue in exactly 3 bullet points.
66 124 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run1 stop-seed-run1 OK 2 0.7 2.0 163 1.85
88.3
List 10 flowers, numbered 1 through 10, one per line.
67 126 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run2 stop-seed-run2 OK 4 0.7 2.0 163 1.85
88.3
List 10 flowers, numbered 1 through 10, one per line.
68 98 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 2 0.0 2.0 718 8.17
87.9
Describe the color blue with its hex code.
69 127 mlx-community/gemma-4-e4b-it-4bit @ stop-low-max-tokens stop-low-max-tokens OK 3 0.0 2.0 100 1.14
87.4
Name three primary colors and explain why they matter in des...
70 35 mlx-community/gemma-4-e4b-it-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 3 0.0 2.0 368 4.22
87.2
Name three primary colors and explain why they matter in des...
71 43 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 5 0.0 2.0 485 5.68
85.3
Name three primary colors and explain why they matter in des...
72 163 mlx-community/gemma-4-e4b-it-4bit @ tool-call-complex tool-call-complex OK 2 0.0 2.0 78 0.92
84.7
tools: [{"type":"function","function":{"name":"search_files"...
73 37 mlx-community/gemma-4-e4b-it-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 2 0.0 2.0 368 4.37
84.1
Name three primary colors and explain why they matter in des...
74 154 mlx-community/gemma-4-e4b-it-4bit @ tool-call-auto tool-call-auto OK 2 0.0 2.0 64 0.76
83.9
tools: [{"type":"function","function":{"name":"get_weather",...
75 92 mlx-community/gemma-4-e4b-it-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 5 0.0 2.0 258 3.08
83.7
List 10 planets or celestial objects, numbered 1 through 10,...
76 157 mlx-community/gemma-4-e4b-it-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 2 0.0 2.0 64 0.77
83.5
tools: [{"type":"function","function":{"name":"get_weather",...
77 116 mlx-community/gemma-4-e4b-it-4bit @ stop-four-max stop-four-max OK 5 0.0 2.0 342 4.1
83.5
List 10 facts about numbers, alternating between digit forma...
78 28 mlx-community/gemma-4-e4b-it-4bit @ scientist scientist OK 5 0.3 2.0 1391 16.7
83.3
Tell me about quantum computing.
79 36 mlx-community/gemma-4-e4b-it-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 2 0.0 2.0 929 11.2
83.0
Generate a person record.
80 78 mlx-community/gemma-4-e4b-it-4bit @ stop-double-newline stop-double-newline OK 5 0.0 2.0 306 3.7
82.7
Write a short paragraph about the ocean. Then write a second...
81 33 mlx-community/gemma-4-e4b-it-4bit @ numbered-list numbered-list OK 5 0.0 2.0 368 4.47
82.3
Name three primary colors and explain why they matter in des...
82 103 mlx-community/gemma-4-e4b-it-4bit @ stop-multi-word stop-multi-word OK 5 0.0 2.0 368 4.48
82.2
Name three primary colors and explain why they matter in des...
83 31 mlx-community/gemma-4-e4b-it-4bit @ json-output json-output OK 3 0.0 2.0 368 4.5
81.8
Name three primary colors and explain why they matter in des...
84 82 mlx-community/gemma-4-e4b-it-4bit @ stop-period stop-period OK 5 0.0 2.0 328 4.03
81.4
Tell me about the sun in three sentences.
85 104 mlx-community/gemma-4-e4b-it-4bit @ stop-multi-word stop-multi-word OK 5 0.0 2.0 356 4.41
80.8
Write a 5-step recipe for making tea. Label each step as "St...
86 75 mlx-community/gemma-4-e4b-it-4bit @ stop-newline stop-newline OK 4 0.0 2.0 330 4.09
80.7
Name three primary colors and explain why they matter in des...
87 160 mlx-community/gemma-4-e4b-it-4bit @ tool-call-multi tool-call-multi OK 3 0.0 2.0 65 0.81
80.6
tools: [{"type":"function","function":{"name":"get_weather",...
88 77 mlx-community/gemma-4-e4b-it-4bit @ stop-double-newline stop-double-newline OK 5 0.0 2.0 330 4.12
80.2
Name three primary colors and explain why they matter in des...
89 169 mlx-community/gemma-4-e4b-it-4bit @ tool-call-nullable-param tool-call-nullable-param OK 2 0.0 2.0 65 0.81
79.8
tools: [{"type":"function","function":{"name":"get_weather",...
90 81 mlx-community/gemma-4-e4b-it-4bit @ stop-period stop-period OK 2 0.0 2.0 330 4.14
79.8
Name three primary colors and explain why they matter in des...
91 67 mlx-community/gemma-4-e4b-it-4bit @ no-streaming no-streaming
--no-streaming
OK 5 0.7 2.0 324 4.07
79.7
Name three primary colors and explain why they matter in des...
92 39 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 5 0.0 2.0 485 6.12
79.2
Name three primary colors and explain why they matter in des...
93 166 mlx-community/gemma-4-e4b-it-4bit @ tool-call-array-param tool-call-array-param OK 3 0.0 2.0 50 0.63
78.9
tools: [{"type":"function","function":{"name":"todowrite","d...
94 55 mlx-community/gemma-4-e4b-it-4bit @ logprobs logprobs
--max-logprobs 5
OK 3 0.0 2.0 368 4.67
78.8
Name three primary colors and explain why they matter in des...
95 38 mlx-community/gemma-4-e4b-it-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 2 0.0 2.0 984 12.54
78.5
Describe Tokyo as a structured record with at least 3 landma...
96 74 mlx-community/gemma-4-e4b-it-4bit @ stop-multi stop-multi OK 2 0.0 2.0 144 1.84
78.4
Write a Python hello world program in a code block, then wri...
97 80 mlx-community/gemma-4-e4b-it-4bit @ stop-word stop-word OK 5 0.0 2.0 530 6.78
78.2
Name 5 programming languages and briefly describe each one.
98 63 mlx-community/gemma-4-e4b-it-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 5 0.0 2.0 419 5.37
78.1
Name three primary colors and explain why they matter in des...
99 30 mlx-community/gemma-4-e4b-it-4bit @ eli5 eli5 OK 5 0.7 2.0 727 9.31
78.1
Tell me about quantum computing.
100 73 mlx-community/gemma-4-e4b-it-4bit @ stop-multi stop-multi OK 5 0.0 2.0 368 4.72
77.9
Name three primary colors and explain why they matter in des...
101 26 mlx-community/gemma-4-e4b-it-4bit @ pirate pirate OK 5 0.7 2.0 1277 16.43
77.7
Tell me about quantum computing.
102 101 mlx-community/gemma-4-e4b-it-4bit @ stop-long-phrase stop-long-phrase OK 5 0.0 2.0 368 4.75
77.5
Name three primary colors and explain why they matter in des...
103 29 mlx-community/gemma-4-e4b-it-4bit @ eli5 eli5 OK 5 0.7 2.0 455 5.9
77.2
Name three primary colors and explain why they matter in des...
104 27 mlx-community/gemma-4-e4b-it-4bit @ scientist scientist OK 5 0.3 2.0 550 7.14
77.1
Name three primary colors and explain why they matter in des...
105 83 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 5 0.0 2.0 368 4.79
76.8
Name three primary colors and explain why they matter in des...
106 97 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 2 0.0 2.0 368 4.79
76.8
Name three primary colors and explain why they matter in des...
107 93 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 3 0.0 2.0 368 4.8
76.7
Name three primary colors and explain why they matter in des...
108 87 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 4 0.0 2.0 368 4.8
76.7
Name three primary colors and explain why they matter in des...
109 70 mlx-community/gemma-4-e4b-it-4bit @ raw-mode raw-mode
--raw
OK 4 0.7 2.0 1091 14.29
76.4
Think step by step: what is 17 * 23?
110 96 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 2 0.0 2.0 572 7.49
76.3
Generate a person profile for someone named Alice who is 30 ...
111 91 mlx-community/gemma-4-e4b-it-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 5 0.0 2.0 368 4.83
76.2
Name three primary colors and explain why they matter in des...
112 89 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 5 0.0 2.0 368 4.83
76.1
Name three primary colors and explain why they matter in des...
113 54 mlx-community/gemma-4-e4b-it-4bit @ long-output long-output OK 4 0.7 2.0 1676 22.03
76.1
Write a detailed recipe for chocolate chip cookies with ingr...
114 62 mlx-community/gemma-4-e4b-it-4bit @ prefill-default prefill-default OK 5 0.0 2.0 1659 21.81
76.1
Given this architecture, what are the top 3 performance bott...
115 6 mlx-community/gemma-4-e4b-it-4bit @ high-temp high-temp OK 5 1.5 3.0 421 5.54
76.0
Explain why the sky is blue in exactly 3 bullet points.
116 53 mlx-community/gemma-4-e4b-it-4bit @ long-output long-output OK 4 0.7 2.0 364 4.79
76.0
Name three primary colors and explain why they matter in des...
117 58 mlx-community/gemma-4-e4b-it-4bit @ small-kv small-kv
--max-kv-size 2048
OK 5 0.7 2.0 580 7.64
76.0
Summarize the key ideas of machine learning in a few paragra...
118 66 mlx-community/gemma-4-e4b-it-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 5 0.0 2.0 1659 21.85
75.9
Given this architecture, what are the top 3 performance bott...
119 71 mlx-community/gemma-4-e4b-it-4bit @ stop-single stop-single OK 5 0.0 3.0 368 4.85
75.8
Name three primary colors and explain why they matter in des...
120 8 mlx-community/gemma-4-e4b-it-4bit @ top-p top-p
--top-p 0.9
OK 5 0.8 2.0 362 4.78
75.8
Explain why the sky is blue in exactly 3 bullet points.
121 64 mlx-community/gemma-4-e4b-it-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 5 0.0 2.0 1659 21.92
75.7
Given this architecture, what are the top 3 performance bott...
122 142 mlx-community/gemma-4-e4b-it-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 5 0.7 2.0 36 0.48
75.5
Write a 4-line poem about the ocean.
123 86 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 4 0.0 2.0 698 9.27
75.3
Write a bash script that prints the current date inside a co...
124 99 mlx-community/gemma-4-e4b-it-4bit @ stop-json-object-key stop-json-object-key OK 3 0.0 2.0 338 4.49
75.2
Name three primary colors and explain why they matter in des...
125 69 mlx-community/gemma-4-e4b-it-4bit @ raw-mode raw-mode
--raw
OK 4 0.7 2.0 238 3.18
74.7
Name three primary colors and explain why they matter in des...
126 140 mlx-community/gemma-4-e4b-it-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 5 0.7 2.0 36 0.48
74.5
Write a 4-line poem about the ocean.
127 45 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 5 0.0 2.0 485 6.51
74.5
Name three primary colors and explain why they matter in des...
128 61 mlx-community/gemma-4-e4b-it-4bit @ prefill-default prefill-default OK 4 0.0 2.0 419 5.63
74.4
Name three primary colors and explain why they matter in des...
129 57 mlx-community/gemma-4-e4b-it-4bit @ small-kv small-kv
--max-kv-size 2048
OK 5 0.7 2.0 179 2.42
73.9
Name three primary colors and explain why they matter in des...
130 65 mlx-community/gemma-4-e4b-it-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 5 0.0 2.0 419 5.68
73.8
Name three primary colors and explain why they matter in des...
131 47 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 5 0.0 2.0 485 6.58
73.7
Name three primary colors and explain why they matter in des...
132 56 mlx-community/gemma-4-e4b-it-4bit @ logprobs logprobs
--max-logprobs 5
OK 4 0.0 2.0 123 1.68
73.4
What is 1+1?
133 41 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 5 0.0 2.0 485 6.61
73.4
Name three primary colors and explain why they matter in des...
134 40 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 5 0.0 2.0 71 0.97
73.3
Read the file Sources/MacLocalAPI/main.swift and explain wha...
135 49 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 5 0.0 2.0 485 6.63
73.2
Name three primary colors and explain why they matter in des...
136 112 mlx-community/gemma-4-e4b-it-4bit @ stop-html-tag stop-html-tag OK 5 0.0 2.0 149 2.05
72.8
Write an HTML unordered list of 5 fruits using <ul> and <li>...
137 42 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 3 0.0 2.0 261 3.6
72.4
Now add a --timeout flag to the CLI that sets a request time...
138 44 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 3 0.0 2.0 385 5.38
71.5
Write a unit test for the timeout feature you just described...
139 94 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 3 0.0 2.0 237 3.37
70.2
List 5 major world cities as a JSON array. Include Tokyo.
140 17 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 5 0.7 3.0 340 4.88
69.7
Name three primary colors and explain why they matter in des...
141 52 mlx-community/gemma-4-e4b-it-4bit @ short-output short-output OK 3 0.7 2.0 50 0.75
67.0
Describe the entire history of Rome.
142 90 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 5 0.0 2.0 152 2.27
66.9
List 10 cities, numbered 1 through 10, one per line.
143 5 mlx-community/gemma-4-e4b-it-4bit @ high-temp high-temp OK 5 1.5 3.0 368 5.63
65.4
Name three primary colors and explain why they matter in des...
144 100 mlx-community/gemma-4-e4b-it-4bit @ stop-json-object-key stop-json-object-key OK 5 0.0 2.0 242 3.79
63.9
Generate a JSON object with keys "name", "age", and "city" f...
145 72 mlx-community/gemma-4-e4b-it-4bit @ stop-single stop-single OK 2 0.0 3.0 145 2.3
63.1
List 10 fruits, numbered 1-10, one per line.
146 84 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 5 0.0 2.0 193 3.12
61.8
List 10 types of cheese, numbered 1 through 10, one per line...
147 14 mlx-community/gemma-4-e4b-it-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 5 0.8 2.0 333 5.5
60.5
Explain why the sky is blue in exactly 3 bullet points.
148 51 mlx-community/gemma-4-e4b-it-4bit @ short-output short-output OK 2 0.7 2.0 50 0.83
60.4
Name three primary colors and explain why they matter in des...
149 20 mlx-community/gemma-4-e4b-it-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 4 0.8 2.0 2000 34.99
57.1
Write a long essay about the history of bread making across ...
150 15 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 5 0.7 2.0 340 5.98
56.8
Name three primary colors and explain why they matter in des...
151 16 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 5 0.7 2.0 560 9.91
56.5
Write a limerick about a cat.
152 12 mlx-community/gemma-4-e4b-it-4bit @ min-p min-p
--min-p 0.05
OK 5 0.8 2.0 434 7.7
56.4
Explain why the sky is blue in exactly 3 bullet points.
153 10 mlx-community/gemma-4-e4b-it-4bit @ top-k top-k
--top-k 30
OK 5 0.8 2.0 334 5.98
55.9
Explain why the sky is blue in exactly 3 bullet points.
154 25 mlx-community/gemma-4-e4b-it-4bit @ pirate pirate OK 5 0.7 2.0 444 7.96
55.8
Name three primary colors and explain why they matter in des...
155 18 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 5 0.7 3.0 560 10.07
55.6
Write a limerick about a cat.
156 9 mlx-community/gemma-4-e4b-it-4bit @ top-k top-k
--top-k 30
OK 5 0.8 2.0 341 6.35
53.7
Name three primary colors and explain why they matter in des...
157 11 mlx-community/gemma-4-e4b-it-4bit @ min-p min-p
--min-p 0.05
OK 5 0.8 2.0 189 3.57
52.9
Name three primary colors and explain why they matter in des...
158 1 mlx-community/gemma-4-e4b-it-4bit @ greedy greedy OK 5 0.0 5.0 368 7.34
50.1
Name three primary colors and explain why they matter in des...
159 2 mlx-community/gemma-4-e4b-it-4bit @ greedy greedy OK 5 0.0 5.0 375 7.49
50.0
Explain why the sky is blue in exactly 3 bullet points.
160 21 mlx-community/gemma-4-e4b-it-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 5 0.8 2.0 248 4.98
49.8
Name three primary colors and explain why they matter in des...
161 13 mlx-community/gemma-4-e4b-it-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 5 0.8 2.0 192 3.88
49.5
Name three primary colors and explain why they matter in des...
162 19 mlx-community/gemma-4-e4b-it-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 5 0.8 2.0 317 6.42
49.4
Name three primary colors and explain why they matter in des...
163 22 mlx-community/gemma-4-e4b-it-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 4 0.8 2.0 1898 38.48
49.3
Write a long essay about the history of bread making across ...
164 24 mlx-community/gemma-4-e4b-it-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 4 0.8 2.0 1772 36.75
48.2
Write a long essay about the history of bread making across ...
165 23 mlx-community/gemma-4-e4b-it-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 5 0.8 2.0 235 5.12
45.9
Name three primary colors and explain why they matter in des...
166 3 mlx-community/gemma-4-e4b-it-4bit @ default default OK 5 0.7 2.0 355 8.03
44.2
Name three primary colors and explain why they matter in des...
167 76 mlx-community/gemma-4-e4b-it-4bit @ stop-newline stop-newline OK 5 0.0 2.0 7 0.24
29.1
What is the capital of France? Answer in one sentence.
168 122 mlx-community/gemma-4-e4b-it-4bit @ stop-high-temp stop-high-temp OK 5 1.0 2.0 6 0.26
23.1
List 10 random words, numbered 1 through 10, one per line.
169 88 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 5 0.0 2.0 5 0.23
21.5
List 10 countries, numbered 1 through 10, one per line.

Failed Runs

TestModelErrorclaudeConfigLoad (s)
46 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn1 agent-cached-turn1 Connection error. 1 t=0.0 --enable-prefix-caching 2.0
48 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn2 agent-cached-turn2 Connection error. 1 t=0.0 --enable-prefix-caching 2.0
50 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn3 agent-cached-turn3 Connection error. 1 t=0.0 --enable-prefix-caching 2.0
59 mlx-community/gemma-4-e4b-it-4bit @ kv-quantized kv-quantized Connection error. 1 t=0.7 --kv-bits 4 2.0
60 mlx-community/gemma-4-e4b-it-4bit @ kv-quantized kv-quantized Connection error. 1 t=0.7 --kv-bits 4 2.0
175 mlx-community/gemma-4-e4b-it-4bit @ long-prompt long-prompt Server process died (check /tmp/mlx-server-84.log) 1 t=0.0 0
176 mlx-community/gemma-4-e4b-it-4bit @ special-chars special-chars Server process died (check /tmp/mlx-server-85.log) 1 t=0.0 0
177 mlx-community/gemma-4-e4b-it-4bit @ multilingual multilingual Server process died (check /tmp/mlx-server-86.log) 1 t=0.3 0
178 mlx-community/gemma-4-e4b-it-4bit @ code-python code-python Server process died (check /tmp/mlx-server-87.log) 1 t=0.0 0
179 mlx-community/gemma-4-e4b-it-4bit @ code-swift code-swift Server process died (check /tmp/mlx-server-88.log) 1 t=0.0 0
180 mlx-community/gemma-4-e4b-it-4bit @ math math Server process died (check /tmp/mlx-server-89.log) 1 t=0.0 0
181 mlx-community/gemma-4-e4b-it-4bit @ long-form long-form Server process died (check /tmp/mlx-server-90.log) 1 t=0.7 0
182 mlx-community/gemma-4-e4b-it-4bit @ strict-format strict-format Server process died (check /tmp/mlx-server-91.log) 1 t=0.0 0

AI Analysis (--smart)

Quality, Anomalies & Recommendations · avg score: 3.9/5

Full Responses

#102 mlx-community/gemma-4-e4b-it-4bit @ stop-long-phrase 471 tokens · 103.5 tok/s

#108 mlx-community/gemma-4-e4b-it-4bit @ stop-immediate 644 tokens · 102.7 tok/s

#107 mlx-community/gemma-4-e4b-it-4bit @ stop-immediate 336 tokens · 102.6 tok/s

#109 mlx-community/gemma-4-e4b-it-4bit @ stop-special-chars 320 tokens · 102.3 tok/s

#120 mlx-community/gemma-4-e4b-it-4bit @ stop-system-numbered 277 tokens · 102.2 tok/s

#95 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-comma 326 tokens · 101.8 tok/s

#114 mlx-community/gemma-4-e4b-it-4bit @ stop-unicode 402 tokens · 100.0 tok/s

#132 mlx-community/gemma-4-e4b-it-4bit @ response-format-schema 1201 tokens · 99.9 tok/s

#118 mlx-community/gemma-4-e4b-it-4bit @ stop-system-pirate 999 tokens · 99.9 tok/s

#164 mlx-community/gemma-4-e4b-it-4bit @ tool-call-complex 1007 tokens · 99.8 tok/s

#148 mlx-community/gemma-4-e4b-it-4bit @ developer-role 1082 tokens · 99.8 tok/s

#161 mlx-community/gemma-4-e4b-it-4bit @ tool-call-multi 440 tokens · 99.7 tok/s

#136 mlx-community/gemma-4-e4b-it-4bit @ think-normal 562 tokens · 99.7 tok/s

#144 mlx-community/gemma-4-e4b-it-4bit @ max-completion-tokens 289 tokens · 99.6 tok/s

#138 mlx-community/gemma-4-e4b-it-4bit @ think-raw 562 tokens · 99.5 tok/s

#145 mlx-community/gemma-4-e4b-it-4bit @ max-completion-tokens 1755 tokens · 99.5 tok/s

#130 mlx-community/gemma-4-e4b-it-4bit @ response-format-json 317 tokens · 99.5 tok/s

#134 mlx-community/gemma-4-e4b-it-4bit @ response-format-text 317 tokens · 99.2 tok/s

#172 mlx-community/gemma-4-e4b-it-4bit @ tool-call-none 268 tokens · 99.0 tok/s

#155 mlx-community/gemma-4-e4b-it-4bit @ tool-call-auto 286 tokens · 98.9 tok/s

#106 mlx-community/gemma-4-e4b-it-4bit @ stop-no-match 256 tokens · 98.9 tok/s

#158 mlx-community/gemma-4-e4b-it-4bit @ tool-call-xml 281 tokens · 98.9 tok/s

#117 mlx-community/gemma-4-e4b-it-4bit @ stop-system-pirate 406 tokens · 98.2 tok/s

#32 mlx-community/gemma-4-e4b-it-4bit @ json-output 246 tokens · 98.2 tok/s

#170 mlx-community/gemma-4-e4b-it-4bit @ tool-call-nullable-param 286 tokens · 98.1 tok/s

#113 mlx-community/gemma-4-e4b-it-4bit @ stop-unicode 368 tokens · 98.0 tok/s

#115 mlx-community/gemma-4-e4b-it-4bit @ stop-four-max 368 tokens · 97.9 tok/s

#133 mlx-community/gemma-4-e4b-it-4bit @ response-format-text 368 tokens · 97.9 tok/s

#146 mlx-community/gemma-4-e4b-it-4bit @ developer-role 368 tokens · 97.9 tok/s

#129 mlx-community/gemma-4-e4b-it-4bit @ response-format-json 368 tokens · 97.8 tok/s

#131 mlx-community/gemma-4-e4b-it-4bit @ response-format-schema 368 tokens · 97.8 tok/s

#162 mlx-community/gemma-4-e4b-it-4bit @ tool-call-complex 368 tokens · 97.8 tok/s

#165 mlx-community/gemma-4-e4b-it-4bit @ tool-call-array-param 368 tokens · 97.8 tok/s

#159 mlx-community/gemma-4-e4b-it-4bit @ tool-call-multi 368 tokens · 97.7 tok/s

#156 mlx-community/gemma-4-e4b-it-4bit @ tool-call-xml 368 tokens · 97.7 tok/s

#143 mlx-community/gemma-4-e4b-it-4bit @ max-completion-tokens 368 tokens · 97.7 tok/s

#152 mlx-community/gemma-4-e4b-it-4bit @ very-verbose 247 tokens · 97.7 tok/s

#137 mlx-community/gemma-4-e4b-it-4bit @ think-raw 368 tokens · 97.7 tok/s

#135 mlx-community/gemma-4-e4b-it-4bit @ think-normal 368 tokens · 97.6 tok/s

#171 mlx-community/gemma-4-e4b-it-4bit @ tool-call-none 368 tokens · 97.6 tok/s

#153 mlx-community/gemma-4-e4b-it-4bit @ tool-call-auto 368 tokens · 97.5 tok/s

#111 mlx-community/gemma-4-e4b-it-4bit @ stop-html-tag 368 tokens · 97.5 tok/s

#167 mlx-community/gemma-4-e4b-it-4bit @ tool-call-array-param 179 tokens · 97.3 tok/s

#150 mlx-community/gemma-4-e4b-it-4bit @ verbose 232 tokens · 97.1 tok/s

#147 mlx-community/gemma-4-e4b-it-4bit @ developer-role 192 tokens · 97.0 tok/s

#125 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run2 340 tokens · 96.8 tok/s

#151 mlx-community/gemma-4-e4b-it-4bit @ very-verbose 347 tokens · 96.8 tok/s

#105 mlx-community/gemma-4-e4b-it-4bit @ stop-no-match 256 tokens · 96.7 tok/s

#174 mlx-community/gemma-4-e4b-it-4bit @ minimal-prompt 199 tokens · 96.7 tok/s

#141 mlx-community/gemma-4-e4b-it-4bit @ non-streaming-seeded 322 tokens · 96.6 tok/s

#139 mlx-community/gemma-4-e4b-it-4bit @ streaming-seeded 322 tokens · 96.4 tok/s

#123 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run1 340 tokens · 96.1 tok/s

#34 mlx-community/gemma-4-e4b-it-4bit @ numbered-list 174 tokens · 96.0 tok/s

#119 mlx-community/gemma-4-e4b-it-4bit @ stop-system-numbered 259 tokens · 96.0 tok/s

#149 mlx-community/gemma-4-e4b-it-4bit @ verbose 269 tokens · 95.8 tok/s

#121 mlx-community/gemma-4-e4b-it-4bit @ stop-high-temp 215 tokens · 94.8 tok/s

#68 mlx-community/gemma-4-e4b-it-4bit @ no-streaming 350 tokens · 94.3 tok/s

#173 mlx-community/gemma-4-e4b-it-4bit @ minimal-prompt 247 tokens · 94.2 tok/s

#7 mlx-community/gemma-4-e4b-it-4bit @ top-p 261 tokens · 93.6 tok/s

#79 mlx-community/gemma-4-e4b-it-4bit @ stop-word 368 tokens · 93.5 tok/s

#168 mlx-community/gemma-4-e4b-it-4bit @ tool-call-nullable-param 368 tokens · 93.3 tok/s

#128 mlx-community/gemma-4-e4b-it-4bit @ stop-low-max-tokens 100 tokens · 92.5 tok/s

#85 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-multi 368 tokens · 90.3 tok/s

#110 mlx-community/gemma-4-e4b-it-4bit @ stop-special-chars 288 tokens · 89.6 tok/s

#4 mlx-community/gemma-4-e4b-it-4bit @ default 380 tokens · 89.3 tok/s

#124 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run1 163 tokens · 88.3 tok/s

#126 mlx-community/gemma-4-e4b-it-4bit @ stop-seed-run2 163 tokens · 88.3 tok/s

#98 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-brace 718 tokens · 87.9 tok/s

#127 mlx-community/gemma-4-e4b-it-4bit @ stop-low-max-tokens 100 tokens · 87.4 tok/s

#35 mlx-community/gemma-4-e4b-it-4bit @ guided-json-simple 368 tokens · 87.2 tok/s

#43 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn3 485 tokens · 85.3 tok/s

#163 mlx-community/gemma-4-e4b-it-4bit @ tool-call-complex 78 tokens · 84.7 tok/s

#37 mlx-community/gemma-4-e4b-it-4bit @ guided-json-nested 368 tokens · 84.1 tok/s

#154 mlx-community/gemma-4-e4b-it-4bit @ tool-call-auto 64 tokens · 83.9 tok/s

#92 mlx-community/gemma-4-e4b-it-4bit @ stop-non-streaming 258 tokens · 83.7 tok/s

#157 mlx-community/gemma-4-e4b-it-4bit @ tool-call-xml 64 tokens · 83.5 tok/s

#116 mlx-community/gemma-4-e4b-it-4bit @ stop-four-max 342 tokens · 83.5 tok/s

#28 mlx-community/gemma-4-e4b-it-4bit @ scientist 1391 tokens · 83.3 tok/s

#36 mlx-community/gemma-4-e4b-it-4bit @ guided-json-simple 929 tokens · 83.0 tok/s

#78 mlx-community/gemma-4-e4b-it-4bit @ stop-double-newline 306 tokens · 82.7 tok/s

#33 mlx-community/gemma-4-e4b-it-4bit @ numbered-list 368 tokens · 82.3 tok/s

#103 mlx-community/gemma-4-e4b-it-4bit @ stop-multi-word 368 tokens · 82.2 tok/s

#31 mlx-community/gemma-4-e4b-it-4bit @ json-output 368 tokens · 81.8 tok/s

#82 mlx-community/gemma-4-e4b-it-4bit @ stop-period 328 tokens · 81.4 tok/s

#104 mlx-community/gemma-4-e4b-it-4bit @ stop-multi-word 356 tokens · 80.8 tok/s

#75 mlx-community/gemma-4-e4b-it-4bit @ stop-newline 330 tokens · 80.7 tok/s

#160 mlx-community/gemma-4-e4b-it-4bit @ tool-call-multi 65 tokens · 80.6 tok/s

#77 mlx-community/gemma-4-e4b-it-4bit @ stop-double-newline 330 tokens · 80.2 tok/s

#169 mlx-community/gemma-4-e4b-it-4bit @ tool-call-nullable-param 65 tokens · 79.8 tok/s

#81 mlx-community/gemma-4-e4b-it-4bit @ stop-period 330 tokens · 79.8 tok/s

#67 mlx-community/gemma-4-e4b-it-4bit @ no-streaming 324 tokens · 79.7 tok/s

#39 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn1 485 tokens · 79.2 tok/s

#166 mlx-community/gemma-4-e4b-it-4bit @ tool-call-array-param 50 tokens · 78.9 tok/s

#55 mlx-community/gemma-4-e4b-it-4bit @ logprobs 368 tokens · 78.8 tok/s

#38 mlx-community/gemma-4-e4b-it-4bit @ guided-json-nested 984 tokens · 78.5 tok/s

#74 mlx-community/gemma-4-e4b-it-4bit @ stop-multi 144 tokens · 78.4 tok/s

#80 mlx-community/gemma-4-e4b-it-4bit @ stop-word 530 tokens · 78.2 tok/s

#63 mlx-community/gemma-4-e4b-it-4bit @ prefill-large-4096 419 tokens · 78.1 tok/s

#30 mlx-community/gemma-4-e4b-it-4bit @ eli5 727 tokens · 78.1 tok/s

#73 mlx-community/gemma-4-e4b-it-4bit @ stop-multi 368 tokens · 77.9 tok/s

#26 mlx-community/gemma-4-e4b-it-4bit @ pirate 1277 tokens · 77.7 tok/s

#101 mlx-community/gemma-4-e4b-it-4bit @ stop-long-phrase 368 tokens · 77.5 tok/s

#29 mlx-community/gemma-4-e4b-it-4bit @ eli5 455 tokens · 77.2 tok/s

#27 mlx-community/gemma-4-e4b-it-4bit @ scientist 550 tokens · 77.1 tok/s

#83 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-only 368 tokens · 76.8 tok/s

#97 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-brace 368 tokens · 76.8 tok/s

#93 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-value 368 tokens · 76.7 tok/s

#87 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-merge 368 tokens · 76.7 tok/s

#70 mlx-community/gemma-4-e4b-it-4bit @ raw-mode 1091 tokens · 76.4 tok/s

#96 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-comma 572 tokens · 76.3 tok/s

#91 mlx-community/gemma-4-e4b-it-4bit @ stop-non-streaming 368 tokens · 76.2 tok/s

#89 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-dedup 368 tokens · 76.1 tok/s

#54 mlx-community/gemma-4-e4b-it-4bit @ long-output 1676 tokens · 76.1 tok/s

#62 mlx-community/gemma-4-e4b-it-4bit @ prefill-default 1659 tokens · 76.1 tok/s

#6 mlx-community/gemma-4-e4b-it-4bit @ high-temp 421 tokens · 76.0 tok/s

#53 mlx-community/gemma-4-e4b-it-4bit @ long-output 364 tokens · 76.0 tok/s

#58 mlx-community/gemma-4-e4b-it-4bit @ small-kv 580 tokens · 76.0 tok/s

#66 mlx-community/gemma-4-e4b-it-4bit @ prefill-small-256 1659 tokens · 75.9 tok/s

#71 mlx-community/gemma-4-e4b-it-4bit @ stop-single 368 tokens · 75.8 tok/s

#8 mlx-community/gemma-4-e4b-it-4bit @ top-p 362 tokens · 75.8 tok/s

#64 mlx-community/gemma-4-e4b-it-4bit @ prefill-large-4096 1659 tokens · 75.7 tok/s

#142 mlx-community/gemma-4-e4b-it-4bit @ non-streaming-seeded 36 tokens · 75.5 tok/s

#86 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-multi 698 tokens · 75.3 tok/s

#99 mlx-community/gemma-4-e4b-it-4bit @ stop-json-object-key 338 tokens · 75.2 tok/s

#69 mlx-community/gemma-4-e4b-it-4bit @ raw-mode 238 tokens · 74.7 tok/s

#140 mlx-community/gemma-4-e4b-it-4bit @ streaming-seeded 36 tokens · 74.5 tok/s

#45 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn1 485 tokens · 74.5 tok/s

#61 mlx-community/gemma-4-e4b-it-4bit @ prefill-default 419 tokens · 74.4 tok/s

#57 mlx-community/gemma-4-e4b-it-4bit @ small-kv 179 tokens · 73.9 tok/s

#65 mlx-community/gemma-4-e4b-it-4bit @ prefill-small-256 419 tokens · 73.8 tok/s

#47 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn2 485 tokens · 73.7 tok/s

#56 mlx-community/gemma-4-e4b-it-4bit @ logprobs 123 tokens · 73.4 tok/s

#41 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn2 485 tokens · 73.4 tok/s

#40 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn1 71 tokens · 73.3 tok/s

#49 mlx-community/gemma-4-e4b-it-4bit @ agent-cached-turn3 485 tokens · 73.2 tok/s

#112 mlx-community/gemma-4-e4b-it-4bit @ stop-html-tag 149 tokens · 72.8 tok/s

#42 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn2 261 tokens · 72.4 tok/s

#44 mlx-community/gemma-4-e4b-it-4bit @ agent-no-cache-turn3 385 tokens · 71.5 tok/s

#94 mlx-community/gemma-4-e4b-it-4bit @ stop-guided-json-value 237 tokens · 70.2 tok/s

#17 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run2 340 tokens · 69.7 tok/s

#52 mlx-community/gemma-4-e4b-it-4bit @ short-output 50 tokens · 67.0 tok/s

#90 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-dedup 152 tokens · 66.9 tok/s

#5 mlx-community/gemma-4-e4b-it-4bit @ high-temp 368 tokens · 65.4 tok/s

#100 mlx-community/gemma-4-e4b-it-4bit @ stop-json-object-key 242 tokens · 63.9 tok/s

#72 mlx-community/gemma-4-e4b-it-4bit @ stop-single 145 tokens · 63.1 tok/s

#84 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-only 193 tokens · 61.8 tok/s

#14 mlx-community/gemma-4-e4b-it-4bit @ combined-samplers 333 tokens · 60.5 tok/s

#51 mlx-community/gemma-4-e4b-it-4bit @ short-output 50 tokens · 60.4 tok/s

#20 mlx-community/gemma-4-e4b-it-4bit @ no-penalty 2000 tokens · 57.1 tok/s

#15 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run1 340 tokens · 56.8 tok/s

#16 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run1 560 tokens · 56.5 tok/s

#12 mlx-community/gemma-4-e4b-it-4bit @ min-p 434 tokens · 56.4 tok/s

#10 mlx-community/gemma-4-e4b-it-4bit @ top-k 334 tokens · 55.9 tok/s

#25 mlx-community/gemma-4-e4b-it-4bit @ pirate 444 tokens · 55.8 tok/s

#18 mlx-community/gemma-4-e4b-it-4bit @ seed-42-run2 560 tokens · 55.6 tok/s

#9 mlx-community/gemma-4-e4b-it-4bit @ top-k 341 tokens · 53.7 tok/s

#11 mlx-community/gemma-4-e4b-it-4bit @ min-p 189 tokens · 52.9 tok/s

#1 mlx-community/gemma-4-e4b-it-4bit @ greedy 368 tokens · 50.1 tok/s

#2 mlx-community/gemma-4-e4b-it-4bit @ greedy 375 tokens · 50.0 tok/s

#21 mlx-community/gemma-4-e4b-it-4bit @ with-penalty 248 tokens · 49.8 tok/s

#13 mlx-community/gemma-4-e4b-it-4bit @ combined-samplers 192 tokens · 49.5 tok/s

#19 mlx-community/gemma-4-e4b-it-4bit @ no-penalty 317 tokens · 49.4 tok/s

#22 mlx-community/gemma-4-e4b-it-4bit @ with-penalty 1898 tokens · 49.3 tok/s

#24 mlx-community/gemma-4-e4b-it-4bit @ repetition-penalty 1772 tokens · 48.2 tok/s

#23 mlx-community/gemma-4-e4b-it-4bit @ repetition-penalty 235 tokens · 45.9 tok/s

#3 mlx-community/gemma-4-e4b-it-4bit @ default 355 tokens · 44.2 tok/s

#76 mlx-community/gemma-4-e4b-it-4bit @ stop-newline 7 tokens · 29.1 tok/s

#122 mlx-community/gemma-4-e4b-it-4bit @ stop-high-temp 6 tokens · 23.1 tok/s

#88 mlx-community/gemma-4-e4b-it-4bit @ stop-cli-api-merge 5 tokens · 21.5 tok/s