| # | Test | Group | Coverage | Status | Duration | Details |
|---|---|---|---|---|---|---|
| 1 | markBatchInProgress transitions status and stores slot IDs | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 2 | getFileData returns raw data | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 3 | getFile returns stored file metadata | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 4 | getFileData returns nil for nonexistent file | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 5 | deleteFile returns false for nonexistent file | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 6 | getFile returns nil for nonexistent file | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 7 | createBatch returns ID with correct prefix and initial state | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 8 | markBatchFailed sets status and error | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 9 | listBatches returns all batches | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 10 | storeFile creates file with correct metadata | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 11 | markBatchCancelling and markBatchCancelled transitions | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 12 | Multiple files have unique IDs | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 13 | recordResult increments failed count for error results | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 14 | deleteFile removes the file | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 15 | insert: new edge (no matching child) | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 16 | insert: multiple inserts grow the tree (multi-turn) | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 17 | insert: exact match update — node already has cache | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 18 | invalidateAll clears everything | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 19 | insert: exact match — node had no prior cache | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 20 | findPrefix: traverses nodes but no cached node found | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 21 | Touch via findPrefix prevents eviction | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 22 | findPrefix: no child for next token — miss at root | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 23 | compactUpward merges single-child node after sibling eviction | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 24 | Count tracks insertions, evictions, and invalidation | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 25 | findPrefix: deepest cached node wins over shallower | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 26 | invalidateAll with debugLogging | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 27 | getBatch returns nil for nonexistent batch | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 28 | LRU eviction at capacity evicts oldest | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 29 | findPrefix: empty cache — miss | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 30 | findPrefix: exact match returns full prefix | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 31 | findPrefix with debugLogging exercises all log branches | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 32 | Conversation fork: both branches survive and are findable | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 33 | insert: partial edge split with remaining tokens | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 34 | findPrefix: miss with matched == 0 and debugLogging | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 35 | findPrefix: partial edge match divergence mid-edge — returns cached state | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 36 | KVCacheEntry stores tokens and layerStates | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 37 | findPrefix: query longer than cached — partial prefix hit | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 38 | RadixNode isLeaf and hasCachedState | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 39 | getSlotIds returns empty for nonexistent batch | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 40 | findPrefix: query shorter than cached edge | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 41 | insert with debugLogging exercises log branches | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 42 | Eviction with debugLogging | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 43 | insert: empty tokens is no-op | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 44 | insert: partial edge split at exact split point | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 45 | Multiple evictions on single insert (maxEntries=1) | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 46 | BatchResultLine with error encodes correctly | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 47 | truncateToOffset on empty cache is no-op | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 48 | FileDeleteResponse defaults | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 49 | toJinjaCompatible() strips null elements from arrays | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 50 | toJinjaCompatible() strips null keys from dicts — Jinja accepts it | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 51 | RequestSlot IDs are unique across instances | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 52 | BaseKVCache truncateToOffset is safe no-op on MambaCache | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 53 | findPrefix: miss with matched > 0 and debugLogging | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 54 | MLXServiceError.serviceShuttingDown has descriptive message | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 55 | toJinjaCompatible() result survives ToolSpec → Jinja Value round-trip | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 56 | BatchListResponse encodes with has_more field | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 57 | StreamChunk carries cached token count | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 58 | EBNF grammar param_value uses permissive pv_char rule | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 59 | decodeJSONEscapes passes through plain text without escapes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 60 | toJinjaCompatible() preserves all non-null types | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 61 | toAny() wraps null as NSNull — Jinja throws on it | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 62 | toAny() dict with null value — Jinja throws | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 63 | KVCacheEntry touch updates access time | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 64 | BatchScheduler default max concurrent is 8 | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 65 | BatchInputLine handles optional body fields | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 66 | BatchInputLine handles messages with special characters | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 67 | RotatingKVCache is NOT batch-eligible | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 68 | coerceStringValue returns nil for unknown schema type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 69 | BatchCreateRequest decodes with snake_case keys | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 70 | BatchInputLine decodes from JSONL line | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 71 | BatchInputLine handles system + user messages | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 72 | JSONL with blank lines are skipped | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 73 | BatchCompletionRequest decodes array of requests | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 74 | MLXServiceError.noModelLoaded has descriptive message | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 75 | runtime parses adaptive xml JSON fallback | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 76 | completed tool call parsing resolves adaptive XML tool names against offered tools | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 77 | BatchScheduler emits only completed tool calls from slot runtime events | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 78 | handles duplicate parameters (keeps first non-empty) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 79 | parses basic XML tool call | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 80 | text content before and after tool call is preserved | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 81 | runtime emits placeholder then final replacement for XML tool call | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 82 | BatchObject encodes with all fields | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 83 | runtime salvages incomplete tool call at stream end | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 84 | Multiple JSONL lines parse independently | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 85 | toAny() result in ToolSpec — Jinja throws (proves the bug) | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 86 | collects logprobs from stream chunks | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 87 | coerces whole-number string to Int for 'number' type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 88 | coerceStringValue returns nil for non-numeric string with integer type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 89 | BatchScheduler stop helper emits stopped chunk on exact stop match | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 90 | FileObject encodes with snake_case keys | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 91 | BatchScheduler stop helper buffers partial stop across chunk boundaries | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 92 | finishReason is stop when stopped by sequence | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 93 | buildChoiceLogprobs converts ResolvedLogprob to ChoiceLogprobs | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 94 | toJinjaCompatible() deeply nested nulls — Jinja accepts them | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 95 | StreamChunk defaults: only text, everything else nil | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 96 | BatchScheduler stop helper does not stop while still inside think block | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 97 | KVCacheSimple and ArraysCache are batch-eligible | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 98 | decodeJSONEscapes preserves real backslashes (\\n stays as \n literal) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 99 | preserves JSON array parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 100 | MambaCache without leftPadding returns nil mask | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 101 | finishReason is tool_calls when tool calls present | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 102 | collects timing and token stats from final chunk | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 103 | regex fallback handles bare < in parameter value | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 104 | runtime preserves nulls in adaptive xml JSON fallback | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 105 | BatchScheduler helper extraction keeps tool call streams isolated per event list | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 106 | BatchScheduler emits delta chunks before completed tool call chunks | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 107 | coerces string to integer | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 108 | multi-chunk think tags extracted correctly | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 109 | think extraction with tool calls returns nil content and reasoning | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 110 | RequestSlot initializes with unique ID and zero content | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 111 | finishReason is stop by default | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 112 | RequestSlot appendContent accumulates text | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 113 | StreamChunk carries timing info | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 114 | preserves content outside tool calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 115 | extracts think tags into reasoningContent | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 116 | handles mixed XML and JSON in separate <tool_call> blocks | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 117 | BatchScheduler emits incremental tool call deltas from slot runtime events | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 118 | buildChoiceLogprobs returns nil for empty input | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 119 | empty stream produces nil content | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 120 | coerceStringValue handles negative numbers | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 121 | stream with only think tags and no visible content | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 122 | bare JSON that's not a tool call doesn't match | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 123 | finishReason is length when max tokens reached | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 124 | coerces string to negative integer | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 125 | no think extraction when disabled | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 126 | normalizeToolCalls assigns sequential indices from startIndex | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 127 | EBNF grammar generates named required param rules for bash tool | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 128 | decodeXMLEntities handles multiple < in Python code | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 129 | returns unchanged when tool name not found in tools list | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 130 | coerces string to boolean true and false | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 131 | parses Mistral [TOOL_CALLS] JSON array format | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 132 | decodeJSONEscapes full edit oldString from real Qwen3-Coder output | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 133 | JSON format switch mid-conversation (Qwen3-Coder-Next common error) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 134 | decodeXMLEntities handles entities at string boundaries | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 135 | mixed: write content has real newlines, edit oldString has escaped — both decoded correctly | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 136 | coerces string to array | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 137 | returns unchanged when arguments JSON is invalid | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 138 | returns unchanged when tools is nil | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 139 | decodeXMLEntities decodes all 5 standard entities | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 140 | decodeXMLEntities passes through bare & without entity suffix | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 141 | preserves JSON object parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 142 | handles parameter values with special characters in Python code | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 143 | mixed coercion: some params coerced, some left alone | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 144 | bash tool with special characters | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 145 | decodeXMLEntities handles double-encoded entities: &lt; → < | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 146 | regex fallback salvages unclosed parameter (max_tokens truncation) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 147 | coerces string to object | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 148 | requiredParamNames returns empty for tool with no required array | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 149 | decodeXMLEntities handles empty string | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 150 | JSON-in-XML with missing name returns no tool calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 151 | returns nil for content without <function=...> tag | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 152 | decodes XML entities in parameter values via XMLParser | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 153 | JSON-in-XML with no arguments key still parses name | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 154 | bash tool with JSON-escaped command gets decoded | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 155 | bare JSON with 'parameters' key instead of 'arguments' | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 156 | requiredParamNames preserves client schema order (not alphabetical) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 157 | coerceStringValue handles empty string for all types | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 158 | parses JSON-in-XML format with 'arguments' key | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 159 | does not fill non-required missing params | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 160 | leaves already-correct types alone (string stays string) | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 161 | decodeJSONEscapes preserves values that already have real newlines | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 162 | returns empty array and original text when no tool calls found | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 163 | parses Mistral [TOOL_CALLS] func_name[ARGS]{...} format | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 164 | parses bare JSON tool call without wrapper tags | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 165 | coerceStringValue returns nil for non-numeric string with number type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 166 | EBNF grammar generates named required param rules for edit tool | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 167 | skips empty parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 168 | returns unchanged when tools is empty | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 169 | decodeJSONEscapes handles empty string | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 170 | coerceStringValue returns nil for invalid JSON with array type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 171 | EBNF grammar allows extra optional params after required ones | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 172 | parses Mistral [TOOL_CALLS] with multiple items in array | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 173 | coerceStringValue returns nil for float string with integer type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 174 | decodeJSONEscapes handles only \" without \n | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 175 | completed tool call parsing preserves remaining non-tool text | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 176 | EBNF grammar handles tool with no required params | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 177 | parses JSON-in-XML format with 'parameters' key | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 178 | handles multiline parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 179 | coerceStringValue coerces '0.0' to Int 0 for number type (whole number) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 180 | JSON-in-XML with invalid JSON falls through | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 181 | does NOT coerce 'yes'/'no'/'1'/'0' to boolean | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 182 | decodeJSONEscapes unescapes literal \n and \" when no real newlines present | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 183 | decodeJSONEscapes handles \t escapes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 184 | fills missing required boolean param with false | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 185 | coerces boolean case-insensitively (TRUE, True, FALSE) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 186 | does NOT fill missing required string param (let client report missing) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 187 | XMLParser path drops unclosed parameter (no bare < to trigger fallback) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 188 | coerceStringValue coerces '0' to Int 0 for integer type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 189 | empty <tool_call></tool_call> block returns no calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 190 | strips <think></think> tags from remaining text | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 191 | question tool: array of objects with typed fields (OpenCode pattern) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 192 | decodeXMLEntities handles consecutive entities | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 193 | multiple parameters with same non-empty value keeps first | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 194 | coerceStringValue returns nil for invalid JSON with object type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 195 | normalizeToolCall remaps keys before coercing values | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 196 | write file with Python containing comparison operators (OpenCode pattern) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 197 | write tool with real newlines is NOT affected by decodeJSONEscapes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 198 | coerces string to number (float) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 199 | decodeXMLEntities passes through strings without entities | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 200 | fills missing required integer param with 0 | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 201 | handles multiple parameters with mixed string and JSON types | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 202 | does not coerce when property not in schema | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 203 | edit tool with JSON-escaped oldString gets decoded (model pre-escaping bug) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 204 | does not coerce non-string values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 205 | handles multiple tool calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 206 | RequestSlot is thread-safe under concurrent writes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 207 | BatchStore handles concurrent batch creates safely | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 208 | Cancel batch transitions to cancelled | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 209 | Cancel batch on non-in_progress returns 400 | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 210 | Cancel nonexistent batch returns 404 | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 211 | Accepts valid method and url | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 212 | BatchCompletionsController sets grammar downgrade header when strict tools present | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 213 | Rejects line with wrong url | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 214 | Rejects line with wrong method | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 215 | BatchStore handles concurrent file operations safely | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 216 | RequestSlot elapsedTime increases over time | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 217 | recordResult increments completed count | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 218 | recordResult drops results for cancelling batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 219 | recordResult drops results for cancelled batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 220 | Batched prefill cache creation matches expected pattern for mixed layers | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 221 | MambaCache mask returns nil after state is set (non-prefill) | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 222 | createSSMMask delegates to MambaCache.makeMask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 223 | recordResult still works for in_progress batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 224 | createAttentionMask delegates to BatchKVCacheSimple.makeMask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 225 | Batch auto-completes when all requests are done | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 226 | Output JSONL file contains all results | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 227 | BatchKVCacheSimple update stores KV for all sequences | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 228 | truncateToOffset is no-op when offset matches array size | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 229 | BatchResultLine round-trips through JSON | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 230 | state getter returns raw refs after truncateToOffset (fast path) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 231 | truncateToOffset physically shrinks arrays to offset | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 232 | truncateToOffset after multiple trim cycles | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 233 | MambaCache leftPadding creates correct SSM mask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 234 | BatchKVCacheSimple mask with uniform padding (same-length sequences) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 235 | BatchKVCacheSimple mask with asymmetric padding (different-length sequences) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 236 | Extracted cache can be loaded into KVCacheSimple for radix save | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 237 | BatchKVCacheSimple decode mask with padding (n=1) | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 238 | MambaCache batched state can be sliced per-sequence | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 239 | Left-padding stacks variable-length token arrays correctly | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 240 | Full extraction round-trip: batch → individual → KVCacheSimple | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 241 | BatchKVCacheSimple extend merges prefill batch with existing decode batch | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 242 | BatchKVCacheSimple extract returns correct per-sequence KV | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 243 | BatchAPIController response includes tool_calls with correct finish_reason | UnitTest | unit smoke standard full | PASS | 0.6s | pass |
| 244 | BatchAPIController response includes logprobs when provided in stream | UnitTest | unit smoke standard full | PASS | 0.6s | pass |
| 245 | BatchAPIController response includes reasoningContent when model supports thinking | UnitTest | unit smoke standard full | PASS | 0.6s | pass |
| 246 | Binary exists at .build/release/afm | Preflight | unit smoke standard full | PASS | 0.0s | file exists |
| 247 | Server reachable at http://127.0.0.1:9998 | Preflight | unit smoke standard full | PASS | 0.0s | 200 OK |
| 248 | /v1/models contains model ID | Lifecycle | unit smoke standard full | PASS | 0.0s | model in response |
| 249 | Basic completion returns content | Lifecycle | unit smoke standard full | PASS | 4.9s | non-empty content or reasoning |
| 250 | Stop string '5' absent from output | Stop | unit smoke standard full | PASS | 1.8s | no '5' in content |
| 251 | finish_reason is 'stop' with stop sequence | Stop | unit smoke standard full | PASS | 0.0s | stop |
| 252 | Multi-word stop 'and' truncates correctly | Stop | unit smoke standard full | PASS | 1.8s | no 'and' in output |
| 253 | Stop on newline produces single line | Stop | unit smoke standard full | PASS | 1.4s | single line |
| 254 | Multiple stop sequences [7, 12] | Stop | unit smoke standard full | PASS | 1.7s | neither found |
| 255 | Empty stop array is no-op | Stop | unit smoke standard full | PASS | 2.2s | valid output |
| 256 | Streaming: stop string '5' absent | Stop | unit smoke standard full | PASS | 1.7s | no '5' in stream |
| 257 | Stop sequence '3.' truncates list | Stop | standard full | PASS | 0.9s | no '3.' in output |
| 258 | Stop 'stopped' doesn't fire on 'stopping' | Stop | standard full | PASS | 2.0s | output produced |
| 259 | Stop 'llo' fires mid-word in 'hello' | Stop | standard full | PASS | 1.8s | no 'llo' |
| 260 | ChoiceLogprobs JSON schema valid | Logprobs | smoke standard full | PASS | 0.1s | valid schema |
| 261 | top_logprobs count <= requested (5) | Logprobs | smoke standard full | PASS | 0.1s | count valid |
| 262 | logprobs=false returns null | Logprobs | smoke standard full | PASS | 0.1s | null logprobs |
| 263 | top_logprobs=99 returns 400 | Logprobs | smoke standard full | PASS | 0.0s | 400 |
| 264 | Streaming logprobs present and valid | Logprobs | standard full | PASS | 0.1s | valid |
| 265 | top_logprobs=0 returns empty arrays | Logprobs | standard full | PASS | 0.1s | empty top_logprobs |
| 266 | reasoning_content present in response | Think | smoke standard full | PASS | 0.0s | present |
| 267 | No <think> tags in content field | Think | smoke standard full | PASS | 0.0s | clean content |
| 268 | Streaming: reasoning_content in deltas | Think | smoke standard full | PASS | 0.9s | present |
| 269 | Stop sequence doesn't break think extraction | Think | smoke standard full | PASS | 1.7s | response ok |
| 270 | reasoning_content has meaningful length (>5 chars) | Think | smoke standard full | PASS | 0.0s | >5 chars |
| 271 | Basic tool call: finish_reason=tool_calls, valid args | Tools | smoke standard full | PASS | 1.3s | valid |
| 272 | tool_choice=none suppresses tool calls | Tools | smoke standard full | PASS | 0.9s | no tool calls |
| 273 | Tool arguments are valid JSON dict | Tools | standard full | PASS | 1.0s | valid JSON |
| 274 | Streaming: tool calls with finish_reason | Tools | standard full | PASS | 1.1s | valid |
| 275 | Multi-tool: at least 1 tool call with 2 tools | Tools | standard full | PASS | 1.2s | >=1 calls |
| 276 | Array param: todos is JSON array (not string) | Tools | standard full | PASS | 1.0s | array |
| 277 | Nullable param: anyOf [string, null] does not crash | Tools | standard full | PASS | 0.9s | no crash |
| 278 | Multi-turn: tool result produces valid follow-up | Tools | standard full | PASS | 1.7s | text response |
| 279 | Multi-turn nullable: full round-trip (anyOf params) | Tools | standard full | PASS | 2.7s | valid follow-up |
| 280 | No tools: normal text response | Tools | standard full | PASS | 0.2s | text response |
| 281 | First unique request: uncached suffix remains | Cache | standard full | PASS | 0.3s | cached_tokens < prompt_tokens |
| 282 | Shared-prefix request: cached_tokens>0 | Cache | standard full | FAIL | 0.2s | Expected: >0\nActual: FAIL: cached_tokens=0 |
| 283 | Exact replay: cached response matches cold response | Cache | standard full | PASS | 0.3s | same content |
| 284 | Different unique prompt: uncached suffix remains | Cache | standard full | PASS | 0.3s | cached_tokens < prompt_tokens |
| 285 | Streaming shared-prefix: cached_tokens>0 in usage chunk | Cache | standard full | FAIL | 0.7s | Expected: >0\nActual: FAIL: no cached_tokens>0 in stream usage |
| 286 | Streaming replay: content matches non-streaming warmup | Cache | standard full | PASS | 0.8s | same content |
| 287 | Concurrent x8 shared-prefix: uncached suffix remains on every branch | Cache | standard full | FAIL | 2.6s | Expected: 0 < cached_tokens < prompt_tokens for all 8\nActual: FAIL: 1:0/59, 2:0/59, 3:0/59, 4:0/59, 5:0/59, 6:0/59, 7:0/59, 8:0/59 |
| 288 | Concurrent x8 shared-prefix: divergent suffix responses stay isolated | Cache | standard full | FAIL | 2.6s | Expected: each of 8 responses keeps only its own marker\nActual: FAIL: 1:error=Expecting value: line 1 column 1 (char 0); 2:error=Expecting value: line 1 column 1 (char 0); 3:error=Expecting value: line 1 column 1 (char 0); 4:error=Expecting value: line 1 column 1 (char 0); 5:error=Expecting value: line 1 column 1 (char 0); 6:error=Expecting value: line 1 column 1 (char 0); 7:error=Expecting value: line 1 column 1 (char 0); 8:error=Expecting value: line 1 column 1 (char 0) |
| 289 | Two simultaneous requests: both 200 | Concurrent | standard full | PASS | 0.2s | 200+200 |
| 290 | Three simultaneous requests: all 200 | Concurrent | standard full | PASS | 0.3s | all 200 |
| 291 | Empty messages → 400 | Error | smoke standard full | PASS | 0.0s | 400 |
| 292 | Malformed JSON → 400 | Error | smoke standard full | PASS | 0.0s | 400 |
| 293 | Missing messages field → 400 | Error | smoke standard full | PASS | 0.0s | 400 |
| 294 | response_format json_object returns valid JSON | Error | smoke standard full | PASS | 0.2s | valid JSON |
| 295 | max_tokens=5 is respected | Error | smoke standard full | PASS | 0.1s | <=10 tokens |
| 296 | OPTIONS /v1/chat/completions → 200 (CORS) | Error | smoke standard full | PASS | 0.0s | 200 |
| 297 | developer role accepted (mapped to system) | Error | smoke standard full | PASS | 4.2s | valid response |
| 298 | enable_thinking=false disables thinking | Kwargs | standard full | PASS | 0.1s | no_think |
| 299 | Streaming: enable_thinking=false disables thinking | Kwargs | standard full | PASS | 0.1s | no_think |
| 300 | Default (no kwargs) retains thinking | Kwargs | standard full | PASS | 1.4s | thinking |
| 301 | enable_thinking=false (2K tokens) returns content | Kwargs | standard full | PASS | 0.1s | content present, no reasoning |
| 302 | enable_thinking=true explicitly keeps thinking | Kwargs | standard full | PASS | 1.4s | thinking |
| 303 | Prefix cache reuse across requests | Cache | standard full | PASS | 0.3s | valid response on cache hit |
| 304 | Issue #32: sequential guided-json → nullable tool (no crash) | Cache | standard full | PASS | 3.3s | both succeed |
| 305 | Sequential: 3 nullable tool calls (cache reuse) | Cache | standard full | PASS | 4.0s | 3/3 succeed |
| 306 | Multi-turn: 5-msg tool conversation with prefix cache | Cache | standard full | PASS | 1.6s | valid response |
| 307 | Long system prompt: 3 sequential requests (prefix reuse) | Cache | standard full | PASS | 4.8s | 3/3 succeed |
| 308 | Sequential stress: 5 mixed requests (text/tool/json/stream/nullable) | Cache | standard full | PASS | 3.3s | 5/5 succeed |
| 309 | Multi-turn: 5-turn growing conversation (prefix reuse) | Cache | standard full | PASS | 4.2s | 5/5 turns |
| 310 | Streaming + non-streaming sequential (shared prefix) | Cache | standard full | PASS | 1.0s | 3/3 succeed |
| 311 | Issue #32 comprehensive: nullable tool + multi-turn + prefix | Cache | standard full | PASS | 2.3s | valid response |
| 312 | json_schema produces valid schema-matching JSON | Structured | standard full | PASS | 0.2s | valid JSON |
| 313 | TTFT < 5s | Perf | full | PASS | 0.5s | <5000ms |
| 314 | tok/s > 1 (104.4 tok/s) | Perf | full | PASS | 0.5s | >1 |
| 315 | Long context (~2K tokens) no crash | Perf | full | PASS | 4.5s | valid response |
| 316 | Very long context (~4K tokens) no NaN/garbage | Perf | full | PASS | 5.0s | clean output |
| 317 | Function name correctly extracted | XMLTools | standard full | PASS | 1.2s | get_weather |
| 318 | Parameter values are correct string types | XMLTools | standard full | PASS | 1.0s | strings |
| 319 | Mixed-type params (string+bool+int) parse correctly | XMLTools | standard full | PASS | 1.3s | valid types |
| 320 | Nested object param survives XML parsing | XMLTools | standard full | PASS | 1.4s | valid dict |
| 321 | tool_choice=required forces tool call | XMLTools | standard full | PASS | 0.9s | tool_calls |
| 322 | tool_choice={function: get_time} calls correct function | XMLTools | standard full | PASS | 0.9s | get_time |
| 323 | Tool call IDs are unique | XMLTools | standard full | PASS | 1.5s | unique IDs |
| 324 | Streaming: XML tool call assembles valid JSON args | XMLTools | standard full | PASS | 1.0s | valid |
| 325 | Streaming: array param is JSON array (not string) | XMLTools | standard full | PASS | 1.0s | array |
| 326 | Tool call matches OpenAI schema (id, type, function.name, function.arguments) | XMLTools | standard full | PASS | 1.2s | valid schema |
| 327 | Normal XML tool call works with afm_adaptive_xml | AdaptiveXML | standard full | PASS | 1.1s | valid tool call |
| 328 | Streaming tool call emits valid deltas | AdaptiveXML | standard full | PASS | 0.9s | name + JSON args |
| 329 | Multi-turn: model responds after tool result | AdaptiveXML | standard full | PASS | 0.8s | non-empty content |
| 330 | tool_choice=none suppresses tool calls | AdaptiveXML | standard full | PASS | 1.7s | no tool_calls |
| 331 | Multiple tools: correct function selected | AdaptiveXML | standard full | PASS | 0.8s | get_time |
| 332 | Argument types coerced (string, bool, int) | AdaptiveXML | standard full | PASS | 1.3s | correct types |
| 333 | Tool call valid (with or without grammar constraints) | AdaptiveXML | standard full | PASS | 1.3s | valid |
| 334 | Array of objects coercion (question tool pattern) | AdaptiveXML | standard full | PASS | 2.3s | array of dicts |
| 335 | Number (float) and boolean coercion | AdaptiveXML | standard full | PASS | 1.1s | correct types |
| 336 | Nested object with typed fields coercion | AdaptiveXML | standard full | PASS | 1.3s | correct types |
| 337 | Streaming array coercion (incremental path) | AdaptiveXML | standard full | PASS | 1.5s | array in stream |
| 338 | XML entity decoding in tool call values | AdaptiveXML | standard full | PASS | 2.3s | decoded |
| 339 | EBNF grammar enforces all required params present | AdaptiveXML | standard full | PASS | 0.9s | command + description |
| 340 | EBNF structured params: array gets json_array constraint | AdaptiveXML | standard full | PASS | 1.5s | tags is array |
| 341 | Calculator tool call (non-streaming) | Grammar | standard full | PASS | 1.3s | calculate(expression) |
| 342 | Calculator tool call (streaming) | Grammar | standard full | PASS | 1.0s | calculate(expression) via SSE |
| 343 | Two tools: grammar allows correct selection | Grammar | standard full | PASS | 1.4s | get_weather selected |
| 344 | Two tools: grammar selects calculate | Grammar | standard full | PASS | 1.1s | calculate selected |
| 345 | Grammar enforces 3 required params (send_email) | Grammar | standard full | PASS | 1.7s | to + subject + body |
| 346 | Grammar constrains array param at generation time | Grammar | standard full | PASS | 1.7s | tags is array |
| 347 | Grammar array param via streaming | Grammar | standard full | PASS | 1.6s | tags is array (SSE) |
| 348 | Complex schema: string + int + array + object | Grammar | standard full | PASS | 2.8s | correct types |
| 349 | Header absent when grammar enabled (tool strict:true) | StrictWiring | smoke standard full | PASS | 1.3s | no header |
| 350 | Header absent when grammar enabled (schema strict:true) | StrictWiring | smoke standard full | PASS | 0.3s | no header |
| 351 | No header when strict absent | StrictWiring | smoke standard full | PASS | 1.0s | no header |
| 352 | Streaming json_schema strict:true returns valid JSON | StrictWiring | smoke standard full | PASS | 0.3s | valid JSON with name+age |
| 353 | Streaming tool strict:true returns valid tool call | StrictWiring | smoke standard full | PASS | 1.3s | get_weather(location) |
| 354 | strict:false does not error (best-effort) | StrictWiring | smoke standard full | PASS | 1.0s | valid response |
| 355 | POST /v1/files upload returns file ID | Batch | standard full | PASS | 0.0s | file-* |
| 356 | GET /v1/files/:id returns file metadata | Batch | standard full | PASS | 0.0s | file object |
| 357 | POST /v1/batches creates batch | Batch | standard full | PASS | 0.0s | in_progress/completed |
| 358 | GET /v1/batches/:id polls to completed | Batch | standard full | PASS | 2.1s | completed |
| 359 | Output JSONL contains both results (2/2) | Batch | standard full | PASS | 0.0s | assert-1 + assert-2 |
| 360 | GET /v1/batches lists completed batch | Batch | standard full | PASS | 0.0s | list with ≥1 batch |
| 361 | DELETE /v1/files/:id removes uploaded file | Batch | standard full | PASS | 0.0s | deleted=true |
| 362 | SSE multiplex: 2 non-streaming requests tagged with custom_id | Batch | standard full | PASS | 0.4s | sse-a + sse-b + [DONE] |
| 363 | SSE multiplex: streaming interleaved with finish_reason | Batch | standard full | PASS | 0.3s | str-x + str-y chunks + stop + [DONE] |
| 364 | SSE multiplex rejects duplicate custom_ids | Batch | standard full | PASS | 0.0s | 400 |
| 365 | SSE multiplex rejects empty requests | Batch | standard full | PASS | 0.0s | 400 |