| # | Test | Group | Coverage | Status | Duration | Details |
|---|---|---|---|---|---|---|
| 1 | getFile returns nil for nonexistent file | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 2 | storeFile creates file with correct metadata | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 3 | deleteFile removes the file | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 4 | getBatch returns nil for nonexistent batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 5 | listBatches returns all batches | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 6 | getFileData returns nil for nonexistent file | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 7 | createBatch returns ID with correct prefix and initial state | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 8 | Multiple files have unique IDs | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 107|unit|9 | streaming: stopReached stays false when < | UnitTest | PASS | end |
||
| 107|unit|10 | streaming: < | UnitTest | PASS | end |
||
| 11 | markBatchCancelling and markBatchCancelled transitions | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 12 | getSlotIds returns empty for nonexistent batch | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 13 | final-only with no analysis still routes to content | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 107|unit|14 | streaming: stopReached is set on < | UnitTest | PASS | return |
||
| 107|unit|15 | streaming: < | UnitTest | PASS | channel |
||
| 16 | markBatchInProgress transitions status and stores slot IDs | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 17 | return inside analysis terminates without a final channel | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 18 | control tokens never leak into output | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 19 | deleteFile returns false for nonexistent file | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 20 | streaming: long body emits in safe-tail-bounded increments | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 21 | getFileData returns raw data | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 22 | analysis then final routes correctly | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 23 | streaming runtime fallback parses completed Gemma4 tool call | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 24 | extractToolCallsFallback parses Gemma4 wrapper blocks | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 25 | getFile returns stored file metadata | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 26 | Gemma4 parser preserves commas inside escaped strings | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 27 | recordResult increments completed count | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 28 | markBatchFailed sets status and error | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 29 | recordResult increments failed count for error results | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 30 | PresenceContext with empty tokens is no-op | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 31 | Batch auto-completes when all requests are done | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 32 | TopKProcessor is no-op when k <= 0 | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 33 | Gemma4 parser leaves nested-looking values as raw strings | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 34 | TopKProcessor is no-op when k >= vocabSize | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 35 | GrammarLogitProcessor with nil mask is passthrough | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 36 | Output JSONL file contains all results | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 37 | Gemma4 parser follows documented wrapper and call syntax | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 38 | recordResult drops results for cancelling batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 39 | recordResult drops results for cancelled batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 40 | GrammarLogitProcessor works with 1D logits | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 41 | createAttentionMask delegates to BatchKVCacheSimple.makeMask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 42 | GrammarLogitProcessor works with 2D logits | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 43 | KVCacheSimple and ArraysCache are batch-eligible | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 108|unit|44 | preamble before first < | UnitTest | PASS | channel |
||
| 45 | recordResult still works for in_progress batch | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 46 | end inside analysis without subsequent channel emits the reasoning so far | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 47 | TopKProcessor works with 2D logits [B, vocabSize] | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 48 | MinPProcessor works with 1D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 49 | MambaCache mask returns nil after state is set (non-prefill) | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 50 | createSSMMask delegates to MambaCache.makeMask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 51 | BatchKVCacheSimple update stores KV for all sequences | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 52 | TopKProcessor works with 1D logits [vocabSize] | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 53 | PresenceContext works with 2D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 54 | RepetitionContext works with 2D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 55 | NoSystemMessageGenerator includes name for tool messages | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 56 | CompositeLogitProcessor chains processors correctly with 2D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 57 | tool message with name includes name in dict | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 58 | MambaCache without leftPadding returns nil mask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 59 | system messages filtered by NoSystemMessageGenerator | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 60 | commentary channel is dropped | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 61 | BatchKVCacheSimple mask with uniform padding (same-length sequences) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 62 | tool message without name omits name from dict | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 63 | Batched prefill cache creation matches expected pattern for mixed layers | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 64 | Extracted cache can be loaded into KVCacheSimple for radix save | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 65 | CompositeLogitProcessor chains processors correctly with 1D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 66 | user message has no name field in dict | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 67 | insert: empty tokens is no-op | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 68 | RepetitionContext applies multiplicative penalty to negative logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 69 | RepetitionContext works with 1D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 70 | StreamChunk carries cached token count | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 71 | MinPProcessor works with 2D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 72 | RequestSlot appendContent accumulates text | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 73 | BatchInputLine handles messages with special characters | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 74 | truncateToOffset on empty cache is no-op | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 75 | BatchInputLine handles optional body fields | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 76 | MambaCache batched state can be sliced per-sequence | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 77 | findPrefix: query longer than cached — partial prefix hit | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 78 | RotatingKVCache is NOT batch-eligible | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 79 | Separate processor instances have independent state | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 80 | BatchScheduler default max concurrent is 8 | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 81 | BatchInputLine handles system + user messages | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 82 | truncateToOffset physically shrinks arrays to offset | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 83 | state getter returns raw refs after truncateToOffset (fast path) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 84 | PresenceContext works with 1D logits | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 85 | BatchKVCacheSimple mask with asymmetric padding (different-length sequences) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 86 | BaseKVCache truncateToOffset is safe no-op on MambaCache | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 87 | BatchScheduler emits only completed tool calls from slot runtime events | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 88 | BatchScheduler stop helper buffers partial stop across chunk boundaries | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 89 | BatchScheduler helper extraction keeps tool call streams isolated per event list | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 90 | JSONL with blank lines are skipped | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 91 | BatchScheduler stop helper does not stop while still inside think block | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 92 | MambaCache leftPadding creates correct SSM mask | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 93 | Left-padding stacks variable-length token arrays correctly | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 94 | invalidateAll clears everything | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 95 | findPrefix: empty cache — miss | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 96 | #103 server-level guided-json applies when request omits response_format | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 97 | BatchScheduler emits incremental tool call deltas from slot runtime events | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 98 | truncateToOffset is no-op when offset matches array size | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 99 | Multiple JSONL lines parse independently | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 100 | findPrefix: traverses nodes but no cached node found | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 101 | MLXServiceError.noModelLoaded has descriptive message | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 102 | StreamChunk carries timing info | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 103 | Multiple evictions on single insert (maxEntries=1) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 104 | insert: partial edge split at exact split point | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 105 | Full extraction round-trip: batch → individual → KVCacheSimple | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 106 | insert: multiple inserts grow the tree (multi-turn) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 107 | #103 returns nil when neither side supplies a schema | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 108 | findPrefix: miss with matched > 0 and debugLogging | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 109 | BatchScheduler stop helper emits stopped chunk on exact stop match | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 110 | runtime parses adaptive xml JSON fallback | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 111 | runtime salvages incomplete tool call at stream end | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 112 | MLXServiceError.serviceShuttingDown has descriptive message | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 113 | #103 per-request response_format wins over server default | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 114 | runtime preserves nulls in adaptive xml JSON fallback | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 115 | #99 pre-opened think: synthetic <think> prefix routes body to reasoning | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 116 | RequestSlot IDs are unique across instances | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 117 | runtime emits placeholder then final replacement for XML tool call | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 118 | BatchScheduler emits delta chunks before completed tool call chunks | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 119 | #103 non-strict schemas are not surfaced (matches existing semantics) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 120 | LRU eviction at capacity evicts oldest | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 121 | truncateToOffset after multiple trim cycles | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 122 | BatchKVCacheSimple extend merges prefill batch with existing decode batch | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 123 | StreamChunk defaults: only text, everything else nil | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 124 | #99 whole-text extractThinkContent on already-open synthetic prefix | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 125 | findPrefix: miss with matched == 0 and debugLogging | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 126 | KVCacheEntry stores tokens and layerStates | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 127 | invalidateAll with debugLogging | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 128 | insert: new edge (no matching child) | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 129 | Eviction with debugLogging | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 130 | insert: exact match update — node already has cache | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 131 | findPrefix: no child for next token — miss at root | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 132 | findPrefix: deepest cached node wins over shallower | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 133 | BatchKVCacheSimple decode mask with padding (n=1) | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 134 | Conversation fork: both branches survive and are findable | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 135 | compactUpward merges single-child node after sibling eviction | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 136 | Count tracks insertions, evictions, and invalidation | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 137 | RequestSlot initializes with unique ID and zero content | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 138 | findPrefix: partial edge match divergence mid-edge — returns cached state | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 139 | findPrefix: exact match returns full prefix | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 140 | didSample updates only the called processor's state | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 141 | findPrefix with debugLogging exercises all log branches | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 142 | T1.3 parallel_tool_calls=true (default) preserves all calls | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 143 | T1.3 parallel_tool_calls=false with single call is a no-op | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 144 | T1.3 parallel_tool_calls=nil leaves prior behavior untouched | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 145 | T1.1 minted request IDs use the documented req_<uuid12> shape | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 146 | T1.3 parallel_tool_calls=false truncates to first tool call | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 147 | T1.2 default is to include usage when stream_options absent | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 148 | T1.2 include_usage=true is honored explicitly | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 149 | T1.1 OpenAIError request_id is omitted when not provided | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 150 | T1.2 include_usage=false suppresses the usage chunk | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 151 | T1.1 OpenAIError exposes request_id field for correlation | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 152 | findPrefix: query shorter than cached edge | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 153 | T1.3 parallel_tool_calls field round-trips through JSON | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 154 | insert: exact match — node had no prior cache | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 155 | finishReason is stop by default | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 156 | extracts think tags into reasoningContent | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 157 | stream with only think tags and no visible content | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 158 | finishReason is stop when stopped by sequence | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 159 | buildChoiceLogprobs returns nil for empty input | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 160 | finishReason is tool_calls when tool calls present | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 161 | think extraction with tool calls returns nil content and reasoning | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 162 | collects timing and token stats from final chunk | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 163 | buildChoiceLogprobs converts ResolvedLogprob to ChoiceLogprobs | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 164 | finishReason is length when max tokens reached | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 165 | collects logprobs from stream chunks | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 166 | empty stream produces nil content | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 167 | multi-chunk think tags extracted correctly | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 168 | coerceStringValue returns nil for non-numeric string with integer type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 169 | decodeXMLEntities decodes all 5 standard entities | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 170 | KVCacheEntry touch updates access time | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 171 | returns unchanged when arguments JSON is invalid | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 172 | no think extraction when disabled | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 173 | returns unchanged when tool name not found in tools list | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 174 | normalizeToolCalls assigns sequential indices from startIndex | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 175 | preserves content outside tool calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 176 | coerceStringValue returns nil for float string with integer type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 177 | decodeJSONEscapes handles \t escapes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 178 | returns nil for content without <function=...> tag | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 179 | Touch via findPrefix prevents eviction | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 180 | insert: partial edge split with remaining tokens | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 181 | decodeJSONEscapes preserves real backslashes (\\n stays as \n literal) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 182 | bash tool with JSON-escaped command gets decoded | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 183 | JSON-in-XML with no arguments key still parses name | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 184 | RadixNode isLeaf and hasCachedState | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 185 | skips empty parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 186 | coerceStringValue coerces '0.0' to Int 0 for number type (whole number) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 187 | insert snapshots MLXArray views into independent storage | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 188 | JSON format switch mid-conversation (Qwen3-Coder-Next common error) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 189 | handles multiple tool calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 190 | toJinjaCompatible() strips null elements from arrays | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 191 | returns unchanged when tools is empty | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 192 | handles multiline parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 193 | EBNF grammar generates named required param rules for bash tool | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 194 | toJinjaCompatible() preserves all non-null types | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 195 | toJinjaCompatible() deeply nested nulls — Jinja accepts them | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 196 | toJinjaCompatible() result survives ToolSpec → Jinja Value round-trip | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 197 | empty <tool_call></tool_call> block returns no calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 198 | toJinjaCompatible() strips null keys from dicts — Jinja accepts it | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 199 | decodeXMLEntities handles double-encoded entities: &lt; → < | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 200 | decodeJSONEscapes handles empty string | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 201 | write tool with real newlines is NOT affected by decodeJSONEscapes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 202 | parses basic XML tool call | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 203 | decodeJSONEscapes preserves values that already have real newlines | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 204 | coerceStringValue returns nil for non-numeric string with number type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 205 | does not coerce non-string values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 206 | parses Mistral [TOOL_CALLS] JSON array format | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 207 | decodeJSONEscapes full edit oldString from real Qwen3-Coder output | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 208 | coerces string to array | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 209 | BatchKVCacheSimple extract returns correct per-sequence KV | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 210 | decodeXMLEntities passes through bare & without entity suffix | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 211 | text content before and after tool call is preserved | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 212 | insert with debugLogging exercises log branches | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 213 | completed tool call parsing resolves adaptive XML tool names against offered tools | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 214 | coerceStringValue handles empty string for all types | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 215 | JSON-in-XML with missing name returns no tool calls | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 216 | parses bare JSON tool call without wrapper tags | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 217 | toAny() wraps null as NSNull — Jinja throws on it | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 218 | decodeXMLEntities handles entities at string boundaries | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 219 | toAny() dict with null value — Jinja throws | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 220 | toAny() result in ToolSpec — Jinja throws (proves the bug) | NullableSchema | unit smoke standard full | PASS | 0.0s | pass |
| 221 | decodeXMLEntities handles consecutive entities | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 222 | JSON-in-XML with invalid JSON falls through | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 223 | decodeJSONEscapes unescapes literal \n and \" when no real newlines present | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 224 | fills missing required boolean param with false | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 225 | EBNF grammar handles tool with no required params | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 226 | bare JSON that's not a tool call doesn't match | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 227 | coerces string to integer | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 228 | edit tool with JSON-escaped oldString gets decoded (model pre-escaping bug) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 229 | requiredParamNames preserves client schema order (not alphabetical) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 230 | fills missing required integer param with 0 | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 231 | coerceStringValue coerces '0' to Int 0 for integer type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 232 | parses Mistral [TOOL_CALLS] with multiple items in array | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 233 | coerces whole-number string to Int for 'number' type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 234 | bare JSON with 'parameters' key instead of 'arguments' | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 235 | handles parameter values with special characters in Python code | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 236 | coerceStringValue returns nil for unknown schema type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 237 | does not fill non-required missing params | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 238 | mixed coercion: some params coerced, some left alone | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 239 | requiredParamNames returns empty for tool with no required array | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 240 | coerceStringValue returns nil for invalid JSON with object type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 241 | parses JSON-in-XML format with 'parameters' key | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 242 | decodeJSONEscapes passes through plain text without escapes | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 243 | regex fallback salvages unclosed parameter (max_tokens truncation) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 244 | coerces string to negative integer | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 245 | regex fallback handles bare < in parameter value | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 246 | coerceStringValue handles negative numbers | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 247 | coerces string to number (float) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 248 | write file with Python containing comparison operators (OpenCode pattern) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 249 | preserves JSON array parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 250 | parses Mistral [TOOL_CALLS] func_name[ARGS]{...} format | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 251 | parses JSON-in-XML format with 'arguments' key | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 252 | returns unchanged when tools is nil | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 253 | decodeJSONEscapes handles only \" without \n | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 254 | mixed: write content has real newlines, edit oldString has escaped — both decoded correctly | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 255 | decodeXMLEntities handles multiple < in Python code | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 256 | coerceStringValue returns nil for invalid JSON with array type | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 257 | strips <think></think> tags from remaining text | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 258 | coerces string to object | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 259 | decodeXMLEntities passes through strings without entities | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 260 | does not coerce when property not in schema | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 261 | does NOT coerce 'yes'/'no'/'1'/'0' to boolean | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 262 | handles duplicate parameters (keeps first non-empty) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 263 | handles mixed XML and JSON in separate <tool_call> blocks | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 264 | decodes XML entities in parameter values via XMLParser | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 265 | XMLParser path drops unclosed parameter (no bare < to trigger fallback) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 266 | preserves JSON object parameter values | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 267 | returns empty array and original text when no tool calls found | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 268 | coerces string to boolean true and false | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 269 | question tool: array of objects with typed fields (OpenCode pattern) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 270 | EBNF grammar allows extra optional params after required ones | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 271 | decodeXMLEntities handles empty string | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 272 | bash tool with special characters | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 273 | multiple parameters with same non-empty value keeps first | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 274 | handles multiple parameters with mixed string and JSON types | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 275 | coerces boolean case-insensitively (TRUE, True, FALSE) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 276 | normalizeToolCall remaps keys before coercing values | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 277 | leaves already-correct types alone (string stays string) | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 278 | FileDeleteResponse defaults | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 279 | EBNF grammar param_value uses permissive pv_char rule | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 280 | BatchResultLine with error encodes correctly | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 281 | completed tool call parsing preserves remaining non-tool text | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 282 | FileObject encodes with snake_case keys | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 283 | EBNF grammar generates named required param rules for edit tool | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 284 | BatchListResponse encodes with has_more field | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 285 | BatchCreateRequest decodes with snake_case keys | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 286 | BatchResultLine round-trips through JSON | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 287 | BatchInputLine decodes from JSONL line | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 288 | BatchCompletionRequest decodes array of requests | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 289 | BatchObject encodes with all fields | UnitTest | unit smoke standard full | PASS | 0.0s | pass |
| 290 | does NOT fill missing required string param (let client report missing) | XMLParsing | unit smoke standard full | PASS | 0.0s | pass |
| 291 | RequestSlot is thread-safe under concurrent writes | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 292 | BatchStore handles concurrent batch creates safely | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 293 | BatchStore handles concurrent file operations safely | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 294 | Cancel batch on non-in_progress returns 400 | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 295 | Cancel batch transitions to cancelled | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 296 | Cancel nonexistent batch returns 404 | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 297 | BatchCompletionsController skips grammar downgrade header for unsupported strict tool grammar | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 298 | BatchCompletionsController sanitizes fenced JSON in non-streaming results | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 299 | BatchCompletionsController sets grammar downgrade header when strict tools present | XMLParsing | unit smoke standard full | PASS | 0.1s | pass |
| 300 | Accepts valid method and url | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 301 | Rejects line with wrong method | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 302 | Rejects line with wrong url | UnitTest | unit smoke standard full | PASS | 0.1s | pass |
| 303 | RequestSlot elapsedTime increases over time | UnitTest | unit smoke standard full | PASS | 0.2s | pass |
| 304 | BatchAPIController response includes reasoningContent when model supports thinking | UnitTest | unit smoke standard full | PASS | 0.7s | pass |
| 305 | BatchAPIController response includes tool_calls with correct finish_reason | UnitTest | unit smoke standard full | PASS | 0.7s | pass |
| 306 | BatchAPIController response includes logprobs when provided in stream | UnitTest | unit smoke standard full | PASS | 0.7s | pass |
| 307 | Binary exists at /Volumes/Crucial4TB/dev/git/maclocal-api/.build/arm64-apple-macosx/release/afm | Preflight | unit smoke standard full | PASS | 0.0s | file exists |
| 308 | Server reachable at http://127.0.0.1:9999 | Preflight | unit smoke standard full | PASS | 0.0s | 200 OK |
| 309 | /v1/models contains model ID | Lifecycle | unit smoke standard full | PASS | 0.0s | model in response |
| 310 | Basic completion returns content | Lifecycle | unit smoke standard full | PASS | 4.7s | non-empty content or reasoning |
| 311 | Stop string '5' absent from output | Stop | unit smoke standard full | PASS | 1.3s | no '5' in content |
| 312 | finish_reason is 'stop' with stop sequence | Stop | unit smoke standard full | PASS | 0.0s | stop |
| 313 | Multi-word stop 'and' truncates correctly | Stop | unit smoke standard full | PASS | 1.7s | no 'and' in output |
| 314 | Stop on newline produces single line | Stop | unit smoke standard full | PASS | 1.7s | single line |
| 315 | Multiple stop sequences [7, 12] | Stop | unit smoke standard full | PASS | 2.2s | neither found |
| 316 | Empty stop array is no-op | Stop | unit smoke standard full | PASS | 3.3s | valid output |
| 317 | Streaming: stop string '5' absent | Stop | unit smoke standard full | PASS | 1.4s | no '5' in stream |
| 318 | Stop sequence '3.' truncates list | Stop | standard full | PASS | 1.0s | no '3.' in output |
| 319 | Stop 'stopped' doesn't fire on 'stopping' | Stop | standard full | PASS | 2.1s | output produced |
| 320 | Stop 'llo' fires mid-word in 'hello' | Stop | standard full | PASS | 0.4s | no 'llo' |
| 321 | ChoiceLogprobs JSON schema valid | Logprobs | smoke standard full | PASS | 0.2s | valid schema |
| 322 | top_logprobs count <= requested (5) | Logprobs | smoke standard full | PASS | 0.2s | count valid |
| 323 | logprobs=false returns null | Logprobs | smoke standard full | PASS | 0.2s | null logprobs |
| 324 | top_logprobs=99 returns 400 | Logprobs | smoke standard full | PASS | 0.0s | 400 |
| 325 | Streaming logprobs present and valid | Logprobs | standard full | PASS | 0.2s | valid |
| 326 | top_logprobs=0 returns empty arrays | Logprobs | standard full | PASS | 0.2s | empty top_logprobs |
| 327 | reasoning_content present in response | Think | smoke standard full | PASS | 0.0s | present |
| 328 | No <think> tags in content field | Think | smoke standard full | PASS | 0.0s | clean content |
| 329 | Streaming: reasoning_content in deltas | Think | smoke standard full | PASS | 1.1s | present |
| 330 | Stop sequence doesn't break think extraction | Think | smoke standard full | PASS | 2.1s | response ok |
| 331 | reasoning_content has meaningful length (>5 chars) | Think | smoke standard full | PASS | 0.0s | >5 chars |
| 332 | Basic tool call: finish_reason=tool_calls, valid args | Tools | smoke standard full | PASS | 1.0s | valid |
| 333 | tool_choice=none suppresses tool calls | Tools | smoke standard full | PASS | 1.1s | no tool calls |
| 334 | Tool arguments are valid JSON dict | Tools | standard full | PASS | 0.5s | valid JSON |
| 335 | Streaming: tool calls with finish_reason | Tools | standard full | PASS | 0.5s | valid |
| 336 | Multi-tool: at least 1 tool call with 2 tools | Tools | standard full | PASS | 1.2s | >=1 calls |
| 337 | Array param: todos is JSON array (not string) | Tools | standard full | PASS | 1.5s | array |
| 338 | Nullable param: anyOf [string, null] does not crash | Tools | standard full | PASS | 0.8s | no crash |
| 339 | Multi-turn: tool result produces valid follow-up | Tools | standard full | PASS | 4.4s | text response |
| 340 | Multi-turn nullable: full round-trip (anyOf params) | Tools | standard full | PASS | 1.6s | valid follow-up |
| 341 | No tools: normal text response | Tools | standard full | PASS | 0.3s | text response |
| 342 | First unique request: uncached suffix remains | Cache | standard full | PASS | 0.4s | cached_tokens < prompt_tokens |
| 343 | Shared-prefix request: cached_tokens>0 | Cache | standard full | PASS | 0.3s | >0 |
| 344 | Exact replay: cached response matches cold response | Cache | standard full | PASS | 0.4s | same content |
| 345 | Different unique prompt: uncached suffix remains | Cache | standard full | PASS | 0.4s | cached_tokens < prompt_tokens |
| 346 | Streaming shared-prefix: cached_tokens>0 in usage chunk | Cache | standard full | PASS | 0.9s | >0 |
| 347 | Streaming replay: content matches non-streaming warmup | Cache | standard full | PASS | 1.0s | same content |
| 348 | Concurrent x8 shared-prefix: uncached suffix remains on every branch | Cache | standard full | FAIL | 2.6s | Expected: 0 < cached_tokens < prompt_tokens for all 8\nActual: FAIL: 3:0/59, 4:0/59, 5:0/59, 6:0/59, 7:0/59, 8:0/59 |
| 349 | Concurrent x8 shared-prefix: divergent suffix responses stay isolated | Cache | standard full | FAIL | 2.6s | Expected: each of 8 responses keeps only its own marker\nActual: FAIL: 1:error=Expecting value: line 1 column 1 (char 0); 2:error=Expecting value: line 1 column 1 (char 0); 3:error=Expecting value: line 1 column 1 (char 0); 4:error=Expecting value: line 1 column 1 (char 0); 5:error=Expecting value: line 1 column 1 (char 0); 6:error=Expecting value: line 1 column 1 (char 0); 7:error=Expecting value: line 1 column 1 (char 0); 8:error=Expecting value: line 1 column 1 (char 0) |
| 350 | Two simultaneous requests: both 200 | Concurrent | standard full | PASS | 0.3s | 200+200 |
| 351 | Three simultaneous requests: all 200 | Concurrent | standard full | PASS | 0.4s | all 200 |
| 352 | Empty messages → 400 | Error | smoke standard full | PASS | 0.0s | 400 |
| 353 | Malformed JSON → 400 | Error | smoke standard full | PASS | 0.0s | 400 |
| 354 | Missing messages field → 400 | Error | smoke standard full | PASS | 0.0s | 400 |
| 355 | response_format json_object returns valid JSON | Error | smoke standard full | PASS | 0.3s | valid JSON |
| 356 | max_tokens=5 is respected | Error | smoke standard full | PASS | 0.2s | <=10 tokens |
| 357 | OPTIONS /v1/chat/completions → 200 (CORS) | Error | smoke standard full | PASS | 0.0s | 200 |
| 358 | developer role accepted (mapped to system) | Error | smoke standard full | PASS | 5.3s | valid response |
| 359 | enable_thinking=false disables thinking | Kwargs | standard full | PASS | 0.2s | no_think |
| 360 | Streaming: enable_thinking=false disables thinking | Kwargs | standard full | PASS | 0.2s | no_think |
| 361 | Default (no kwargs) retains thinking | Kwargs | standard full | PASS | 1.8s | thinking |
| 362 | enable_thinking=false (2K tokens) returns content | Kwargs | standard full | PASS | 0.2s | content present, no reasoning |
| 363 | enable_thinking=true explicitly keeps thinking | Kwargs | standard full | PASS | 1.8s | thinking |
| 364 | Prefix cache reuse across requests | Cache | standard full | PASS | 0.4s | valid response on cache hit |
| 365 | Issue #32: sequential guided-json → nullable tool (no crash) | Cache | standard full | PASS | 3.4s | both succeed |
| 366 | Sequential: 3 nullable tool calls (cache reuse) | Cache | standard full | PASS | 2.9s | 3/3 succeed |
| 367 | Multi-turn: 5-msg tool conversation with prefix cache | Cache | standard full | PASS | 1.4s | valid response |
| 368 | Long system prompt: 3 sequential requests (prefix reuse) | Cache | standard full | PASS | 6.7s | 3/3 succeed |
| 369 | Sequential stress: 5 mixed requests (text/tool/json/stream/nullable) | Cache | standard full | PASS | 4.1s | 5/5 succeed |
| 370 | Multi-turn: 5-turn growing conversation (prefix reuse) | Cache | standard full | PASS | 4.7s | 5/5 turns |
| 371 | Streaming + non-streaming sequential (shared prefix) | Cache | standard full | PASS | 1.3s | 3/3 succeed |
| 372 | Issue #32 comprehensive: nullable tool + multi-turn + prefix | Cache | standard full | PASS | 2.0s | valid response |
| 373 | json_schema produces valid schema-matching JSON | Structured | standard full | PASS | 0.4s | valid JSON |
| 374 | TTFT < 5s | Perf | full | PASS | 0.6s | <5000ms |
| 375 | tok/s > 1 (83.1 tok/s) | Perf | full | PASS | 0.6s | >1 |
| 376 | Long context (~2K tokens) no crash | Perf | full | PASS | 6.0s | valid response |
| 377 | Very long context (~4K tokens) no NaN/garbage | Perf | full | PASS | 8.3s | clean output |
| 378 | Function name correctly extracted | XMLTools | standard full | PASS | 1.1s | get_weather |
| 379 | Parameter values are correct string types | XMLTools | standard full | FAIL | 0.8s | Expected: strings\nActual: FAIL: location=str(), unit=str() |
| 380 | Mixed-type params (string+bool+int) parse correctly | XMLTools | standard full | PASS | 1.3s | valid types |
| 381 | Nested object param survives XML parsing | XMLTools | standard full | PASS | 1.2s | valid dict |
| 382 | tool_choice=required forces tool call | XMLTools | standard full | PASS | 1.1s | tool_calls |
| 383 | tool_choice={function: get_time} calls correct function | XMLTools | standard full | PASS | 0.9s | get_time |
| 384 | Tool call IDs are unique | XMLTools | standard full | PASS | 1.3s | unique IDs |
| 385 | Streaming: XML tool call assembles valid JSON args | XMLTools | standard full | FAIL | 0.5s | Expected: valid\nActual: FAIL: assembled args not valid JSON: {"location":"Sydney","unit":"fahrenheit"}{"location":"Sydney","unit":"fahrenheit"} |
| 386 | Streaming: array param is JSON array (not string) | XMLTools | standard full | FAIL | 1.4s | Expected: array\nActual: FAIL: args not valid JSON: {"todos":["Walk dog","Read book","Cook dinner"]}{"todos":["Walk dog","Read book","Cook dinner"]} |
| 387 | Tool call matches OpenAI schema (id, type, function.name, function.arguments) | XMLTools | standard full | PASS | 1.1s | valid schema |
| 388 | Normal XML tool call works with afm_adaptive_xml | AdaptiveXML | standard full | PASS | 1.1s | valid tool call |
| 389 | Streaming tool call emits valid deltas | AdaptiveXML | standard full | FAIL | 1.1s | Expected: name + JSON args\nActual: FAIL: args not valid JSON: {"location":"Tokyo","unit":"celsius"}{"location":"Tokyo","unit":"celsius"} |
| 390 | Multi-turn: model responds after tool result | AdaptiveXML | standard full | PASS | 1.8s | non-empty content |
| 391 | tool_choice=none suppresses tool calls | AdaptiveXML | standard full | PASS | 2.2s | no tool_calls |
| 392 | Multiple tools: correct function selected | AdaptiveXML | standard full | PASS | 1.0s | get_time |
| 393 | Argument types coerced (string, bool, int) | AdaptiveXML | standard full | PASS | 1.2s | correct types |
| 394 | Tool call valid (with or without grammar constraints) | AdaptiveXML | standard full | PASS | 1.1s | valid |
| 395 | Array of objects coercion (question tool pattern) | AdaptiveXML | standard full | PASS | 1.6s | array of dicts |
| 396 | Number (float) and boolean coercion | AdaptiveXML | standard full | FAIL | 1.1s | Expected: correct types\nActual: FAIL: type coercion: ['celsius=str(string("22.5"))', 'enabled=str(string("True"))'] |
| 397 | Nested object with typed fields coercion | AdaptiveXML | standard full | PASS | 1.2s | correct types |
| 398 | Streaming array coercion (incremental path) | AdaptiveXML | standard full | FAIL | 0.8s | Expected: array in stream\nActual: FAIL: invalid JSON arguments: Extra data: line 1 column 124 (char 123) |
| 399 | XML entity decoding in tool call values | AdaptiveXML | standard full | PASS | 3.2s | decoded |
| 400 | EBNF grammar enforces all required params present | AdaptiveXML | standard full | PASS | 1.2s | command + description |
| 401 | EBNF structured params: array gets json_array constraint | AdaptiveXML | standard full | PASS | 1.3s | tags is array |
| 402 | Calculator tool call (non-streaming) | Grammar | standard full | FAIL | 2.0s | Expected: calculate(expression)\nActual: FAIL: no tool_calls |
| 403 | Calculator tool call (streaming) | Grammar | standard full | FAIL | 5.4s | Expected: calculate(expression) via SSE\nActual: FAIL: no tool call in stream |
| 404 | Two tools: grammar allows correct selection | Grammar | standard full | FAIL | 1.7s | Expected: get_weather selected\nActual: FAIL: no tool_calls |
| 405 | Two tools: grammar selects calculate | Grammar | standard full | FAIL | 1.5s | Expected: calculate selected\nActual: FAIL: no tool_calls |
| 406 | Grammar enforces 3 required params (send_email) | Grammar | standard full | FAIL | 5.9s | Expected: to + subject + body\nActual: FAIL: no tool_calls |
| 407 | Grammar constrains array param at generation time | Grammar | standard full | FAIL | 5.9s | Expected: tags is array\nActual: FAIL: no tool_calls |
| 408 | Grammar array param via streaming | Grammar | standard full | FAIL | 1.2s | Expected: tags is array (SSE)\nActual: FAIL: no tool call in stream |
| 409 | Complex schema: string + int + array + object | Grammar | standard full | FAIL | 3.1s | Expected: correct types\nActual: FAIL: no tool_calls |
| 410 | Header absent when grammar enabled (tool strict:true) | StrictWiring | smoke standard full | PASS | 1.4s | no header |
| 411 | Header absent when grammar enabled (schema strict:true) | StrictWiring | smoke standard full | PASS | 0.4s | no header |
| 412 | No header when strict absent | StrictWiring | smoke standard full | PASS | 0.4s | no header |
| 413 | Streaming json_schema strict:true returns valid JSON | StrictWiring | smoke standard full | FAIL | 3.2s | Expected: valid JSON with name+age\nActual: FAIL: invalid JSON: Unterminated string starting at: line 1 column 11 (char 10) |
| 414 | Streaming tool strict:true returns valid tool call | StrictWiring | smoke standard full | FAIL | 1.7s | Expected: get_weather(location)\nActual: FAIL: no tool call in stream |
| 415 | strict:false does not error (best-effort) | StrictWiring | smoke standard full | PASS | 0.9s | valid response |
| 416 | POST /v1/files upload returns file ID | Batch | standard full | PASS | 0.0s | file-* |
| 417 | GET /v1/files/:id returns file metadata | Batch | standard full | PASS | 0.0s | file object |
| 418 | POST /v1/batches creates batch | Batch | standard full | PASS | 0.0s | in_progress/completed |
| 419 | GET /v1/batches/:id polls to completed | Batch | standard full | PASS | 2.1s | completed |
| 420 | Output JSONL contains both results (2/2) | Batch | standard full | PASS | 0.0s | assert-1 + assert-2 |
| 421 | GET /v1/batches lists completed batch | Batch | standard full | PASS | 0.0s | list with ≥1 batch |
| 422 | DELETE /v1/files/:id removes uploaded file | Batch | standard full | PASS | 0.0s | deleted=true |
| 423 | SSE multiplex: 2 non-streaming requests tagged with custom_id | Batch | standard full | PASS | 0.3s | sse-a + sse-b + [DONE] |
| 424 | SSE multiplex: streaming interleaved with finish_reason | Batch | standard full | PASS | 0.4s | str-x + str-y chunks + stop + [DONE] |
| 425 | SSE multiplex rejects duplicate custom_ids | Batch | standard full | PASS | 0.0s | 400 |
| 426 | SSE multiplex rejects empty requests | Batch | standard full | PASS | 0.0s | 400 |
| 427 | batch + top_k + streaming | PairwiseSmoke | standard full | PASS | 0.2s | content present |
| 428 | batch + presence_penalty + non-streaming | PairwiseSmoke | standard full | PASS | 0.2s | finish_reason present |
| 429 | batch + repetition_penalty + logprobs | PairwiseSmoke | standard full | PASS | 0.2s | response valid |
| 430 | batch + all sampling params combined | PairwiseSmoke | standard full | PASS | 0.2s | response valid |
| 431 | streaming parity (same seed → same output) | PairwiseSmoke | standard full | FAIL | 0.3s | Expected: ns='' vs s=''\nActual: FAIL: mismatch |
| 432 | cache idempotency (same seed → same output) | PairwiseSmoke | standard full | FAIL | 0.3s | Expected: r1='' vs r2=''\nActual: FAIL: mismatch |