Archive BUG-000022 evaluation and deferred final-review findings
This commit is contained in:
Nico committed
1 parent
aec2bcdb21
commit
72e1ade0a9
6 files changed
+781
No files matched your search
@@ -0,0 +1,34 @@
|
||||
# BUG-000021: field-confirmed visibility mechanism and analysis review
|
||||
|
||||
Date: 2026-10-25. Evidence: final revision-2 generation-123 case package reviewed previously, followed by operator-supplied SQL outputs, screenshots and in-game experiments. No model calls, DB writes or code changes were executed by the assistant for this review. The earlier completion and usage reports remain unchanged.
|
||||
|
||||
## Confirmed operator experiments
|
||||
|
||||
- Furien exists as creature 35286, spawn 367807. GM visibility and NPC inspection confirmed the original live spawn.
|
||||
- The original PhaseId is 169. The inspected Vcore source defines DEFAULT_PHASE as 169; InitDbPhaseShift treats it as Unphased. Both the NPC and the player's reported ordinary phase state had Flags 8. This contradicts the automatic diagnosis's unverified premise that 169 is a nondefault inaccessible phase.
|
||||
- creature_addon is empty for this spawn. creature_template_addon has StandState 7 and aura 49414; the live aura list identifies Generic Quest Invisibility 1, aura type 18.
|
||||
- Removing 49414 from the NPC makes him visible without GM mode. Keeping the original NPC aura and adding detection aura 49416 to the player also makes him visible.
|
||||
- There was no matching spell_area rule for area 405/2404 or the Horde breadcrumb quest. Existing uses of 49416 were confined to other area/quest conditions.
|
||||
- Operator inserted spell_area (spell=49416, area=405, quest_start=0, quest_end=0, aura_spell=0, racemask=946, gender=2, flags=3, quest_start_status=0, quest_end_status=0), reloaded spell_area, removed the manually applied player aura and left/reentered Desolace. Operator reports automatic Horde visibility, and invisibility to an Alliance character.
|
||||
- This supports the proposed zone-wide Horde detection rule for the tested scenario. Original retail conditions, all quest-progress states, aura removal on exit and the entire downstream quest chain were not all separately reported as tested. It is not proof that this is the only correct rule.
|
||||
- Jankie (36410) and mount templates have no static creature rows; an Alliance field test did not find her even in GM mode. No fix applied. This is reserved for a subsequent independent BugAnalysis field test.
|
||||
|
||||
## What BugAnalysis did correctly
|
||||
|
||||
Intake, project binding, read-only DB tools, actor-audited technical release, bounded name-assessment repair, case continuation, early diagnosis and differentiated coding/human handoff worked. Furien's identity and existing spawn were found correctly. H1 missing-spawn was rejected using actual complete query evidence. H2 appropriately included visibility as a candidate mechanism. Placeholders and human verification prevented a fabricated target PhaseId from becoming an executable hardcoded instruction.
|
||||
|
||||
## What failed
|
||||
|
||||
The automatic workflow never identified the invisibility aura. Original archive members include an empty creature_addon result but no direct creature_template_addon result for 35286. Numeric 49414 strings exist in historical SQL-reference ID lists; these are not captured evidence of Furien's aura. The relationship tool projects template/script, spawn and event-link information, not template addon/auras or effective visibility. This is a coverage gap, not a reason to treat omitted fields as absent; the read-only DB tool could retrieve them.
|
||||
|
||||
The H2 initial brief labels the mere existence of phase-related schema columns as supporting causal evidence. Later the model explicitly calls PhaseId 169 nondefault without checking its core semantics. The next brief presents exclusion of the test player as a fact although no phase-membership measurement was obtained. The root-cause claim thus grew from a real column value through an unverified interpretation into an alleged runtime observation.
|
||||
|
||||
Early review used the same spawn records to reject H1 and countercheck H2. Showing that a spawn exists is not a discriminating test of whether phase state or a separate invisibility aura hides it. Neither the source DEFAULT_PHASE definition nor the target's aura state was examined. Final diagnosis repeated the unsupported player-phase assertion and accepted the early conclusion. Contract-valid evidence references establish provenance of the row, not entailment of every causal clause attached to it.
|
||||
|
||||
The coding request correctly uses {{TARGET_PHASE_ID}}, but already mandates changing the NPC phase and prohibits changes to other spawn fields. The human task asks which phase is intended; it does not adequately question the unsupported repair mechanism itself. A placeholder does not repair an incorrect causal diagnosis.
|
||||
|
||||
## Generalizable improvement candidates, not implemented here
|
||||
|
||||
Distinguish captured values, interpreted mechanisms and unverified runtime prerequisites; do not promote schema-only results to causal support. Verify numeric field semantics in the actual source before classifying values as abnormal. Expand visibility research to relevant effective addon/aura sources, keeping spawn-specific versus template precedence explicit. Require a countercheck that probes the selected mechanism rather than only eliminating another hypothesis. Have final review test causal prerequisites and allow a focused tool/human follow-up when they are missing. Review whether the chosen intervention follows from the evidence, separately from whether parameters are known. These measures do not require excluding every alternative, exhausting budgets or disabling early completion.
|
||||
|
||||
The run is an infrastructure success and a useful partially correct investigation, but not a successful automatic root-cause diagnosis or repair recommendation. The visibility fix was derived by subsequent human-guided investigation. No claim is made that a single example establishes overall accuracy or that the system should memorize Furien/169/49416 as a special case.
|
||||
@@ -0,0 +1,29 @@
|
||||
# BUG-000022: Officer Jankie field analysis
|
||||
|
||||
Date: 2026-10-25. Input: `BUG-000022-Fallakte.zip`, revision 1, generation 79, OUTPUT_READY/outbox. No paid calls or code changes were performed for this evaluation. The final package was read directly, without a retained extracted workspace. Usage is archived separately at `token-usage/bug22-final-g00000079-20261025.json`.
|
||||
|
||||
## Hypotheses and actual research
|
||||
|
||||
H1: missing world spawn. Startup `creature_spawn_context` found template 36410, empty AIName/ScriptName and zero creature rows. H2: existing spawn hidden by phase/quest conditions. A direct creature query for 36410 independently returned zero rows with complete filtered coverage. H3: dynamic summon/movement/despawn. The first requested source.context call omitted required path_prefix and was rejected with INVESTIGATION_OUTPUT; the next call used source.search for 36410. The rejected query is in the curated corpus at `tests/fixtures/llm_rejections/20261025/bug22-source-context-prefix/`.
|
||||
|
||||
After startup assessment, H1 became strongly_supported, H2/H3 weakened. H1 then repeated source.search for the same number with a different limit. Both captures show the same historical SQL/numeric lexical matches and partial coverage with skipped files. A smart_scripts query for entryorguid 36410 returned zero rows. The controller accepted an early diagnosis request. Final diagnosis selected missing spawn, rejected H2/H3 and produced a coding SQL template with placeholders for GUID, coordinates and orientation, plus a human request to obtain position/mount requirements.
|
||||
|
||||
There are five evidence records: one relationship query, one direct creature query, two lexical source searches and one smart_scripts query. No direct current creature_questender/queststarter row query was made during investigation; SQL-history references were found. No actual spawn/fix was applied by this run. The operator's earlier DB and GM observations independently support the absence diagnosis, but the final success of a patch remains untested.
|
||||
|
||||
## Assessment
|
||||
|
||||
This is a much more defensible repair candidate than BUG-000021's unverified PhaseId interpretation: the selected missing-static-spawn premise was actually tested with complete query results, and the proposed insertion addresses it directly. Correct identity, sensible initial alternatives, investigation of script possibility, early finish and differentiated placeholder/human handoff are positives. It is reasonable to try this repair within the downstream coding/build/human-test feedback system without proving universal absence of every possible dynamic caller.
|
||||
|
||||
Two qualifications matter. Empty own-template script bindings and no own SmartAI rows do not logically exclude summons by external scripts, spells or other entries. The diagnosis acknowledges uninspected C++ in scope_limits but still calls H3 refuted; its confidence language exceeds its coverage. Event-link nodes were skipped because there were no parent spawn GUIDs; that is not an independent investigation of all event logic.
|
||||
|
||||
The coding request's only explicit validation requirement is that the new creature row exists. It should also require the original symptom to be checked: a normal Alliance character at the destination can see Jankie and turn in quest 28531. A valid INSERT alone is not proof of behavioral repair. Mount/follow-up behavior remains an explicit human clarification. Coordinates are correctly not invented. The human document's emphasis on authoritative/reference coordinates is stronger than necessary for an operator-approved suitable position; this is secondary to functional correctness.
|
||||
|
||||
## Deferred work, explicitly not implemented
|
||||
|
||||
User requested retaining the final-review improvement for later evaluation: verify the selected cause's load-bearing premise using targeted evidence/source semantics or a concrete follow-up, rather than adopting investigation narration. Distinguish value capture from semantic abnormality and unmeasured player state. Do not require exhaustive exclusion of every alternative, all budgets to be spent, or guaranteed patch success. BUG-000021's standard PhaseId=169 assumption is the motivating counterexample; BUG-000022 illustrates a reasonable repair trial with narrower coverage language needed. Also retain the source.context missing-prefix case for later form/default-recovery work. No analysis prompts, validators or tool behavior were changed here.
|
||||
|
||||
## Metrics
|
||||
|
||||
Thirteen measured model calls, one additional startup correction. Total: 106317 input and 21897 output including thinking. Clean: 102446 input and 21265 output. The first joint-planning call is regular despite its recorded correction label; it is counted once. Recorded model time totals 207.939304 seconds; revision checkpoint span 436.431866 seconds (7m16.4s), excluding unrecorded queue time. Investigation prompt message contents ranged from 8865 to 13098 characters.
|
||||
|
||||
Saved pricing yields USD 0.0948699–0.150581025 for known total usage, clean USD 0.091244325–0.14695545. Missing cache/storage values prevent an exact total and remain unknown. USD estimates are not EUR billing. No updated provider-account balance was supplied. Full phase and per-call accounting, version/config hashes and cache limitations are in the JSON report.
|
||||
@@ -0,0 +1,659 @@
|
||||
{
|
||||
"case_id": "BUG-000022",
|
||||
"package_id": "api-04e95ed5d97043810706ce14ff101d8cb29778bea835bd190d7bbdb5578e9f8b",
|
||||
"analysis_revision": 1,
|
||||
"package_generation": 79,
|
||||
"result": "OUTPUT_READY",
|
||||
"recorded_at": "2026-10-25",
|
||||
"scope": "Final package, all recorded model calls once; joint interpretation/hypotheses counted once. No new model calls.",
|
||||
"package_sha256": "33ad04882c92fdb37df9a6452b7bb30243a511cd28ea55b36a4d6600aeff8361",
|
||||
"pricing": {
|
||||
"model": "gemini-3.8-flash",
|
||||
"currency": "USD",
|
||||
"recorded_at": "2026-10-25",
|
||||
"source": "saved per-call cost metadata and configured table, not independently refreshed vendor pricing",
|
||||
"input_per_million": 0.75,
|
||||
"cache_input_per_million": 0.075,
|
||||
"output_including_reasoning_per_million": 3.75,
|
||||
"storage": "reported estimates separately; missing values unknown"
|
||||
},
|
||||
"classification_note": "First case_plan_v2 response is a regular joint call despite recorded correction label. Additional startup response is excluded from clean balance.",
|
||||
"account_balance_eur": null,
|
||||
"account_status": "No EUR balance supplied",
|
||||
"runtime": {
|
||||
"first_revision_checkpoint": "2026-10-24T22:14:39.788595+00:00",
|
||||
"completed": "2026-10-24T22:21:56.220461+00:00",
|
||||
"checkpoint_span_seconds": 436.431866,
|
||||
"note": "Checkpoint span includes local overhead, excludes any unrecorded queue waiting before first revision checkpoint"
|
||||
},
|
||||
"total": {
|
||||
"calls": 13,
|
||||
"measured_calls": 13,
|
||||
"input_tokens": 106317,
|
||||
"output_including_reasoning_tokens": 21897,
|
||||
"known_reasoning_tokens": 13570,
|
||||
"reasoning_complete": false,
|
||||
"known_cached_input_tokens": 16697,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 207.939304,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.09486990000000001,
|
||||
0.15058102499999998
|
||||
],
|
||||
"cache_storage_cost_usd": null,
|
||||
"phases": {
|
||||
"diagnosis": {
|
||||
"calls": 1,
|
||||
"measured_calls": 1,
|
||||
"input_tokens": 20463,
|
||||
"output_including_reasoning_tokens": 2188,
|
||||
"known_reasoning_tokens": 1013,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 14.279153,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.009739725000000001,
|
||||
0.02355225
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
"entity_resolution": {
|
||||
"calls": 2,
|
||||
"measured_calls": 2,
|
||||
"input_tokens": 32272,
|
||||
"output_including_reasoning_tokens": 422,
|
||||
"known_reasoning_tokens": 0,
|
||||
"reasoning_complete": false,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 42.703409,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.004002899999999999,
|
||||
0.0257865
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
"handoff": {
|
||||
"calls": 1,
|
||||
"measured_calls": 1,
|
||||
"input_tokens": 15533,
|
||||
"output_including_reasoning_tokens": 4177,
|
||||
"known_reasoning_tokens": 2808,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 28.14314,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.016828725,
|
||||
0.0273135
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
"investigation": {
|
||||
"calls": 8,
|
||||
"measured_calls": 8,
|
||||
"input_tokens": 27305,
|
||||
"output_including_reasoning_tokens": 10148,
|
||||
"known_reasoning_tokens": 8480,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 16697,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 90.76304400000001,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.04488525,
|
||||
0.04726327500000001
|
||||
],
|
||||
"cache_storage_cost_usd": null
|
||||
},
|
||||
"joint_planning": {
|
||||
"calls": 1,
|
||||
"measured_calls": 1,
|
||||
"input_tokens": 10744,
|
||||
"output_including_reasoning_tokens": 4962,
|
||||
"known_reasoning_tokens": 1269,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 32.050558,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.019413299999999998,
|
||||
0.026665499999999998
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
}
|
||||
}
|
||||
},
|
||||
"clean": {
|
||||
"calls": 12,
|
||||
"measured_calls": 12,
|
||||
"input_tokens": 102446,
|
||||
"output_including_reasoning_tokens": 21265,
|
||||
"known_reasoning_tokens": 13030,
|
||||
"reasoning_complete": false,
|
||||
"known_cached_input_tokens": 14256,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 200.814912,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.091244325,
|
||||
0.14695545
|
||||
],
|
||||
"cache_storage_cost_usd": null,
|
||||
"phases": {
|
||||
"diagnosis": {
|
||||
"calls": 1,
|
||||
"measured_calls": 1,
|
||||
"input_tokens": 20463,
|
||||
"output_including_reasoning_tokens": 2188,
|
||||
"known_reasoning_tokens": 1013,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 14.279153,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.009739725000000001,
|
||||
0.02355225
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
"entity_resolution": {
|
||||
"calls": 2,
|
||||
"measured_calls": 2,
|
||||
"input_tokens": 32272,
|
||||
"output_including_reasoning_tokens": 422,
|
||||
"known_reasoning_tokens": 0,
|
||||
"reasoning_complete": false,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 42.703409,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.004002899999999999,
|
||||
0.0257865
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
"handoff": {
|
||||
"calls": 1,
|
||||
"measured_calls": 1,
|
||||
"input_tokens": 15533,
|
||||
"output_including_reasoning_tokens": 4177,
|
||||
"known_reasoning_tokens": 2808,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 28.14314,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.016828725,
|
||||
0.0273135
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
"investigation": {
|
||||
"calls": 7,
|
||||
"measured_calls": 7,
|
||||
"input_tokens": 23434,
|
||||
"output_including_reasoning_tokens": 9516,
|
||||
"known_reasoning_tokens": 7940,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 14256,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 83.63865200000001,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.041259675,
|
||||
0.0436377
|
||||
],
|
||||
"cache_storage_cost_usd": null
|
||||
},
|
||||
"joint_planning": {
|
||||
"calls": 1,
|
||||
"measured_calls": 1,
|
||||
"input_tokens": 10744,
|
||||
"output_including_reasoning_tokens": 4962,
|
||||
"known_reasoning_tokens": 1269,
|
||||
"reasoning_complete": true,
|
||||
"known_cached_input_tokens": 0,
|
||||
"cache_complete": false,
|
||||
"model_seconds_known_sum": 32.050558,
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.019413299999999998,
|
||||
0.026665499999999998
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
}
|
||||
}
|
||||
},
|
||||
"calls": [
|
||||
{
|
||||
"ref": "llm/operations/6c0a36f93bea41b87241a30769bd92bb6dc387869b46d3a013ec595cfc7e9548/round-0001.json",
|
||||
"operation_key": "6c0a36f93bea41b87241a30769bd92bb6dc387869b46d3a013ec595cfc7e9548",
|
||||
"analysis_revision": 1,
|
||||
"phase": "entity_resolution",
|
||||
"prompt_version": "entity_resolution_plan_v4",
|
||||
"prompt_characters": 33168,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "645b6f2cd80737162108331f6fcf9da8f086dcacc635b3375dec16c9c71e7f4b",
|
||||
"usage": {
|
||||
"input_tokens": 14980,
|
||||
"output_tokens": 112,
|
||||
"reasoning_tokens": null,
|
||||
"cached_input_tokens": null,
|
||||
"uncached_input_tokens": null,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "below_minimum",
|
||||
"elapsed_seconds": 39.040508
|
||||
},
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.0015435,
|
||||
0.011655
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/88adb8b462df2c473b421f617b086dd65351532f28e81a7a1052e1f24da87dea/round-0001.json",
|
||||
"operation_key": "88adb8b462df2c473b421f617b086dd65351532f28e81a7a1052e1f24da87dea",
|
||||
"analysis_revision": 1,
|
||||
"phase": "entity_resolution",
|
||||
"prompt_version": "entity_resolution_assessment_v4",
|
||||
"prompt_characters": 39785,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "94cd9df23849fa4c59d4cfa06b69627c3978b912ba16d6c90a7bafa1ff84d5ae",
|
||||
"usage": {
|
||||
"input_tokens": 17292,
|
||||
"output_tokens": 310,
|
||||
"reasoning_tokens": null,
|
||||
"cached_input_tokens": null,
|
||||
"uncached_input_tokens": null,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "below_minimum",
|
||||
"elapsed_seconds": 3.662901
|
||||
},
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.0024593999999999996,
|
||||
0.0141315
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/572afccbd4034d9c5485045cb4bb28b61fdd40e48dc8a3fab67cfc17e997cd65/round-0001.json",
|
||||
"operation_key": "572afccbd4034d9c5485045cb4bb28b61fdd40e48dc8a3fab67cfc17e997cd65",
|
||||
"analysis_revision": 1,
|
||||
"phase": "joint_planning",
|
||||
"prompt_version": "case_plan_v2",
|
||||
"prompt_characters": 33025,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "correction",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "1fcd4e5cad0b961240236d3146b60de4a07bc14962e98626b020b457bafc2fdf",
|
||||
"usage": {
|
||||
"input_tokens": 10744,
|
||||
"output_tokens": 4962,
|
||||
"reasoning_tokens": 1269,
|
||||
"cached_input_tokens": null,
|
||||
"uncached_input_tokens": null,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "below_minimum",
|
||||
"elapsed_seconds": 32.050558
|
||||
},
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.019413299999999998,
|
||||
0.026665499999999998
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/ca6cdff81de3cbae0492c26802daa287b11bf4fabefad477a9b64f1b6db30112/round-0001.json",
|
||||
"operation_key": "ca6cdff81de3cbae0492c26802daa287b11bf4fabefad477a9b64f1b6db30112",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_startup_v1",
|
||||
"prompt_characters": 8865,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "18e1a41a7c31942556f3c7be6793762fce43220ee6d671866c0d14d6dc2f3c7f",
|
||||
"usage": {
|
||||
"input_tokens": 2697,
|
||||
"output_tokens": 393,
|
||||
"reasoning_tokens": 318,
|
||||
"cached_input_tokens": 2441,
|
||||
"uncached_input_tokens": 256,
|
||||
"cache_created_tokens": 2441,
|
||||
"cache_status": "created",
|
||||
"elapsed_seconds": 5.655612
|
||||
},
|
||||
"estimated_cost_usd": 0.0018488250000000001,
|
||||
"known_usage_usd_range": [
|
||||
0.0018488250000000001,
|
||||
0.0018488250000000001
|
||||
],
|
||||
"cache_storage_cost_usd": 0.00010170833333333334
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/54ef9b495e10fe49a2ffad5909c89efdbfe7ef7645b601865d12e5223b0651bc/round-0001.json",
|
||||
"operation_key": "54ef9b495e10fe49a2ffad5909c89efdbfe7ef7645b601865d12e5223b0651bc",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_startup_v1",
|
||||
"prompt_characters": 11950,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "6269dd79ef6176ff248f206613f469444e080b423cc8b7a12518f9701f61ac60",
|
||||
"usage": {
|
||||
"input_tokens": 3566,
|
||||
"output_tokens": 677,
|
||||
"reasoning_tokens": 561,
|
||||
"cached_input_tokens": 2441,
|
||||
"uncached_input_tokens": 1125,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "reused",
|
||||
"elapsed_seconds": 6.459214
|
||||
},
|
||||
"estimated_cost_usd": 0.0035655750000000005,
|
||||
"known_usage_usd_range": [
|
||||
0.0035655750000000005,
|
||||
0.0035655750000000005
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/71fd77c20b2af9bb2d842927c7a39cc8e1cf3e15541f387a26054fdb1047b6e4/round-0001.json",
|
||||
"operation_key": "71fd77c20b2af9bb2d842927c7a39cc8e1cf3e15541f387a26054fdb1047b6e4",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_startup_v1",
|
||||
"prompt_characters": 12860,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "3ab7cf7e3d8e9137d558c15c2012140f0a0618f8cca9e70f7eef14bf02bb0c41",
|
||||
"usage": {
|
||||
"input_tokens": 3815,
|
||||
"output_tokens": 1001,
|
||||
"reasoning_tokens": 875,
|
||||
"cached_input_tokens": 2441,
|
||||
"uncached_input_tokens": 1374,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "reused",
|
||||
"elapsed_seconds": 7.44411
|
||||
},
|
||||
"estimated_cost_usd": 0.004967325,
|
||||
"known_usage_usd_range": [
|
||||
0.004967325,
|
||||
0.004967325
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/7b8f9ecd4cb00c7e1d8bbd314d9ab15032701b76a0d5cf4256b895312b03a731/round-0001.json",
|
||||
"operation_key": "7b8f9ecd4cb00c7e1d8bbd314d9ab15032701b76a0d5cf4256b895312b03a731",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_startup_v1",
|
||||
"prompt_characters": 13098,
|
||||
"classification": "correction",
|
||||
"recorded_classification": "correction",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "747d5e6358c32804aabf93970ef4889b3c1bc809254b05efaeb0df61e1897873",
|
||||
"usage": {
|
||||
"input_tokens": 3871,
|
||||
"output_tokens": 632,
|
||||
"reasoning_tokens": 540,
|
||||
"cached_input_tokens": 2441,
|
||||
"uncached_input_tokens": 1430,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "reused",
|
||||
"elapsed_seconds": 7.124392
|
||||
},
|
||||
"estimated_cost_usd": 0.0036255750000000002,
|
||||
"known_usage_usd_range": [
|
||||
0.0036255750000000002,
|
||||
0.0036255750000000002
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/0270771b422d04af95c20c38558476ded170af96569985af436406482d8d043a/round-0001.json",
|
||||
"operation_key": "0270771b422d04af95c20c38558476ded170af96569985af436406482d8d043a",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_startup_review_v1",
|
||||
"prompt_characters": 11179,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "7a6617bb65d9d93dd8aa0e8d85b629909e7fb9c39ec270db8bb60511e3dde5b7",
|
||||
"usage": {
|
||||
"input_tokens": 3523,
|
||||
"output_tokens": 2374,
|
||||
"reasoning_tokens": 1773,
|
||||
"cached_input_tokens": null,
|
||||
"uncached_input_tokens": null,
|
||||
"cache_created_tokens": null,
|
||||
"cache_status": "fallback",
|
||||
"elapsed_seconds": 18.078619
|
||||
},
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.009166725,
|
||||
0.011544750000000001
|
||||
],
|
||||
"cache_storage_cost_usd": null
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/c619a7901de5674f54e8371759fba596a7746f67d62499b198780813912e5c31/round-0001.json",
|
||||
"operation_key": "c619a7901de5674f54e8371759fba596a7746f67d62499b198780813912e5c31",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_project_v20",
|
||||
"prompt_characters": 9612,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "f50e57d329485610f657a47c5d22a120750a049ed368a54ba6127671ad942b09",
|
||||
"usage": {
|
||||
"input_tokens": 2920,
|
||||
"output_tokens": 291,
|
||||
"reasoning_tokens": 198,
|
||||
"cached_input_tokens": 2497,
|
||||
"uncached_input_tokens": 423,
|
||||
"cache_created_tokens": 2497,
|
||||
"cache_status": "created",
|
||||
"elapsed_seconds": 4.425924
|
||||
},
|
||||
"estimated_cost_usd": 0.001595775,
|
||||
"known_usage_usd_range": [
|
||||
0.001595775,
|
||||
0.001595775
|
||||
],
|
||||
"cache_storage_cost_usd": 0.00010404166666666667
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/b5de43dfa1122fa86decfa538047ee813621839eded8ed15356d341f3439e383/round-0001.json",
|
||||
"operation_key": "b5de43dfa1122fa86decfa538047ee813621839eded8ed15356d341f3439e383",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_project_v20",
|
||||
"prompt_characters": 12076,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "7cb224250e9557d857268001dcecf8cba78fa509081eb13e8fe22ed66a85379f",
|
||||
"usage": {
|
||||
"input_tokens": 4132,
|
||||
"output_tokens": 624,
|
||||
"reasoning_tokens": 321,
|
||||
"cached_input_tokens": 2511,
|
||||
"uncached_input_tokens": 1621,
|
||||
"cache_created_tokens": 2511,
|
||||
"cache_status": "created",
|
||||
"elapsed_seconds": 7.509486
|
||||
},
|
||||
"estimated_cost_usd": 0.0037440750000000004,
|
||||
"known_usage_usd_range": [
|
||||
0.0037440750000000004,
|
||||
0.0037440750000000004
|
||||
],
|
||||
"cache_storage_cost_usd": 0.00010462500000000001
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/6849c974442865e5ca3e8f146ef4520c275f2e37a25fb7caa498f17089ed6dc1/round-0001.json",
|
||||
"operation_key": "6849c974442865e5ca3e8f146ef4520c275f2e37a25fb7caa498f17089ed6dc1",
|
||||
"analysis_revision": 1,
|
||||
"phase": "investigation",
|
||||
"prompt_version": "investigation_project_v20",
|
||||
"prompt_characters": 9159,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "ff3c7cd769e708cf4cb6ff98e19f2aff507841f046e9d178076c1b6339102560",
|
||||
"usage": {
|
||||
"input_tokens": 2781,
|
||||
"output_tokens": 4156,
|
||||
"reasoning_tokens": 3894,
|
||||
"cached_input_tokens": 1925,
|
||||
"uncached_input_tokens": 856,
|
||||
"cache_created_tokens": 1925,
|
||||
"cache_status": "created",
|
||||
"elapsed_seconds": 34.065687
|
||||
},
|
||||
"estimated_cost_usd": 0.016371375,
|
||||
"known_usage_usd_range": [
|
||||
0.016371375,
|
||||
0.016371375
|
||||
],
|
||||
"cache_storage_cost_usd": 8.020833333333334e-05
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/25febf70da1f602d9d830c61c59e4504617a8bc05beac14676d7fd4e9f6589f9/round-0001.json",
|
||||
"operation_key": "25febf70da1f602d9d830c61c59e4504617a8bc05beac14676d7fd4e9f6589f9",
|
||||
"analysis_revision": 1,
|
||||
"phase": "diagnosis",
|
||||
"prompt_version": "diagnosis_early_v8",
|
||||
"prompt_characters": 48403,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "569ec836dd3f078c5cbaf46f32f3ea5e330654219f6723a691133b1e732e746f",
|
||||
"usage": {
|
||||
"input_tokens": 20463,
|
||||
"output_tokens": 2188,
|
||||
"reasoning_tokens": 1013,
|
||||
"cached_input_tokens": null,
|
||||
"uncached_input_tokens": null,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "below_minimum",
|
||||
"elapsed_seconds": 14.279153
|
||||
},
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.009739725000000001,
|
||||
0.02355225
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
},
|
||||
{
|
||||
"ref": "llm/operations/17917402a4c04bd20ae3b0a2f256a39daa4c026a0afff5f80f408478611d4e03/round-0001.json",
|
||||
"operation_key": "17917402a4c04bd20ae3b0a2f256a39daa4c026a0afff5f80f408478611d4e03",
|
||||
"analysis_revision": 1,
|
||||
"phase": "handoff",
|
||||
"prompt_version": "change_request_v9",
|
||||
"prompt_characters": 38336,
|
||||
"classification": "regular",
|
||||
"recorded_classification": "regular",
|
||||
"status": "SUCCESS",
|
||||
"code": null,
|
||||
"model": "gemini-3.8-flash",
|
||||
"provider": "gemini-native",
|
||||
"config_sha256": "692c8bac07efc915a44a89ac8aab1b4caa3e125d8619745f13c2ee570cb9e054",
|
||||
"request_sha256": "aaf9aaa1e371329ba165cd131f64e4cd574e98ef55e129defe9ecf0cee055342",
|
||||
"usage": {
|
||||
"input_tokens": 15533,
|
||||
"output_tokens": 4177,
|
||||
"reasoning_tokens": 2808,
|
||||
"cached_input_tokens": null,
|
||||
"uncached_input_tokens": null,
|
||||
"cache_created_tokens": 0,
|
||||
"cache_status": "below_minimum",
|
||||
"elapsed_seconds": 28.14314
|
||||
},
|
||||
"estimated_cost_usd": null,
|
||||
"known_usage_usd_range": [
|
||||
0.016828725,
|
||||
0.0273135
|
||||
],
|
||||
"cache_storage_cost_usd": 0.0
|
||||
}
|
||||
],
|
||||
"limitations": [
|
||||
"Unknown cached_input_tokens are not zero. USD bounds apply to known usage and exclude unreported charges.",
|
||||
"Output includes thinking; known reasoning tokens must not be added again."
|
||||
]
|
||||
}
|
||||
+5
@@ -0,0 +1,5 @@
|
||||
# BUG-000022: missing source.context path_prefix
|
||||
|
||||
The startup model requested the contextual source tool for Jankie using text 36410 and entity_refs N0002. The query omitted required path_prefix and was rejected with INVESTIGATION_OUTPUT. The next model call used plain source.search, producing mostly historical SQL and lexical numeric matches, with skipped files and partial coverage.
|
||||
|
||||
Against the current protocol-2 query schema, the sole error is missing path_prefix. Adding the explicit empty prefix passes this query-schema check. This is a counterprobe, not an implemented automatic repair or proof of the full response's semantic validity. A future bounded syntax/default recovery could preserve the selected richer tool. Do not infer that lexical numeric search results exclude all dynamic callers.
|
||||
+15
@@ -0,0 +1,15 @@
|
||||
{
|
||||
"assessment": null,
|
||||
"next": {
|
||||
"arguments": {
|
||||
"entity_refs": [
|
||||
"N0002"
|
||||
],
|
||||
"kind": "source.context",
|
||||
"text": "36410"
|
||||
},
|
||||
"kind": "tool",
|
||||
"operation": "project.query"
|
||||
},
|
||||
"observation": "Search codebase context for references to creature entry 36410 (Officer Jankie) to evaluate potential scripted spawns, movement, or event handling."
|
||||
}
|
||||
+39
@@ -0,0 +1,39 @@
|
||||
{
|
||||
"type": "object",
|
||||
"additionalProperties": false,
|
||||
"required": [
|
||||
"kind",
|
||||
"text",
|
||||
"path_prefix"
|
||||
],
|
||||
"properties": {
|
||||
"kind": {
|
||||
"const": "source.context"
|
||||
},
|
||||
"text": {
|
||||
"type": "string",
|
||||
"minLength": 1,
|
||||
"maxLength": 200
|
||||
},
|
||||
"path_prefix": {
|
||||
"type": "string",
|
||||
"maxLength": 250
|
||||
},
|
||||
"scope": {
|
||||
"enum": [
|
||||
"code",
|
||||
"schema",
|
||||
"historical_sql"
|
||||
]
|
||||
},
|
||||
"entity_refs": {
|
||||
"type": "array",
|
||||
"maxItems": 4,
|
||||
"uniqueItems": true,
|
||||
"items": {
|
||||
"type": "string",
|
||||
"pattern": "^N[0-9]{4,}$"
|
||||
}
|
||||
}
|
||||
}
|
||||
}
|
||||
Reference in new issue
Block a user