Compact hypothesis prompts and separate evidence from causal assumptions

This commit is contained in:
Nico committed 2026-10-15 13:24:41 +02:00
1 parent 482df4579d
commit 680a5dd5ed
9 files changed
+184 -10

No files matched your search

+27
View File
@@ -88,3 +88,30 @@ previously contained 151857 characters; the compact representation contains
The next fresh LLM trial must verify role/ID correctness, item-name uncertainty,
visibility prerequisites and investigation directions. No LLM pre-summary and
no extra model calls are introduced. Name-resolution prompts are unchanged.
## Hypothesis generation v2
New hypothesis generation checkpoints freeze `prompt_version=hypotheses_v2` in
the archived hypothesis context. Existing contexts without that field reconstruct
v1 requests and retain their hypotheses and budgets unchanged. V2 applies the
same deterministic compact presentation to the entire hypothesis input, retaining
case sources, accepted interpretation sources, prior proposals and budget policy.
No additional LLM call or semantic summary is introduced.
On the saved stable-resolution-20261015 generation, initial message characters
fall from 153692 to 86127 (44.0%). Actual provider tokens and quality require a
fresh live comparison; no token or monetary saving is guaranteed by character size.
V2 explicitly distinguishes supplied evidence from conditional causal mechanisms.
Untested item/aura associations remain permissible research questions. A nearby
name must not be presented as an established ID binding. Concrete API/enum/action
numbers require an explicit mapping in cited readable local evidence; otherwise
the model asks which implementation realizes the conceptual operation. Existing
interpretation speculation is not upgraded to a verified fact. The prompts do
not prescribe a known correct cause or specific test-case IDs.
These are prompting constraints, not a complete semantic fact checker over free
text. Existing deterministic source/count/budget validation remains in place.
A later live trial must assess whether this prevents the observed unsupported
item equivalence and action-number examples while preserving causal diversity.