Compact hypothesis prompts and separate evidence from causal assumptions
This commit is contained in:
1 parent
482df4579d
commit
680a5dd5ed
9 files changed
+184
-10
No files matched your search
@@ -88,3 +88,30 @@ previously contained 151857 characters; the compact representation contains
|
||||
The next fresh LLM trial must verify role/ID correctness, item-name uncertainty,
|
||||
visibility prerequisites and investigation directions. No LLM pre-summary and
|
||||
no extra model calls are introduced. Name-resolution prompts are unchanged.
|
||||
|
||||
|
||||
## Hypothesis generation v2
|
||||
|
||||
New hypothesis generation checkpoints freeze `prompt_version=hypotheses_v2` in
|
||||
the archived hypothesis context. Existing contexts without that field reconstruct
|
||||
v1 requests and retain their hypotheses and budgets unchanged. V2 applies the
|
||||
same deterministic compact presentation to the entire hypothesis input, retaining
|
||||
case sources, accepted interpretation sources, prior proposals and budget policy.
|
||||
No additional LLM call or semantic summary is introduced.
|
||||
|
||||
On the saved stable-resolution-20261015 generation, initial message characters
|
||||
fall from 153692 to 86127 (44.0%). Actual provider tokens and quality require a
|
||||
fresh live comparison; no token or monetary saving is guaranteed by character size.
|
||||
|
||||
V2 explicitly distinguishes supplied evidence from conditional causal mechanisms.
|
||||
Untested item/aura associations remain permissible research questions. A nearby
|
||||
name must not be presented as an established ID binding. Concrete API/enum/action
|
||||
numbers require an explicit mapping in cited readable local evidence; otherwise
|
||||
the model asks which implementation realizes the conceptual operation. Existing
|
||||
interpretation speculation is not upgraded to a verified fact. The prompts do
|
||||
not prescribe a known correct cause or specific test-case IDs.
|
||||
|
||||
These are prompting constraints, not a complete semantic fact checker over free
|
||||
text. Existing deterministic source/count/budget validation remains in place.
|
||||
A later live trial must assess whether this prevents the observed unsupported
|
||||
item equivalence and action-number examples while preserving causal diversity.
|
||||
Reference in new issue
Block a user