Repository navigation
L7: learned soft-prefix latent handoff + preregistered G-W7 bench - #87
Merged
Merged
Conversation
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ssion Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Adapter identity now hashes the codec config (model, sender layer, slots, d_attn, system prompt, storage dtype) with the projector weights; saved projectors carry that config and refuse to load under another one. Batched calls refuse unequal input lengths, empty answers raise, base forwards skip the KV cache, projector init no longer touches the global torch RNG, from_pretrained requires a pinned revision, generation is plain greedy, admit accepts a cached adapter id, and TrainStats records the trained identity and gradient clip. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…eport) Each phase runs in its own process under 'all'. The sender process encodes paired, blank and mismatched capsules; the receiver process opens only questions, anchors, the capsule index and capsules (never dataset.json), issues each grant from the manifest, admits every use, verifies every injected receipt and runs seven integrity probes. The report phase joins gold, computes paired bootstrap differences, H1/H2/H4 verdicts, follow rates, integrity and cost including training. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…er run Review fixes for the run CLI: the receiver saves every grant and the report re-verifies each INJECTED receipt from the saved grants and capsule manifests, binds every capsule-arm score row to one, and counts anchors and probes against the dataset rather than the receiver's own numbers. The report takes its config from the phase records (which must agree), emits the preregistered overall verdict label, and renders before creating files. 'all' refuses a non-empty run directory or an existing REPORT.md up front; anchors are verified before scoring; the receiver re-checks candidate token distinctness. Weights load from the local cache without memory-mapping (the mmap page-in crashed on this host), and the training budget is batch 4, 3000 steps, lr 1e-3. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Metric, arms (paired / blank / shuffled / mismatched / no prefix, with a text-context ceiling), unseen evaluation split (unseen names, phrasings and a yes/no task family), sample size (200 documents x 4 items per family), H1/H2 promotion rule (every paired-minus-control lower 95% CI bound >= 0.10), H4 integrity, cost accounting and the training budget, committed before any confirmatory result exists. The calibration pilot (training split, seed 999) is disclosed and is not evidence. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The first confirmatory attempt (run g-w7-confirm-1) died twice in the prepare phase while loading weights: reading the whole safetensors file ran out of memory on this shared host. The bench loader now reads the header and one tensor at a time (same weights: identical base digest), and the projector's embedding-RMS prior is computed from row norms instead of a vocab x width temporary (same value). No preregistered setting changes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Run g-w7-confirm-2 (seed 20261025, 200 unseen evaluation documents), preregistered in 4918fc8. H1 PASS: on unseen phrasings the paired capsule scores 0.547 against 0.056-0.113 for blank/shuffled/mismatched/ no-capsule controls (lower 95% bounds 0.409-0.480 vs margin 0.10), and shuffled/mismatched answers follow the capsule source (0.56/0.55). The transfer is partial (job 0.965, pet 0.99, city and colour at chance). H2 FAIL: no transfer to the unseen yes/no family. H4 PASS: 140/140 probes refused, 6400/6400 receipts re-verified, 200/200 anchors. Training cost 3952 s CPU, about 6.7e14 FLOPs. Deviations recorded. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ote plan drift TensorRefV1 takes the contract's Dtype literal; the codec casts after its membership check (CI runs mypy on aether_context). NativeMemoryLLM.receive gains the optional principal_id/current_fence keywords the backend already accepts. The plan notes where review fixes superseded Tasks 7-8. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
AetherAI3
marked this pull request as ready for review
October 28, 2026 02:27
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Lane L7 / W7 of the Predator V2 fanout. This PR tests whether a learned soft-prefix capsule
carries usable context between a frozen same-model pair. It adds an optional
[latent]extra, anHF soft-prefix backend that emits the merged
latent_v1manifests, and a preregistered bench withstrict controls.
Result (proposed for gate G-W7):
phrasings.
The lane proposes the verdict; the orchestrator owns the gate.
G-W7 results
Run
g-w7-confirm-2: Qwen2.5-0.5B-Instruct @7ae5576, float32, CPU, 200 unseen evaluationdocuments × 4 items per family. The preregistration was committed alone in 4918fc8, before any
result.
capsule's source document dictates 0.56 and 0.55 of the time.
colour 0.125 (chance 0.125).
prompt;
Full tables, cost, limits and deviations are in
bench/latent_transfer/REPORT.md. Deviations:What changed
aether_context/latent/behindpip install .[latent]:NativeMemoryLLMprotocol;LatentCapsuleV1/ContextHandoffGrantV1/LatentUseReceiptV1;HFSoftPrefixBackend: the frozen base model with only the projector trainable, and a receiverthat is differentiable through
inputs_embeds;subprocess test proves the core never imports torch, transformers or
aether_context.latent.bench/latent_transfer/:an allowlist of files;
docs/LATENT_HANDOFF.md, a CHANGELOG entry and the plan.Test plan
[latent]venv (tiny random Llama, no download): 133 passed (all 12 latent test files)ruff check aether_context testsandpython -m mypy aether_contextcleanbench/latent_transfer/REPORT.md)🤖 Generated with Claude Code