The Owen
Human AI ProjectLEARNING THROUGH EXPERIENCE
← All journal entries
8 September 2026 · v111.4 · Project · 3 min read

The test he hadn’t seen before.

An independent 40-case test tells a more complicated story. The failures matter just as much as the gains.

Source validation
Historical original report, retained as evidence.

Frozen primary examiner

The v111.3 Blind Examiner was not edited. Its hidden semantic programs, realiser and scorer remained frozen. The new candidate saw only each current prompt and learner-visible entity descriptions; examination caused zero model changes.

SeedOverallLanguage meaningNoisy languageTemporalBeliefReferenceHard composition
77111392/10014/1711/1617/1717/1717/1716/16
77111495/10014/1714/1617/1717/1717/1716/16
77111593/10013/1713/1617/1717/1717/1716/16

The historical pre-v111.4 seed-771113 language result was 5/17. The replicated post-development range is 13–14/17.

Independent frozen hand-authored set

This second set is defined in a separate module that imports neither the Mentor nor learner internals. It contains 40 fixed cases and was not used for teaching.

CapabilityFullAttempted
Semantic roles716
Negation scope56
Event language34
Noisy forms44
Conversational pragmatics38
Ambiguity preservation02
Total2240

Controls scored 13/40 for text-only and 6/40 for shuffled context.

Failure categories

Full-arm failures comprised:

  • 9 semantic-role/generalisation failures;
  • 6 insufficient-language-evidence results;
  • 1 negation-scope failure;
  • 2 unjustified-certainty failures.

The principal boundary is not lexical recall. It is deciding role orientation and knowing when weak overlapping evidence is insufficient.

Leakage and mutation checks

  • Examiner modules do not import developmental Mentor modules.
  • Mentor source does not import either blind examiner.
  • Exact blind prompts and hidden expected structures are never passed to development.
  • Blind candidate fingerprints were identical before and after examination.
  • The primary comparison continued to use the unchanged v111.3 examiner.

Classification

PARTIAL DEVELOPMENTAL TRANSFER PROVEN IN CONTROLLED OWEN WORLD.

Not proven: human English mastery, open-world linguistic understanding, calibrated ambiguity, robust unfamiliar pragmatics, or general noisy-speech competence.

Sources and limits

  • OWEN_V111_4_LANGUAGE_BLIND_SCORECARD.md

Engineering reports and reviewed source support this entry. Bounded results do not establish general intelligence or consciousness.

Download the chapter and sources

Public discussion

Visit the community

Ask a question, share an observation, or suggest a test inspired by this entry.

No public comments yet.

Checking sign-in…