The Council of Elders — Waldorf-style classroom training: a golden-youth pupil taught by 8+1 open-weights teachers via geometric-mean softmax consensus, the dream lane, the dyad-live corpus
  • Python 76.2%
  • HTML 22.2%
  • Shell 1.6%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Peter Lodri 9dda7a7043
Merge pull request #2 from 8b-is/aye/research-branding
Use 8b.is Research for public publisher branding
2026-10-10 21:26:43 +09:00
.github/workflows feat(pages): add GitHub Pages landing page and deployment workflow 2026-08-17 10:17:05 +02:00
.well-known feat(site): client-side E2E in the 8b-is theme — robots, llms.txt, well-known, agents.md, headers, seo, json-ld, rss, constellation footer 2026-08-21 05:03:49 +02:00
assets chore: the backyardultraloop — sovereign sync, lap 0/108 2026-09-12 16:59:09 +02:00
data/sources feat(corpus): the Doombible — Tom Hall's original DOOM design bible joins the teaching sources 2026-08-21 05:35:44 +02:00
docs feat: add Nemotron Lightning + the latest HF models to the classroom 2026-08-22 07:07:01 +02:00
hf-overlay feat: vények tanácsa (Waldorf) classroom-SOTA-training pipeline 2026-08-17 06:36:32 +02:00
honesty Authenticate observer routes and deduplicate durable deliveries 2026-10-05 07:03:36 -04:00
scripts chore: the backyardultraloop — sovereign sync, lap 0/108 2026-09-12 16:59:09 +02:00
status feat(wire): qYAML in the status lane — t3y frames for config 2026-08-21 05:27:33 +02:00
tests Authenticate observer routes and deduplicate durable deliveries 2026-10-05 07:03:36 -04:00
.gitignore chore: ignore the generated _site directory 2026-08-22 07:28:26 +02:00
_headers feat: classroom.vaked.dev — ko-fi CSP, ultraCROSSref, the TEAM + sponsors 2026-08-22 07:14:02 +02:00
agents.md feat(site): client-side E2E in the 8b-is theme — robots, llms.txt, well-known, agents.md, headers, seo, json-ld, rss, constellation footer 2026-08-21 05:03:49 +02:00
CLA.md docs: CrushLike LICENSE + CLA — the gate, not the wall 2026-08-22 07:16:05 +02:00
index.html docs: give research a little class with shared branding 2026-10-10 13:00:25 +09:00
KOMPRESS_v2_HF.md docs: formalize consensus equivalence in Hugging Face paper card 2026-08-18 19:37:27 +02:00
LICENSE-CrushLike.md docs: CrushLike LICENSE + CLA — the gate, not the wall 2026-08-22 07:16:05 +02:00
llms.txt feat(site): client-side E2E in the 8b-is theme — robots, llms.txt, well-known, agents.md, headers, seo, json-ld, rss, constellation footer 2026-08-21 05:03:49 +02:00
preflight.sh feat(runbook+preflight): prepare for the training run 2026-08-21 04:59:20 +02:00
README.hu.md docs: english README + PLAN (deepseek-pro thinking pupil × 8+1 elders) 2026-08-17 07:35:53 +02:00
README.md docs: 8b-is GitHub Sponsors — the profile is public 2026-08-22 07:22:49 +02:00
robots.txt feat(pages): add GitHub Pages landing page and deployment workflow 2026-08-17 10:17:05 +02:00
rss.xml feat(site): client-side E2E in the 8b-is theme — robots, llms.txt, well-known, agents.md, headers, seo, json-ld, rss, constellation footer 2026-08-21 05:03:49 +02:00
site.webmanifest feat(site): client-side E2E in the 8b-is theme — robots, llms.txt, well-known, agents.md, headers, seo, json-ld, rss, constellation footer 2026-08-21 05:03:49 +02:00
train_with_ama.sh feat(ama): the constant bidirectional Q&A — trainee ⟷ Peter, always on 2026-08-21 04:57:17 +02:00
train_with_dream.sh feat(dream-lane): the classroom breathes — dream.vaked.dev + Riva's breath + AMA 2026-08-21 04:06:53 +02:00

classroom-sota-training

The Council of Elders — the golden youth dreams

GitHub Pages Published Model HF Space Explorer License

The Council of Elders (Vének Tanácsa) — a Waldorf-style classroom training pipeline. A thinking-enabled pupil model sits in the middle of the room — the golden youth — and is taught, philosophized with, and capability-built by a council of 8 + 1 open-weights teacher models.

The lanes

The classroom is more than a loss function:

  • The council (CometAPI) — 8 external elders, four Qwen + four DeepSeek, all open-weights, MAX thinking, one OpenAI-compatible API (scripts/cometapi_teacher.py --council).
  • The dream lane — Riva's breathing clock streams dream.vaked.dev: inhale chants OM MANI PADME HUNG, exhale enters the DREAM state and AMAs Peter about the pupil's dreams (scripts/riva_dream.py, train_with_dream.sh).
  • The corpus — dyad-live (memory logs + the dreams), the whole constellation (enthea, dyad-mapping, the papers), and the HF datasets (cogitoergosumma, ultrawhale-dogfood, osc9000-traces) via scripts/capture_dyad.py.
  • The long context — TurboQuant: runtime KV-cache quantization, 100K context on a consumer GPU, the pupil's long memory (docs/turboquant.md).
  • The live status — the landing page polls a webhook server and renders the report on the machine's own wire, ternarySIMDJSON (status/server.py, status/wire.py).

Every byte the classroom speaks is ternary: markdown via mq, text via t3:, JSON via t3j: — the data plane of the universe of training.

Referrals — support the classroom, earn together

lane link reward
opencode Go opencode.ai/go?ref=CMTEVHACZC you both get $5 when a friend subscribes
CometAPI cometapi.com aff kFxG 10% of every friend's payment ($10+)
RunPod runpod.io?ref=v7hg20fc $5 credit bonus per invite
ModelArk byteplus.com ModelArk 10% off, first month from $4.50
DeepSeek tokens platform.deepseek.com up to $30 coupon per referral

The concept

The pupil is not force-fed a single objective function. The elders teach the Waldorf way:

  • they teach — knowledge passed on in each teacher's own modality
  • they philosophize — they discuss meaning, not just token likelihoods
  • they build capability — the pupil learns through understanding, not mimicry: it builds its own internal model, independent of any single teacher's consensus

The deliberation reaches the pupil through a geometric-mean softmax consensus — the elders' "unanimous decision" is not the majority dictating, but a shared, balanced direction.

Architecture

             ┌──────────────────────────────────────────┐
             │    THE COUNCIL OF ELDERS (8 + 1 teachers) │
             │  open-weights models, each with its own   │
             │  logits vote (Qwen3-8B/14B + extended)    │
             └───────────────┬──────────────────────────┘
                             │ geometric-mean softmax consensus
                             ▼
             ┌──────────────────────────────────────────┐
             │         PUPIL (the golden youth)          │
             │  latest deepseek-pro (thinking-enabled)   │
             │  learns in the room, not by imitation     │
             └──────────────────────────────────────────┘
  • Teachers: teacher_logits.py caches faculty logits (Qwen3-8B + Qwen3-14B bf16, tokenizer byte-identical to the pupil's).
  • Training objective: train_quantal_classroom.py — multi-faculty KL, geometric-mean softmax consensus, β-ramp epoch schedule.
  • Support: train_quantal_distill.py (single-teacher), build_corpus_v2.py (corpus), quantal_golden_logits.py / quantal_compare_logits.py (verification).
  • HF Jobs overlay: hf-overlay/ — classroom_train.py (HF Jobs wrapper), harness_eval.py (harness eval for the Dipankar fixed-point test).

Results

Version Training Best val CE
v2 single-teacher (H200) Qwen3-14B 1.8166
classroom (council of elders) Qwen3-8B + Qwen3-14B 1.6120
harness gate (old ckpt, new stack) — 2.1369 (the gain is TRAINING, not harness)

Published model: PeetPedro/quantal-classroom-1.6

The plan (next)

See docs/PLAN.md — the pupil becomes the latest deepseek-pro with thinking, taught by 8 + 1 open-weights teachers (the +1 being the "flash" version of the pupil's own family).

Conventions

  • The pipeline lives under the 8b-is org — our own transformers fork (8b-is/transformers) is the sovereign home base.
  • Every new teacher added = the council grows; the consensus method scales, and teachers can be swapped without the pupil retraining the old ones.

🌐 The Sovereign Constellation


License

Apache-2.0 (verify each teacher base-model's license separately; Qwen3 is Apache-2.0).

Genesis Seal: 7c242080f5f821e5eaf563fe2208d60632c451687baf65f4fe8e4a0d226e3ecf · WE. {-1, 0, +1}. <3

IN OUR TEAM — 8b-is · p === visionary officer · sponsor peterlodri-sec · sponsor 8b-is