Today centered on concrete operator mechanics: Sakana’s recursive self-improvement loop, Goodfire’s live per-token cyber monitors, and more evidence that tiny or typed decision models are becoming a practical layer beside full LLM generation.
Coverage update: Some YouTube sources were unavailable for this edition.
MASS is the clearest new training artifact today: it cycles one model through solver, optimizer, and evaluator roles in a multi-agent loop, then distills the team output back into the base model.
Goodfire claims live Kimi K3 monitors that beat an LLM judge at 50x lower cost, which is exactly the kind of always-on control layer operators can actually deploy.
The pattern from earlier in the week kept getting sharper today: Clef returns option probabilities in one forward pass, while JEV routes easy decisions away from expensive LLM calls and decides whether to research, reply, publish, wait, or escalate.
This is a concrete serving update, not a concept piece: vLLM says Rubin-tuned kernels, locality-aware MoE, and day-0 model support already translate into large throughput gains on NVIDIA’s new box.
This takes a benchmark-style problem set and makes it trainable infrastructure for open RL, even if the current verifier is still strict about exact formalization.
Karpathy says roughly 6 billion people have barely used LLMs, while about 1-2 billion are casual free-tier users and professionals outside math and code often remain in that group.
The model was trained on real and synthetic conversations, then on-policy distilled, and the creator says blind tests picked the humanlike version 23.5% of the time versus 15.1% for the base model.
Commentary in the interview says motion is easier to train in simulation than grasping, and that humans in cameras-on-hands rigs are being used to record manipulation data.
The post says grafting fine-tunes a pre-training checkpoint, then adds the weight difference onto the post-trained model, and reports validation on five model families up to 284B parameters.
The post says a constitution was built for Gemma 3 27B-IT and evaluates whether training generalizes across principles by holding out scenarios for a specific principle.
The post says affine bridges are trained between residual streams of smaller and larger models, with the goal of transferring linear features across architectures.
Commenters dispute Tao’s claims, including one commenter who says the cancer-medicine slide is poorly informed and another who argues some medicines already work without understood mechanisms.
Commenters say the reported cost came from requiring byte-matching decompilation, and argue functional-equivalence decompilation would be much cheaper.
Commenters argue the article’s group borrowing proposal mostly reduces to no-use-after-free, while another says borrow checking’s shared-xor-mutable rule is a feature.
Commenters discuss how Git stores data, including the `du` size and byte options and the fact that identical file contents become a single blob object.
WorldGuide treats procedural video generation as closed-loop task execution and uses an initial image plus a task prompt to decide actions and check completion.
Mohamed Bin Zayed University of Artificial Intelligence · arXiv · code · project
LEGO replaces depth lifting and point-cloud re-rendering with a learned view synthesizer for conditioning video diffusion from a single exocentric recording.
SpatialOPSD internalizes spatial reasoning with on-policy self-distillation from summarized verified execution traces so the model can operate without tools.
The paper reports a V-shaped performance curve in mixed text-image corpora, with irrelevant text degrading retrieval more than an equal number of image documents.
VibeEdit uses spatial marks and optional short notes on the image instead of a separate text prompt to support addition, removal, replacement, attribute change, and movement.
The episode says OpenAI released 372 novel mathematical results at roughly three hours of compute per proof, including partial progress on the Riemann hypothesis.
The dataset packages RL training environments for code, cyber, general knowledge, visual web development, and music tasks with executable tests or rule-based verifiers.
The browser simulator shows a photorealistic globe with live aircraft, ships, satellites, earthquakes, traffic, and public cameras, plus hands-free voice control.
AirLLM says 70B models can run on a single 4GB GPU without quantization, distillation, or pruning, and now supports training very large models on small VRAM.