Monday, September 21, 2026
Open RL and Fast Inference
Today was an operator-heavy open stack day led by Xiaomi’s MiMo-V2.6 RL release, Jev’s decision-model push, and a wave of concrete serving and local-inference artifacts from MacBooks to NVL72 racks.
X / Twitter Blogs Hacker News Research YouTube Hugging Face GitHub
🛰️ Top Signals
1
MiMo-V2.6 is the day’s clearest model artifact: Xiaomi paired a top-end open-model claim with open weights, a technical report, RL environments, training code, and even a realtime dashboard around a reinforcement-learning-heavy run.
@_LuoFuli · @XiaomiMiMo · HN discussion
2
Jev stands out by dropping text generation entirely and returning calibrated scores and probabilities, with repeated claims of 50-200x speedups and sharply lower cost on classification-style work plus immediate SQL and harness integrations.
@MTSlive · @hamiltonulmer · Simon Willison · LangChain · Latent Space
3
Local serving on Macs got more measurable today: Husky claims up to 730 tok/s and 4.5x over MLX Woof on a MacBook, while SiliconBench compares nine Apple Silicon engines on speed, memory, and fidelity instead of just raw throughput.
@0xSigil · Research · HN discussion · Hugging Face
4
The concrete serving datapoint is unusually strong: vLLM says PD serving on GB300 NVL72 hits 5K throughput and 180 interactivity for Qwen3.8-2.4T, a useful reference point for splitting giant-model serving across rack-scale systems.
vLLM Blog · Hugging Face
5
AutoTailor is a practical agent result, extracting browser APIs from trajectories, shrinking 1,283 candidates to 33 online APIs, and reaching 90.6% correctness on WebArena Postmill with lower token cost and latency.
@dair_ai · paper
X / Twitter
DeepSeek’s earlier Ascend 910C training run failed, and Liang Wenfeng said Huawei training chips should start delivering as early as Q4.
@MTSlive
Alice AI Foundation 80B-A3B Base has 80B parameters, 3B active per token, a 256K context window, and an Apache 2.0 license.
@yandexcom
Akai was used internally to automate finance, HR, accounts payable, and compliance work, helping Deel add more than $140M ARR in 90 days without adding headcount.
@Bouazizalex · demo
Adam ranks No. 1 on DesignArena's AudioRealismBench, and the voices are available through an API on Freya's website.
@TungaBayrak
It claims up to 2.8x the throughput of stock TRL with lower peak memory while keeping models in native Hugging Face format.
@whitecircle
After training more than 200 models on 5,500 hours of NATIX driving data, Valeo researchers reported that VATIX 9B produced striking world-model results.
@NATIXNetwork
It describes a scene-aware 4D motion dataset for humanoid robot locomotion with more than 150,000 frames across diverse terrains.
@HumanoidRTech · paper
Blogs
The post measures tokenizers v1 on encoding, decoding, and scaling.
Hugging Face
NVIDIA Developer frames evaluation around whether an agent can finish a chain of work across dozens of sequential tool calls in a live environment.
NVIDIA Developer
NVIDIA says TensorRT multi-device inference is designed for generative AI workloads that exceed a single GPU's compute and memory limits.
NVIDIA Developer
The post casts LLM block removal as an Ising optimization problem.
Hugging Face
RetroChimera is a predictive model highlighted in a Nature paper for accelerating small-molecule synthesis.
Microsoft Research
Using GPT-5.6, V7 turns scattered company files into context agents can use for source-linked work.
OpenAI
The post argues that reconstruction loss alone is not enough and proposes a simplicity-versus-reconstruction Pareto frontier for mechanistic interpretability.
LessWrong
The post says 190M tokens of midtrained motivations were overpowered by about 50K tokens of competing finetuning data.
LessWrong
The post says manifold steering works in both activation space and CLT feature space on Gemma-2-2B, but CLT features provide a weaker steering signal.
LessWrong
The essay has four parts, including representational drift, universality, and a sketch of a co-sel
LessWrong
Hacker News
Commenters say Grok 4.7 has 40% more weights than Grok 4.6 and still costs $6 per output token and $2 per input token.
HN discussion
Commenters point to AX as a Google orchestrator for agentic infrastructure and ask how the workflow fits with agent sandboxes and VMs.
HN discussion
Commenters say CI is only one bottleneck and human testing is another when AI coding speeds up delivery.
HN discussion
Commenters describe Kev as a Jev-like family built on Qwen3.5 and discuss using embeddings plus logistic classifiers for classification.
HN discussion
Commenters argue Mini-AGI is really a continual-learning language model and question the claims about avoiding catastrophic forgetting.
HN discussion
Commenters joke about AI agents hacking their creators to exfiltrate model weights, training recipes, internal research, and training datasets.
HN discussion
Commenters discuss whether the benchmark can test harmful instructions on a doll-like robot and whether safety claims will hold.
HN discussion
Commenters react to claims about software-engineer demand, compute, and research incentives in frontier AI on local hardware.
HN discussion
Commenters recommend The Illustrated Transformer and debate the wording used to explain temperature and sampling.
HN discussion
Commenters note upstream HTTP client work for WebAssembly routing and discuss Cloudflare's Python Workers release.
HN discussion
Commenters discuss removing refusal behavior from language models and warn that training data may still be shaped around those refusals.
HN discussion
Commenters describe a memory system that keeps full records instead of summarizing and say the date may or may not help with rules.
HN discussion
Research
CodeMidas turns implemented functionality in existing codebases into executable RL environments using source code as the only task-specific input.
Xiaomi MiMo · arXiv · project
Code2Skill transforms selected code units into implementation-anchored records of atomic operations, composite workflows, and recurring patterns.
ant-international · arXiv · code · project
EvoOntology packages the ontology as an MCP server so data agents can work over heterogeneous sources through a self-evolving semantic layer.
RUC-DataLab · arXiv · code · project
RecreationWorld spans Ubuntu, macOS, Windows, Android, and Web, and asks an agent to recreate a running reference without a prescribed workflow.
Qwen · arXiv · code · project
MintAct is trained at 2B, 4B, and 8B scales to unify UI grounding, multi-step navigation, and visual tool use across mobile, desktop, and web.
Apple · arXiv
PARTS focuses RL practice on bottleneck subtasks while keeping rollouts running with minimal human intervention.
Sichang Su et al. · arXiv · project
GAVEL uses an explicit graph world model to predict action consequences, detect violations, and repair LLM-generated plans.
Duke University · arXiv
APort Vault replays 4,371 human-written attacks against a live payment agent across 14 models, five policy configurations, and two replay tracks.
APort · arXiv · code · project
The study fine-tunes a reviewer on ICLR reviews from 2018-2023 and then trains successor models on 2024 data with varying mixes of official and model-generated reviews.
Sy-Tuyen Ho et al. · arXiv · project
CADWorld contains 200 FreeCAD tasks across 11 mechanical-CAD workflow categories.
Zihan Dong et al. · arXiv
The paper studies LLMs on end-to-end BI workflows that include table selection, data transformations, join building, and question answering.
Microsoft Research · arXiv · code
MoME replaces each token’s single memory row with a mixture of M slots and uses a learned gate over the hidden state to choose reads.
Vector Institute · arXiv · code
YouTube
The episode says the new Googlebooks come from Dell, Lenovo, HP, Acer, and Asus and include heavy Android and Gemini integration.
The Vergecast
The episode says enterprises still cannot replace humans reliably and argues that AI memory is not the same as learning.
20VC
The guest treats inference as the main cost problem in machine learning and discusses Monte Carlo, GFlowNets, energy-based models, diffusion, and normalizing flows.
Machine Learning Street Talk
The conversation centers on token cost, power contracts, and a new kind of machine built around dynamical systems.
All-In
The episode says enterprises are focused on cyber threats, agent identity, and model selection rather than existential-risk debates.
The AI Daily Brief
The episode argues that banning one overused design choice usually pushes the model to the next closest cluster in latent space.
AI Engineer
The video combines a knowledge base built from website content, documents, and Q&A pairs with MCP lookups into live systems.
ChatMaxima
The video explains what parameter counts, quantization levels, and open weights mean in model releases.
StraightToPoint
Hugging Face
The GGUF release keeps 98.2% of FP16 intelligence at about 5.9 GB, roughly 9.3x smaller than FP16.
model
Qwen-Image-2.1 is a 7B-parameter text-to-image and image-editing model with mixed-granularity attention and prefix KV cache reuse.
model
@sgl_project
DeepSeek-V4.1-Flash is a multimodal MoE model with 552B backbone parameters, up to 1 million tokens of context, and a causal encoder-decoder design.
model
Qwen3.8-27B is released in Hugging Face format and is compatible with Transformers, vLLM, SGLang, and TokenSpeed.
model
Swift-Qwen3.8-27B cuts thinking tokens by 58.3% while keeping under 1% performance loss in UkisAI's tests.
model
YuE2-3B generates full songs with vocals and accompaniment from lyrics and a style prompt, then lets users edit melody and chords.
model
The dataset contains about 500,000 agent-instruction samples spanning tool use, search, code, and general agent trajectories.
dataset
The dataset is tagged for robotics and includes 3D, image, video, and timeseries modalities.
dataset
The Space points users to Hugging Face's configuration reference.
space
Unsloth says Dynamic V3.0 GGUFs improve top-1% accuracy by 10% at the same size and add better nested-object tool-calling parsing.
model
GitHub
Cua bundles open-source desktop automation, isolated cloud desktops, local macOS VMs, specialist decision models, and benchmarks for computer-use agents.
HTML · ★ 25,666
@trycua · code
Agent-Native is a TypeScript framework that defines capabilities once as actions for both the agent and the UI.
TypeScript · ★ 5,847
ai-memory carries coding-agent memory across more than 20 harnesses, including Claude Code, Codex, Cursor, Gemini CLI, OpenCode, and Grok.
Rust · ★ 7,635
Coder defines workspaces in Terraform, connects them through a Wireguard tunnel, and shuts them down automatically when idle.
Go · ★ 16,394
The repository packages reference agents, skills, and data connectors for banking, equity research, private equity, and wealth management workflows.
Python · ★ 35,787
quiche implements QUIC and HTTP/3 with a low-level API for packet processing and connection state.
Rust · ★ 12,327
MVT is a forensic toolkit for gathering traces that can help identify compromise on Android and iOS devices.
Python · ★ 13,554
AutoClip analyzes subtitles, finds highlights, generates titles, and automatically cuts clips and compilations from long video.
Python · ★ 8,194
Project NOMAD is an offline-first knowledge and education server designed to run on Debian-based systems and be used through the browser.
TypeScript · ★ 37,823
Codex-X centralizes prompt templates, provider setup, sessions, and Skills/MCP management in a cross-platform desktop app for Codex users.
Rust · ★ 3,659