Wednesday, August 12, 2026

BDH-CQ; Macaron-V1; SWE-Bench ProMax

self-improving-agentson-policy-distillationagent-memorybenchmark-qualityinference-efficiency

Executive Summary

Today's HuggingFace trending papers (from 2026-08-12) are led by BDH-CQ: In-Context Learning with Recurrent Latent Reasoning (247 upvotes), which introduces a novel recurrent latent reasoning approach combining in-context learning with non-verbal iterative computation. Close behind is Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA (223 upvotes), proposing a continual learning framework using frozen base models with Mixture-of-LoRA adapters.

The self-improvement theme dominates: Ouroboros presents a coding agent that rewrites its own core implementation through reviewed commits, while Macaron-V1 targets lifelong adaptation. Simultaneously, benchmark quality is under scrutiny — SWE-Bench ProMax exposes test flaws in 60% of SWE-bench instances and introduces multilingual code refactoring challenges that resist memorization.

On the infrastructure side, Motif 3's 314B MoE model demonstrates fine-grained expert routing at scale, and OasisKV addresses HBM capacity limits for long-context inference. A notable security paper reveals that encrypted chain-of-thought blocks are interchangeable across user sessions, representing a structural vulnerability in how reasoning traces are handled.

Researcher Notes

The self-development loop is closing. Three papers this week — Ouroboros, Macaron-V1, and Evo-Bench — collectively describe a world where agents not only complete tasks but actively improve the infrastructure they run on. Ouroboros commits reviewed changes to its own runtime; Macaron-V1 evaluates successor configurations against an external contract; Evo-Bench benchmarks the meta-capability of LLMs to evolve their own harness. This isn't science fiction — these are working systems with concrete evaluation results.

Unsupervised distillation is reaching maturity. Both the top self-distillation paper (On-Policy Self-Distillation without Any Supervision) and SPOT show that you can extract surprisingly strong post-training signal from a model's own outputs — no ground truth, no teacher labels, no environment feedback. The internal consistency criterion in OPD is particularly elegant: the model converges on answers that are stable across perturbations. This could compress the feedback data requirement dramatically for future fine-tuning pipelines.

MiniMax-H3 is dominating the model leaderboard in a way that's hard to ignore: it appears in six of the top-20 trending model slots simultaneously (base model, ComfyUI wrappers, LoRA adapters, community variants). This kind of ecosystem explosion typically signals a model that genuinely hit a quality-vs-accessibility sweet spot. Kimi-K3 leads on raw likes (10,528) despite being a feature-extraction model, suggesting strong developer interest in embeddings infrastructure.

GitHub trending is an agent-tooling story today. PrimeIntellect's prime-agent (1,138 stars today), agency-agents (958), and Orca's ADE (875) all target the same problem from different angles: how do you manage, orchestrate, and improve a fleet of coding agents? The paperclipai/paperclip repo at 748 stars today reflects the same demand. This is a market forming in real time around agentic infrastructure primitives.

Sleeper hit to watch: Scaling Inherently Interpretable Language Models (Guide Labs, 13 upvotes) is quietly making the case that interpretability doesn't have to be a post-hoc tax on capability. By baking interpretability into the training objective and showing it scales across three orders of magnitude of compute, this could reframe the entire alignment-vs-capability tradeoff conversation. Low engagement now, but the ideas are significant.

Themes & Trends

↑

Self-Improving Agents

rising

Systems that autonomously improve their own code, prompts, and architectures through experience — from Ouroboros's recursive core evolution to Macaron-V1's continual learning framework.

↑

On-Policy Distillation

rising

A wave of methods using a model's own generated data — without external supervision — to improve post-training quality, driven by internal consistency and sparse outcome signals.

↑

Agent Memory Systems

rising

Novel architectures for giving LLM agents persistent, structured memory — including hierarchical distillation from teacher agents and reduced-order RL for memory utility.

→

Benchmark Quality & Saturation

stable

Growing concern about benchmark validity: SWE-Bench ProMax surfaces flawed test suites, while Evo-Bench targets the meta-problem of agents improving evaluation frameworks themselves.

→

Inference Efficiency

stable

Hardware-aware LLM serving innovations: OasisKV scales KV cache beyond HBM with lookahead sparse prefetching; Motif 3 demonstrates fine-grained MoE sparsity at 314B scale.

Trending Papers (13)

BDH-CQ: In-Context Learning with Recurrent Latent Reasoning

High Relevance

Björn Engdahl, Adrian Kosowski, Jan Chorowski, Zuzanna Stamirowska, Przemysław Uznański, Junlin Jiang — Independent Research

We introduce BDH-CQ, a reasoning model that combines in-context learning with recurrent latent reasoning. Inputs presented at inference time continuously update the model's recurrent memory; the model then solves a query through iterative computation in a high-dimensional latent space, without verbalizing its intermediate reasoning. We evaluate the model on the public ARC-AGI-1 evaluation set a...

Key Findings

  • •

    Inputs presented at inference time continuously update the model's recurrent memory; the model then solves a query through iterative computation in a

  • •

    We evaluate the model on the public ARC-AGI-1 evaluation set and use controlled ARC-like interventions to study what it learns from demonstrations, ho

  • •

    A 150M-parameter configuration reaches 29.5% pass@2 at a computed inference cost of $0.0007 per task.

memoryreasoningmodel-arch
247 upvotes

Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA

High Relevance

Mind Lab, Vin Bo, Asher Cai, Jingwei Cao, Song Cao, Vic Cao — Independent Research

Macaron-V1 is an open agent-model family for experiential intelligence: learning from experience in real environments and continuing to learn after deployment. It is organized around two system goals. Adaptation is pursued through recursive improvement of versioned model-harness pairs, where experience from one configuration is evaluated under an external contract and used to construct its succ...

Key Findings

  • •

    It is organized around two system goals.

  • •

    Adaptation is pursued through recursive improvement of versioned model-harness pairs, where experience from one configuration is evaluated under an ex

  • •

    Collaboration is pursued via the Mixture-of-LoRA (MoL) architecture that freezes a base model, composes specialist LoRA adapters, and selects one LoRA

agentsmodel-arch
223 upvotes

SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring

High Relevance

Yuling Shi, Jinghan Xu, Kelin Fu, Wenhao Zeng, Shilin He, Lei Zhang — Independent Research

As AI coding agents take on increasingly complex, long-horizon software engineering tasks, existing benchmarks are rapidly saturating and their evaluation quality has come under serious scrutiny: a recent audit found that nearly 60% of unsolved SWE-bench Verified instances contain flawed tests -- either overly narrow tests that reject correct solutions or overly broad tests that check unstated ...

Key Findings

  • •

    Code refactoring, which requires coordinated, behavior-preserving changes across many files, offers a substantially harder and more realistic test of

  • •

    We introduce SWE-Bench ProMax, an expert-curated, multilingual code refactoring benchmark of 170 instances drawn from real commits across seven progra

  • •

    Every instance undergoes rigorous, multi-stage curation that directly addresses the quality problems identified in prior benchmarks: issue description

agentsbenchmarkscode-generation
117 upvotes

On-Policy Self-Distillation without Any Supervision

Yijiang Li, Bingyang Wang, Yijun Liang, Yunjie Tian, Di Fu, Nuno Vasconcelos — Independent Research

On-policy (Self-)Distillation (OPD / OPSD) has shown strong potential for post-training large language models (LLMs). However, existing methods still rely heavily on external supervision, including ground-truth signals, environmental feedback, or guidance from larger models, and therefore fall short of genuine "self"-distillation. In this study, we show that on-policy self-distillation can be a...

Key Findings

  • •

    However, existing methods still rely heavily on external supervision, including ground-truth signals, environmental feedback, or guidance from larger

  • •

    In this study, we show that on-policy self-distillation can be achieved using only a model's own generations via internal consistency.

  • •

    We propose unsupervised on-policy self-distillation (U-OPSD).

distillationllmmodel-archvision
67 upvotes

Ouroboros: A Self-Developing Frontier Coding Agent with Reviewed Core Evolution

Anton Razzhigaev, Andrei Gritsaev, Andrei Kaznacheev, Nikita Dragunov, Roman Yampolskiy, Andrei Kuznetsov — Inria, University of Louisville

We present Ouroboros, a self-developing agent harness whose tools, prompts, context assembly, and core implementation improve through reviewed commits that become the runtime for later work. Core evolution proceeds in two modes. In recursive free evolution, improvement is itself a task, and completing one evolution cycle can schedule the next.

Key Findings

  • •

    Core evolution proceeds in two modes.

  • •

    In recursive free evolution, improvement is itself a task, and completing one evolution cycle can schedule the next.

  • •

    In experience-driven core evolution, ordinary work and social interaction expose bugs, rough edges, and inefficient context construction that lead to

agents
66 upvotes

Stealing Reasoning Traces from Proprietary LLM APIs

Alexander Panfilov, David Schmotz, Ilia Shumailov, Luca Beurer-Kellner, Joachim Schaeffer, Ameya Prabhu — Google DeepMind, ETH Zurich, UC Berkeley

Leading large language model providers now conceal their models' step-by-step reasoning, or chain-of-thought, to protect intellectual property and limit information leakage. Rather than storing these traces server-side, providers return them to the client as blocks of encrypted text, which the client passes back with each subsequent request. Building on prior research, we identify an architectu...

Key Findings

  • •

    Rather than storing these traces server-side, providers return them to the client as blocks of encrypted text, which the client passes back with each

  • •

    Building on prior research, we identify an architectural vulnerability: these encrypted blocks are fully compatible and interchangeable across differe

  • •

    We exploit this compatibility to develop a scalable decryption jailbreak.

reasoningllmmodel-arch
36 upvotes

Motif 3: Technical Report

Junghwan Lim, Joon Son Chung, Sungmin Lee, Wai Ting Cheung, Gihun Cho, Minsu Ha — Independent Research

We introduce Motif 3, a decoder-only Mixture-of-Experts language model with 314 billion total parameters and 13.2 billion activated per token. Each sparse MoE layer contains 384 routed experts, with eight selected per token. This fine-grained sparsity provides substantial expert capacity while limiting computation.

Key Findings

  • •

    Each sparse MoE layer contains 384 routed experts, with eight selected per token.

  • •

    This fine-grained sparsity provides substantial expert capacity while limiting computation.

  • •

    Motif 3 is built around Grouped Differential Latent Attention (GDLA), which integrates grouped differential attention with the compressed key-value re

model-archmoecode-generation
34 upvotes

Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory

Taeil Kim, Kangsan Kim, Sung Ju Hwang — KAIST, KAIST, KAIST

Memory systems have shown promise for improving agent performance, but their potential remains largely unexplored for small language models, which struggle to generate sufficient successful trajectories on their own. We propose Agent Memory Distillation (AMD), a training-free framework that transfers structured knowledge from a large teacher agent to a small student agent through hierarchical m...

Key Findings

  • •

    We propose Agent Memory Distillation (AMD), a training-free framework that transfers structured knowledge from a large teacher agent to a small studen

  • •

    AMD constructs three complementary memory types from successful teacher trajectories: Workflow memory encodes task-level strategies, Subtask memory pr

  • •

    Workflow and Subtask memories are injected proactively at the start of each task, while Function memory is retrieved reactively upon tool-calling erro

agentsmemorydistillationllm
34 upvotes

Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains

Diandian Zhang, Tingyu Song, Lin Fu, Zheyuan Yang, Yilun Zhao — Independent Research

We introduce Sci-VBench, a comprehensive benchmark for evaluating knowledge- and reasoning-intensive video generation across scientific domains. It contains 1,253 expert-annotated examples spanning 60 subjects across four core disciplines: Natural Science, Healthcare, Humanities & Social Sciences, and Engineering. Each example requires models to generate temporally rich videos that demand scien...

Key Findings

  • •

    It contains 1,253 expert-annotated examples spanning 60 subjects across four core disciplines: Natural Science, Healthcare, Humanities & Social Scienc

  • •

    Each example requires models to generate temporally rich videos that demand scientific reasoning and knowledge-grounded synthesis, going beyond surfac

  • •

    We further establish a rubric-based evaluation protocol.

benchmarksreasoningvideo
23 upvotes

What to Edit Next: Visually Aligned Image-Editing Follow-Up Suggestions in Conversational Systems

Zhijing Zhang, Jinpeng Yu, Xin Song, Bingnan Li, Chuyue Li, Changhui Du — Independent Research

Conversational assistants increasingly recommend follow-up edits to help users continue a task. Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored. In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the current image.

Key Findings

  • •

    Existing systems primarily target text-only interactions, leaving image-creation conversations underexplored.

  • •

    In image-creation tasks, useful follow-up edit suggestions must reflect user preferences, offer diverse directions, and remain executable on the curre

  • •

    We collected 100,000 real multi-turn image-creation conversation samples from Qwen App and found that 80.1% are image-dependent, underscoring the need

language-models
23 upvotes

OasisKV: Scaling In-Decode KV Cache Beyond HBM with Lookahead Sparse Prefetching

Can Xiao, Sukmin Cho, Junbong We, Zhixiong Niu, Jianyi Cheng, Yiren Zhao — Independent Research

Large language model (LLM) inference serving is increasingly constrained by memory rather than compute. As long-context and long-form reasoning workloads become more prevalent, the key-value (KV) cache dominates both memory footprint and memory traffic during LLM token generation, i.e., decode. In particular, HBM capacity has become a scarce and costly resource that heavily limits inference bat...

Key Findings

  • •

    As long-context and long-form reasoning workloads become more prevalent, the key-value (KV) cache dominates both memory footprint and memory traffic d

  • •

    In particular, HBM capacity has become a scarce and costly resource that heavily limits inference batch size and system throughput.

  • •

    This paper presents OasisKV, a memory-centric LLM inference system design that alleviates HBM capacity pressure by decoupling full KV-cache storage fr

memoryreasoningllmmodel-arch
17 upvotes

SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation

Zikun Qu, Min Zhang, Mingze Kong, Zhiwei Shang, Yikun Ban, Shuang Qiu — Independent Research

On-policy distillation (OPD) provides dense teacher supervision on student-generated trajectories, but standard reverse-KL training can assign insufficient probability to other plausible continuations. Teacher entropy alone does not reveal whether uncertainty is concentrated among a few plausible next tokens or dispersed over a long probability tail, nor whether the student already represents t...

Key Findings

  • •

    Teacher entropy alone does not reveal whether uncertainty is concentrated among a few plausible next tokens or dispersed over a long probability tail,

  • •

    Moreover, local teacher probabilities may not predict downstream success.

  • •

    We introduce Sparse Probing and Outcome-calibrated Targets OPD (SPOT), which addresses two coupled decisions, where to probe and what to distill, thro

distillationvision
17 upvotes

Scaling Inherently Interpretable Language Models

Guide Labs Team, Andreas Madsen, Aya Abdelsalam Ismail, Giang Nguyen, Isaac Plant, Muawiz Chaudhary — Guide Labs

Interpretability is often treated as a tax on capability: language models are trained as opaque systems, then explained after the fact, with methods whose reliability is difficult to establish. In this work, we challenge this premise. Rather than reverse-engineering a model, we make interpretability a constraint of the training pipeline, optimized alongside the language modeling objective.

Key Findings

  • •

    In this work, we challenge this premise.

  • •

    Rather than reverse-engineering a model, we make interpretability a constraint of the training pipeline, optimized alongside the language modeling obj

  • •

    Across three orders of magnitude of compute, on both autoregressive and diffusion language models, interpretability scales with capability rather than

model-archinterpretability
13 upvotes

Trending Models (10)

MiniMax-H3

MiniMaxAI · video-generation · Unknown

View on HF

MiniMax-H3 by MiniMaxAI. 59,368 downloads, 3,579 likes on HuggingFace.

diffuserssafetensorstext-to-videoimage-to-video
59.4K downloads3.6K likes
Muse-Glimmer-30B

meta-models · image-text-to-text · Unknown

View on HF

Muse-Glimmer-30B by meta-models. 0 downloads, 1,102 likes on HuggingFace.

transformerssafetensorsmuse_glimmerimage-text-to-text
0 downloads1.1K likes
DeepSeek-V4-Flash-0731

deepseek-ai · text-generation · Unknown

View on HF

DeepSeek-V4-Flash-0731 by deepseek-ai. 1,048,685 downloads, 3,153 likes on HuggingFace.

transformerssafetensorsdeepseek_v4text-generation
1.0M downloads3.2K likes
MiniMax-H3-Turbo-Lora

larryvrh · video-generation · Unknown

View on HF

MiniMax-H3-Turbo-Lora by larryvrh. 0 downloads, 651 likes on HuggingFace.

text-to-videotext-to-audioaudio-videolora
0 downloads651 likes
MiniMax-H3

Comfy-Org · text-generation · Unknown

View on HF

MiniMax-H3 by Comfy-Org. 6,798,796 downloads, 1,213 likes on HuggingFace.

diffusion-single-filecomfyuilicense:other
6.8M downloads1.2K likes
Kimi-K3

moonshotai · feature-extraction · Unknown

View on HF

Kimi-K3 by moonshotai. 1,565,484 downloads, 10,528 likes on HuggingFace.

transformerssafetensorskimi_k3feature-extraction
1.6M downloads10.5K likes
LFM2.5-2.6B

LiquidAI · text-generation · Unknown

View on HF

LFM2.5-2.6B by LiquidAI. 93,668 downloads, 551 likes on HuggingFace.

transformerssafetensorslfm2text-generation
93.7K downloads551 likes

Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUF by DavidAU. 2,521,093 downloads, 1,899 likes on HuggingFace.

ggufunslothfine tuneheretic
2.5M downloads1.9K likes
Minimax-h3-Turbo

lightx2v · video-generation · Unknown

View on HF

Minimax-h3-Turbo by lightx2v. 20,376 downloads, 343 likes on HuggingFace.

diffuserst2vi2vr2v
20.4K downloads343 likes
Muse-Glimmer-30B-GGUF

unsloth · image-text-to-text · Unknown

View on HF

Muse-Glimmer-30B-GGUF by unsloth. 0 downloads, 307 likes on HuggingFace.

transformersggufunslothmeta
0 downloads307 likes

Trending GitHub Repos (12)

A self-improving RLM agent for coding workflows and long-running autonomous tasks.

agentsai
TypeScript14.2K+1.1K today1.5K

A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy injectors to reality checkers. Each agent is a specialized expert with personality, processes, and proven deliverables.

agentsai
Shell143.3K+958 today23.3K

Graph-Native Infrastructure for Context and Accountable AI Systems

aigraph
Python4.9K+893 today532
High RelevanceGitHub

Orca is the ADE for working with a fleet of parallel agents. Run any coding agent with your own subscription. Available on desktop, mobile and VPS.

agentsai
TypeScript42.9K+875 today3.0K

小红书笔记 | 评论爬虫、抖音视频 | 评论爬虫、快手视频 | 评论爬虫、B 站视频 | 评论爬虫、微博帖子 | 评论爬虫、百度贴吧帖子 | 百度贴吧评论回复爬虫 | 知乎问答文章|评论爬虫

code-tools
Python61.7K+855 today12.1K
High RelevanceGitHub

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

tooling
Python34.8K+812 today4.4K

The open-source app everyone uses to manage agents at work

agentsai
TypeScript77.2K+748 today14.3K

Production-grade engineering skills for AI coding agents.

agentsai
JavaScript86.3K+578 today9.3K

Public repository for Agent Skills

agents
Python168.2K+485 today20.0K

World's first open-source, agentic video production system. 12 production pipelines, 100+ tools, 700+ agent skill and production-knowledge files. Turn your AI coding assistant into a full video production studio.

agentsaivideo
Python47.4K+458 today5.9K

Curated list of project-based tutorials

tooling
Python278.5K+401 today35.8K

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

airaggraphcode-tools
Python3.9K+341 today564

Sources Checked

05:24 AM UTC
05:24 AM UTC
05:24 AM UTC