Sunday, July 5, 2026
Program-as-Weights compiles natural-language specs into locally-executable neural artifacts, topping HF Papers with 107 upvotes; agent-memory research (AgenticSTS, AutoMem, SkillCoach, DuoMem) converges on treating memory as a trainable, bounded skill rather than an ever-growing context; hybrid-attention and flow-matching work pushes long-context and diffusion efficiency; and GitHub trending is dominated by a viral wave of Claude Code / agent-skills repositories.
Executive Summary
The July 5th cycle (HF Papers reflect the July 3rd weekend fallback) is anchored by Program-as-Weights, a new paradigm from a Harvard-affiliated team that compiles fuzzy, natural-language-specified functions into compact neural weights that run locally instead of calling an LLM API at inference time — a direct attack on the cost, latency, and reproducibility problems of using LLMs as glue code. Close behind, a cluster of papers reframes agent memory as a first-class, trainable capability: AgenticSTS proposes a bounded-memory contract built from typed retrieval rather than an ever-growing transcript, AutoMem promotes file-system operations to memory actions the model learns to manage, DuoMem distills procedural memory into on-device student models, and SkillCoach introduces self-evolving rubrics for skill-use evaluation. Together they suggest the field is shifting from 'stuff everything into context' toward structured, evaluable, and often distillable memory systems.
A second cluster targets evaluation infrastructure for agents: EvoPolicyGym isolates autonomous policy evolution from open-ended software engineering, AgenticDataBench benchmarks data-science agents, PACE proposes a cheap proxy for expensive agentic benchmarks like SWE-Bench and GAIA, and DiscoBench studies when search agents should ask clarifying questions instead of guessing. On the architecture and generation side, Morphing into Hybrid Attention Models tackles which layers should keep full attention when converting Transformers to hybrid linear-attention models, Multi-Resolution Flow Matching delivers training-free 5x+ diffusion speedups via staged sampling, and WorldDirector decouples semantic motion orchestration from pixel rendering for controllable video world models.
On the model release side, Zhipu's GLM-5.2, Baidu's Unlimited-OCR, Tencent's Hy3 (Hunyuan), NVIDIA's Qwen3.6-27B-NVFP4 quantization and LocateAnything-3B, DeepSeek's V4-Pro-DSpark, and Alibaba Qwen's AgentWorld-35B-A3B all show heavy trending activity, reflecting continued rapid iteration among Chinese labs alongside NVIDIA's quantization tooling. GitHub Trending is notably dominated by non-paper signal: a wave of Claude Code and agent-skills repositories (claude-skills, agent-skills, taste-skill, system_prompts_leaks, codex-plugin-cc) posted some of the largest single-day star gains of the period, indicating that tooling and prompt/skill ecosystems around coding agents are moving faster than the underlying model releases themselves.
Researcher Notes
The most conceptually interesting result of the cycle is Program-as-Weights, which reframes 'fuzzy function' programming — tasks like log alerting, JSON repair, or intent-based ranking that resist clean rule-based implementation — as a compilation target rather than an inference-time LLM call. By compiling a natural-language spec into a compact, locally-executable neural artifact, the authors attack the locality, reproducibility, and cost problems that come from outsourcing every fuzzy decision to a hosted LLM API. This is a meaningfully different framing from prompt engineering or distillation: it treats the neural network as an artifact analogous to a compiled binary, which could matter a great deal for edge deployment and auditability if it generalizes beyond the paper's benchmark tasks.
A striking pattern across four independent papers — AgenticSTS, AutoMem, DuoMem, and SkillCoach — is the convergence on memory as a bounded, structured, and often trainable skill rather than an unbounded append-only log. AgenticSTS's core insight, that memory is 'a contract about what each future decision is allowed to see,' and its typed-retrieval alternative to naive context concatenation, addresses a real failure mode in long-horizon agents where signal from any one memory component becomes impossible to isolate once mixed into a jumbled prompt. AutoMem goes further by promoting file-system operations to first-class memory actions the model itself learns to wield, borrowing directly from the cognitive-science notion of metamemory. DuoMem's dual-space distillation for on-device memory agents is the practical mirror image: it asks how procedural memory competence, once learned by a large teacher, can survive compression onto resource-constrained student models. Taken together, this looks like an emerging subfield — agent memory engineering — that is maturing past ad hoc context-window tricks toward principled, evaluable memory architectures.
On evaluation methodology, PACE's proposal to predict expensive agentic-benchmark performance (SWE-Bench, GAIA) from a small, cheap set of non-agentic capability tests is a pragmatic response to a real bottleneck: full agentic evaluations can cost thousands of dollars and take days. If such proxies hold up under distribution shift as new model families are evaluated, they could meaningfully lower the cost of iterating on agent research. This complements EvoPolicyGym's effort to cleanly separate autonomous policy evolution from general software-engineering progress and DiscoBench's focus on clarification-seeking behavior in deep search agents — all three papers point to a maturing recognition that agent benchmarks today conflate too many capabilities into single scalar scores, and that the field needs sharper, more decomposed measurement tools before further scaling of agent training is worth the compute.
On architecture, Morphing into Hybrid Attention Models addresses a genuinely underexplored design question: existing Transformer-to-hybrid-attention conversion methods pick which layers retain full attention using heuristics (fixed patterns, layerwise scores) that treat each layer's importance in isolation, ignoring interdependence between layers. This is the kind of unglamorous-but-consequential systems question that determines whether long-context efficiency gains from hybrid/linear attention are left on the table. Paired with Multi-Resolution Flow Matching's training-free staged-sampling approach to diffusion acceleration (claiming over 5x speedup with no retraining), the throughline for the cycle's efficiency papers is squeezing more throughput out of existing pretrained models rather than training new ones from scratch — a sensible response to the rising cost of frontier pretraining.
Finally, the GitHub Trending signal this cycle is worth flagging on its own: repositories like claude-skills, agent-skills, taste-skill, and system_prompts_leaks posted some of the largest single-day star increases (600-1,458 stars/day), well outpacing any individual model or paper's engagement. This suggests that the community-facing layer around coding-agent tooling — skills, plugins, leaked system prompts, and agent multiplexers like herdr and gastown — is currently a faster-moving and higher-attention surface than either paper publication or model releases, and is worth tracking as its own trend independent of the research literature.
Themes & Trends
Agent Memory as a Trainable Skill
risingMultiple papers reframe LLM agent memory management as a bounded, structured, and trainable capability rather than an unbounded append-only context, spanning typed retrieval, metamemory, and on-device distillation.
Fuzzy-Function Neural Compilation
risingA new paradigm compiles natural-language function specifications directly into compact, locally-executable neural weights, avoiding per-call reliance on hosted LLM APIs for everyday fuzzy programming tasks.
Agentic Benchmark Proxies and Sharper Evaluation
risingSeveral papers push back on coarse, expensive agentic benchmarks, proposing cheaper proxies, cleaner isolation of specific capabilities, and clarification-aware evaluation to better measure true agent competence.
Hybrid & Long-Context Attention Efficiency
stableWork on converting Transformers into hybrid full/linear-attention models and on interpreting non-literal retrieval heads targets more efficient and better-understood long-context inference.
Efficient and Reward-Aligned Visual Generation
stableTraining-free acceleration techniques and distribution-wise reward finetuning continue to push diffusion and video world models toward faster, more reliable, and better-aligned generation.
Claude Code / Agent-Skills Ecosystem Surge
risingGitHub Trending is dominated by a viral wave of Claude Code and general agent-skills tooling repositories posting some of the largest single-day star gains, outpacing paper and model engagement.
Trending Papers (14)
Program-as-Weights: A Programming Paradigm for Fuzzy Functions
High RelevanceWentao Zhang, Liliana Hotsko, Woojeong Kim, Pengyu Nie, Stuart Shieber et al. — Harvard University
The paper proposes fuzzy-function programming, which compiles a natural-language specification of tasks like log alerting or JSON repair into a compact, locally-executable neural artifact instead of calling an LLM API at inference time. This targets the locality, reproducibility, and cost problems of using hosted LLMs as ad hoc glue code.
Key Findings
- •
Introduces Program-as-Weights, a method for compiling natural-language function specs into small locally-executable neural artifacts
- •
Targets everyday fuzzy programming tasks (log alerting, malformed JSON repair, intent-based ranking) currently outsourced to LLM APIs
- •
Aims to preserve locality, reproducibility, and lower per-call cost compared to hosted LLM inference
AgenticSTS: A Bounded-Memory Testbed for Long-Horizon LLM Agents
High RelevanceXiangchen Cheng, Yunwei Jiang, Jianwen Sun, Zizhen Li, Chuanhao Li et al. — Tsinghua University
AgenticSTS instruments a bounded-memory contract for long-horizon LLM agents in which every decision is made from a fresh, typed-retrieval-assembled prompt rather than an ever-appended transcript of raw observations and tool calls. The testbed isolates the effect of individual memory components that are otherwise jumbled together in naive append-only context.
Key Findings
- •
Proposes a bounded memory contract using typed retrieval instead of raw context concatenation
- •
Demonstrates that naive append-only memory makes individual memory-component effects hard to isolate
- •
Provides an instrumented testbed for studying long-horizon agent memory design choices
EvoPolicyGym: Evaluating Autonomous Policy Evolution in Interactive Environments
High RelevanceZhilin Wang, Han Song, Runzhe Zhan, Jusen Du, Jiacheng Chen et al. — Shanghai Artificial Intelligence Laboratory
EvoPolicyGym introduces Autonomous Policy Evolution as a controlled evaluation setting in which a harness-model agent repeatedly edits an executable policy under a fixed interaction budget, separating this capability from open-ended software-engineering benchmarks. The benchmark is built from compact interactive reinforcement-learning environments.
Key Findings
- •
Defines Autonomous Policy Evolution as a distinct, controlled evaluation setting for agents
- •
Separates policy-editing capability from general software-engineering benchmark scores
- •
Built on compact interactive RL environments for repeated policy-editing evaluation
Morphing into Hybrid Attention Models
High RelevanceDisen Lan, Jianbin Zheng, Yuxi Ren, Xin Xia, Xuanda Wang et al. — ByteDance Seed
This paper studies which layers should retain full attention when converting a Transformer into a hybrid attention model that mixes full and linear attention for long-context efficiency. It argues existing heuristic layer-selection methods treat layer importance in isolation and overlook interdependencies between layers.
Key Findings
- •
Shows Transformer-to-hybrid conversion quality depends critically on which layers keep full attention
- •
Critiques existing heuristic/fixed-pattern and layerwise-scoring selection methods for ignoring layer interdependence
- •
Proposes a selection approach that accounts for interactions between layers during conversion
Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Sampling
High RelevanceXingyu Zheng, Xianglong Liu, Yifu Ding, Weilun Feng, Junqing Lin et al. — Beihang University
The paper presents a training-free, hardware-agnostic multi-resolution generation strategy for text-to-image diffusion models that stages sampling across resolutions to achieve over 5x speedup without any retraining. It analyzes and addresses artifacts caused by latent-space upsampling and selective partial-region modification used by prior multi-resolution methods.
Key Findings
- •
Achieves more than 5x inference speedup for text-to-image diffusion without any training
- •
Identifies quality issues in prior multi-resolution methods caused by latent-space upsampling and selective region edits
- •
Proposes staged sampling as a hardware-agnostic acceleration strategy compatible with existing pretrained diffusion models
AgenticDataBench: A Comprehensive Benchmark for Data Agents
Zhaoyan Sun, Shan Zhong, Daizhou Wen, Jiaxing Han, Guoliang Li et al. — Tsinghua University
AgenticDataBench addresses the lack of rigorous benchmarks for LLM-based data agents that automate data-science workflows, which currently reduce labor-intensive data scientist effort. It provides comprehensive evaluation coverage for automating heterogeneous, raw-data-to-insight pipelines.
Key Findings
- •
Identifies a gap in comprehensive benchmarks for LLM-based data science automation agents
- •
Covers heterogeneous raw-data-to-insight workflows relevant to real data science practice
- •
Aims to enable rigorous, scalable evaluation of data-agent automation quality
WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory
High RelevanceHanlin Wang, Hao Ouyang, Qiuyu Wang, Wen Wang, Qingyan Bai et al. — Alibaba Group
WorldDirector is a controllable video world model framework with persistent dynamic object memory and unrestricted viewpoint exploration, decoupling semantic motion orchestration from pixel-level visual generation. It uses an LLM to coordinate 3D trajectories and camera movement independent of continuous visual observation.
Key Findings
- •
Decouples semantic motion orchestration from pixel rendering, unlike prior entangled world models
- •
Uses an LLM to coordinate 3D object trajectories and camera movement
- •
Supports persistent dynamic object memory and unrestricted viewpoint exploration without continuous visual observation
Breaking Failure Cascades: Step-Aware Reinforcement Learning for Medical Multimodal Reasoning
Junha Jung, Minbyul Jeong, Suhyeon Lim, Sungwook Jung, Jaehoon Yun et al. — KAIST
The paper shows that cascading errors from early-stage reasoning failures are a leading cause of incorrect predictions in medical multimodal reasoning, where current post-training pipelines rely on outcome-centric, final-answer correctness signals. It proposes step-aware reinforcement learning to give credit assignment across the reasoning process rather than only the final answer.
Key Findings
- •
Identifies early-stage reasoning failure cascades as a major source of incorrect clinical predictions
- •
Critiques outcome-centric post-training for sparse credit assignment in medical MLLM reasoning
- •
Introduces step-aware reinforcement learning to optimize the reasoning process directly
SkillCoach: Self-Evolving Rubrics for Evaluating and Enhancing Agentic Skill-Use
Jiayin Zhu, Kelong Mao, Yudong Guo, Dengbo He, Sulong Xu et al. — Renmin University of China
SkillCoach targets the problem that final-verifier success is too coarse to evaluate or train reliable skill-use in LLM agents drawing from overlapping skill repositories encoding SOPs, tool workflows, and validation routines. It introduces self-evolving rubrics that can detect distractor-skill selection, skipped steps, and incorrect workflow composition.
Key Findings
- •
Shows coarse final-verifier success signals fail to distinguish good skill-use from lucky trial-and-error
- •
Introduces self-evolving rubrics for finer-grained agentic skill-use evaluation
- •
Targets failure modes including distractor-skill selection, skipped steps, and incorrect workflow composition
AutoMem: Automated Learning of Memory as a Cognitive Skill
High RelevanceShengguang Wu, Hao Zhu, Yuhui Zhang, Xiaohan Wang, Serena Yeung-Levy et al. — Stanford University
AutoMem treats LLM memory management as a trainable skill (metamemory), promoting file-system operations to first-class memory actions alongside task actions so the model decides how to encode, retrieve, and organize its own knowledge. The memory skill improves along both prompt/schema structure and learned action policy.
Key Findings
- •
Frames memory management as a trainable cognitive skill (metamemory) rather than a fixed mechanism
- •
Promotes file-system operations to first-class memory actions the model itself controls
- •
Improves memory competence along two axes: supporting structure (prompts, schemas) and learned action policy
Logit-Contribution Scoring Identifies Non-Literal Retrieval Heads
Aryo Pradipta Gema, Beatrice Alex, Pasquale Minervini et al. — University of Edinburgh
The paper introduces logit-contribution scoring to identify attention heads that synthesize answers from the meaning of a context span rather than literally copying tokens, addressing a blind spot in existing literal-copy detectors. This matters for interpreting long-context model behavior where synthesis, not verbatim retrieval, is common.
Key Findings
- •
Shows existing retrieval-head detectors miss heads that synthesize rather than literally copy context
- •
Introduces logit-contribution scoring based on what a head writes through output-value projections, not just what it attends to
- •
Improves interpretability of long-context synthesis behavior in LLMs
Optimizing Visual Generative Models via Distribution-wise Rewards
Ruihang Li, Mengde Xu, Shuyang Gu, Leigang Qu, Fuli Feng et al. — Microsoft Research Asia
The paper proposes finetuning visual generative models with distribution-wise rewards rather than conventional sample-wise rewards, which frequently cause reward hacking that degrades image diversity and introduces visual anomalies. Distribution-wise rewards better align generated outputs with the real-world data distribution as a whole.
Key Findings
- •
Shows sample-wise RL reward functions for visual generation frequently cause reward hacking and reduced diversity
- •
Proposes distribution-wise rewards that evaluate alignment against the full real-world data distribution
- •
Demonstrates improved generation quality and diversity over sample-wise reward finetuning
PACE: A Proxy for Agentic Capability Evaluation
Yueqi Song, Lintang Sutawika, Jiarui Liu, Lindia Tjuatja, Jiayi Geng et al. — Carnegie Mellon University
PACE investigates whether performance on expensive agentic benchmarks like SWE-Bench and GAIA, which can cost thousands of dollars and take days per evaluation, can be accurately predicted from a small, carefully selected set of cheap non-agentic capability tests. This offers a low-cost proxy for tracking agentic progress during model development.
Key Findings
- •
Full agentic benchmark evaluations can cost thousands of dollars and take days to run
- •
Proposes a small, curated set of non-agentic tests as a cheap proxy for agentic benchmark performance
- •
Aims to enable faster, lower-cost iteration cycles when tracking agent capability improvements
When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search
Yiling Tao, Shihan Deng, Meiling Tao, Pengzhi Wei, Zhichao Hu et al. — Peking University
DiscoBench addresses the gap between existing search-agent benchmarks, which assume complete and explicit user queries, and real-world deep search where queries are frequently vague, underspecified, or factually incorrect. It evaluates whether search agents can recognize ambiguity and ask clarifying questions instead of propagating errors along multi-step reasoning chains.
Key Findings
- •
Shows existing deep-search benchmarks unrealistically assume complete, explicit user queries
- •
Introduces DiscoBench to evaluate clarification-seeking behavior under vague or incorrect queries
- •
Demonstrates that ambiguity can propagate and compound along multi-step search reasoning chains
Trending Models (12)
Zhipu AI (Z.ai) · text-generation · MoE (size unspecified)
A large text-generation and conversational model from Zhipu's GLM family using a mixture-of-experts architecture with dynamic sparse attention (glm_moe_dsa).
Baidu · feature-extraction · unspecified
Baidu's OCR-oriented feature-extraction model designed for large-scale document and text recognition workloads.
Tencent (Hunyuan) · text-generation · unspecified
The latest Hunyuan-family text-generation model from Tencent, trending sharply on likes despite very early download counts.
Shanghai Artificial Intelligence Laboratory (InternScience) · image-text-to-text · MoE
A mixture-of-experts image-text-to-text agentic model built on a Qwen3.5-MoE backbone, aimed at multimodal agent workflows.
NVIDIA · text-generation · 27B
An NVFP4 quantized version of Qwen3.6-27B produced with NVIDIA's Model Optimizer toolkit, targeting efficient low-precision inference.
DeepReinforce AI · text-generation · 35B
A GGUF-quantized 35B text-generation model from DeepReinforce AI's Ornith series, released under MIT license for local/endpoint deployment.
Google · tabular-regression · unspecified
Google's tabular foundation model supporting zero-shot tabular regression, part of an emerging line of foundation models for structured/tabular data.
DeepSeek AI · text-generation · unspecified
DeepSeek's V4-Pro text-generation model with the DSpark variant, referencing an associated arXiv paper for its architecture/training methodology.
NVIDIA · feature-extraction · 3B
A 3B-parameter feature-extraction model from NVIDIA targeting general-purpose visual/spatial localization tasks, showing very high trending downloads.
Mistral AI · text-generation · 119B-A6B (MoE)
A sparse mixture-of-experts finetune (119B total, ~6B active) built on Mistral's Leanstral-2603 base model, packaged for vLLM serving.
Krea · text-to-image · unspecified
A fast text-to-image diffusion model distilled from Krea-2-Raw for turbo (few-step) generation.
Alibaba (Qwen) · image-text-to-text · 35B-A3B (MoE)
A mixture-of-experts image-text-to-text model from Alibaba's Qwen team purpose-built for agentic, world-model-style multimodal tasks.
Trending GitHub Repos (15)
A privacy-first, fully local AI meeting assistant with fast Parakeet/Whisper live transcription, speaker diarization, and Ollama-based summarization.
A Claude Code skill that gives an AI agent 'good taste,' aiming to stop it from generating boring, generic output.
Extracted system prompts from Anthropic Claude, OpenAI ChatGPT/Codex, Google Gemini, xAI Grok, and other coding assistants, updated regularly.
Production-grade engineering skills for AI coding agents, growing rapidly as part of the broader agent-skills ecosystem.
A plugin that lets Codex be invoked from within Claude Code to review code or delegate tasks, bridging the two coding-agent ecosystems.
An API to search, scrape, and interact with the web at scale, widely used as a data-ingestion backend for LLM agents and RAG pipelines.
An agent multiplexer that lives in your terminal, letting developers manage and coordinate multiple coding-agent sessions.
A large collection of Claude Code skills, agent skills, and plugins spanning engineering, product, research, and business-operations use cases across multiple coding agents.
An AI agent skill that researches any topic across Reddit, X, YouTube, HN, Polymarket, and the web, then synthesizes a grounded summary.
A lightweight, lightning-fast, in-process vector database, useful as an embedded retrieval backend for RAG and agent memory systems.
A multi-agent LLM framework for financial trading, coordinating specialized agent roles for market analysis and decision-making.
A multi-agent workspace manager for coordinating multiple coding agents within a shared environment.
An AI-oriented quantitative investment platform supporting supervised learning, market dynamics modeling, and RL, integrated with Microsoft's RD-Agent for automated R&D.
Anthropic's reference resources and tooling for applying Claude to financial-services use cases.
The simplest, fastest repository for training and finetuning medium-sized GPTs, a long-standing foundational reference implementation.