Thursday, July 2, 2026

SenseTime's Orca world foundation model dominates with 178 upvotes; speculative decoding innovations from BlockPilot and Multi-Block Diffusion accelerate inference; agent infrastructure consolidates on GitHub with agency-agents crossing 123K stars

world-foundation-modelsspeculative-decoding-innovationsagent-memory-and-skill-evolutionon-policy-distillationagent-infrastructure-platformsgguf-model-distribution

Executive Summary

Today's AI research landscape is headlined by SenseTime and Shanghai AI Lab's Orca, a world foundation model using Next-State-Prediction that drew massive community attention with 178 upvotes — the highest-engagement paper of the day by a wide margin. The paper proposes learning world dynamics directly in a model's latent space, representing a significant push toward general-purpose world simulators. Alongside Orca, two complementary papers on efficient inference stand out: BlockPilot introduces instance-adaptive policy learning for diffusion-based speculative decoding, and Multi-Block Diffusion extends block diffusion language models with inter-block parallelism, together signaling a maturing field of non-autoregressive acceleration methods.

On the agent and distillation front, ByteDance's Dockerless continues to gain traction (now 86 upvotes) as the environment-free verification paradigm gains broader recognition, while DOPD from CUHK/Skywork AI further refines on-policy distillation with its privilege illusion analysis. A notable cluster of papers addresses agent memory and skill evolution: SkillHone proposes persistent decision history for continual skill improvement, the AFTER benchmark evaluates procedural memory in LLM agents, and RL with Metacognitive Feedback teaches models uncertainty awareness through reinforcement learning.

GitHub trending remains agent-infrastructure-heavy, with agency-agents maintaining its dominant position at 123K stars and 2,114 new stars today. New entrants include Facebook's astryx design system (agent-ready), TencentCloud's CubeSandbox for AI agent sandboxing, and the council-of-high-intelligence multi-AI deliberation framework. The model ecosystem sees continued consolidation around GLM-5.2, Ornith-1.0, and GGUF-quantized community variants, while Baidu's Unlimited-OCR surges past 630K downloads and NVIDIA's LocateAnything-3B approaches 900K.

Researcher Notes

Orca is the standout paper of the day and potentially the week. SenseTime and Shanghai AI Lab's world foundation model drew 178 upvotes — more than double the next-highest paper — suggesting the community sees Next-State-Prediction as a meaningful advance over prior world model approaches. The core idea of learning world dynamics via state prediction in latent space rather than pixel-level reconstruction aligns with a broader trend toward abstract, compact world representations. If the model generalizes across diverse physical scenarios as claimed, it could become a foundational component for robotics planning, autonomous driving simulation, and game AI. The 'world is in your mind' framing is ambitious but directionally consistent with where embodied AI research is heading.

Speculative decoding is entering a second wave of innovation. BlockPilot's instance-adaptive approach addresses a real weakness in vanilla speculative decoding: fixed block sizes waste compute on easy tokens and bottleneck on hard ones. By learning per-instance policies for block size selection, BlockPilot essentially makes speculative decoding 'intelligent' about when to be aggressive vs. conservative. Meanwhile, Multi-Block Diffusion from Fudan extends the block diffusion paradigm with inter-block parallelism, attacking the same latency problem from a non-autoregressive angle. Together with yesterday's inference optimization papers, we are seeing a diversification of the inference acceleration toolkit beyond simple quantization and pruning.

Agent memory and skill acquisition are crystallizing as distinct subfields. Three papers today tackle different aspects of this challenge: SkillHone proposes persistent decision history for continual skill evolution (learning from past mistakes), the AFTER benchmark provides systematic evaluation of procedural memory (can agents remember how to do things?), and RL with Metacognitive Feedback teaches models to express uncertainty accurately. These complement rather than compete — an ideal agent would need all three capabilities. The emergence of dedicated benchmarks like AFTER suggests the field is maturing past proof-of-concept into systematic evaluation.

The VLA knowledge retention question is important and underexplored. The 'Does VLA Even Know the Basics?' paper (41 upvotes) asks whether Vision-Language-Action models retain fundamental visual and spatial knowledge when fine-tuned for robotic action. The Act2Answer protocol for testing this is clever — converting action tasks into question-answering to probe underlying knowledge. If VLAs are losing basic capabilities during action fine-tuning, it suggests current training pipelines may be creating capable-but-brittle robots. This has practical implications for deployment safety.

GitHub's agent infrastructure trend is consolidating rather than expanding. While yesterday saw new entrants like Agent-Reach surge, today's trending is more about established projects maintaining momentum: agency-agents (2,114 stars today), strix (1,211), herdr (609), google/agents-cli (586). The notable new signal is Facebook's astryx — an agent-ready design system at 708 stars today — which suggests major tech companies are now building UI frameworks with agent consumption as a first-class use case, not an afterthought. TencentCloud's CubeSandbox (79 stars today) similarly indicates enterprise investment in secure agent execution environments.

Themes & Trends

World Foundation Models

rising

Orca's Next-State-Prediction paradigm for learning world dynamics in latent space represents a major push toward general-purpose world simulators, with massive community engagement (178 upvotes) signaling broad interest in abstract world representations for robotics, simulation, and embodied AI.

Inference Acceleration Beyond Quantization

rising

BlockPilot's instance-adaptive speculative decoding and Multi-Block Diffusion's inter-block parallelism represent a diversifying toolkit for inference optimization. The field is moving past simple quantization toward intelligent, adaptive acceleration strategies.

Agent Memory, Skills, and Metacognition

rising

Three complementary papers address different aspects of agent cognitive infrastructure: SkillHone (persistent skill evolution), AFTER (procedural memory benchmarking), and RL with Metacognitive Feedback (uncertainty awareness). The emergence of dedicated benchmarks signals maturation from proof-of-concept to systematic evaluation.

Agent Infrastructure Consolidation

stable

GitHub trending is dominated by agent infrastructure at all layers: agency-agents (orchestration), herdr (multiplexer), google agents-cli (deployment), OmniRoute (gateway), CubeSandbox (security), and astryx (agent-ready UI). The ecosystem is consolidating around production-grade tooling rather than spawning new categories.

On-Policy Distillation Refinement

stable

DOPD's advantage-aware dual supervision continues the rapid theoretical maturation of on-policy distillation, building on privilege illusion analysis to deliver more robust teacher-student training across LLM and VLM settings.

GGUF-First Model Distribution

stable

The pattern of immediate GGUF quantization for every notable model release persists across Ornith-1.0, Qwythos-9B, and Gemma-4 variants. Qwythos-9B-GGUF surpassed 1.1M downloads, confirming llama.cpp as the de facto local inference runtime for open-weight models.

Trending Papers (14)

Orca: The World is in Your Mind

High Relevance

Yihao Wang, et al. SenseTime, Shanghai AI Laboratory

Proposes a world foundation model based on Next-State-Prediction that learns world dynamics in latent space. The model aims to capture generalizable physical and spatial reasoning without pixel-level reconstruction, enabling applications in robotics, simulation, and embodied AI.

Key Findings

  • Next-State-Prediction paradigm learns abstract world dynamics in latent space rather than pixel-level reconstruction

  • Demonstrates generalization across diverse physical scenarios including object interactions and spatial reasoning

  • Achieves highest community engagement of the day with 178 upvotes, indicating strong perceived significance

world-modelsfoundation-modelsnext-state-predictionembodied-aisimulation
178 upvotes

Dockerless: Environment-Free Program Verifier for Coding Agents

High Relevance

Wenhao Zeng, et al. ByteDance

Proposes an environment-free agentic patch verifier that evaluates code patches without executing them, using evidence gathered through agentic repository exploration. Enables a fully environment-free post-training pipeline for coding agents that matches Docker-based approaches.

Key Findings

  • Outperforms the strongest open-source verifier by 14.3 AUC points on a verifier evaluation benchmark

  • Achieves 62.0%, 50.0%, and 35.2% resolve rates on SWE-bench Verified, Multilingual, and Pro respectively

  • Enables fully environment-free SFT trajectory filtering and RL reward computation, matching Docker-based post-training

coding-agentsprogram-verificationSWE-benchreinforcement-learningpost-training
86 upvotes

DOPD: Dual On-policy Distillation

High Relevance

Xinlei Yu, et al. Chinese University of Hong Kong, Skywork AI

Introduces an advantage-aware dual distillation paradigm that dynamically routes token-level supervision between privileged teacher and privileged student policies based on their advantage gap, addressing the 'privilege illusion' failure mode in on-policy distillation.

Key Findings

  • Identifies 'privilege illusion' — a failure mode where students conflate transferable capability gaps with information asymmetry

  • Dynamic token-level routing assigns different supervision strength, objective, and strategy per token

  • Consistently outperforms vanilla OPD across both LLM and VLM settings with improved stability

on-policy-distillationknowledge-distillationLLM-trainingvision-language-models
76 upvotes

BlockPilot: Instance-Adaptive Policy Learning for Diffusion-based Speculative Decoding

High Relevance

Hao Zhang, et al. Tsinghua University

Proposes an instance-adaptive policy learning framework that dynamically selects block sizes for diffusion-based speculative decoding, replacing fixed block sizes with learned per-instance policies that balance throughput and quality.

Key Findings

  • Learns per-instance policies for block size selection, making speculative decoding adaptive to input difficulty

  • Outperforms fixed-block-size speculative decoding on throughput-quality trade-off across multiple benchmarks

  • Demonstrates that aggressive block sizes benefit easy tokens while conservative sizes are needed for complex tokens

speculative-decodingdiffusion-modelsinference-optimizationadaptive-computation
67 upvotes

Does VLA Even Know the Basics?

High Relevance

Nikita Kachaev, et al. AIRI, HSE University

Investigates whether Vision-Language-Action models retain fundamental visual and spatial knowledge after fine-tuning for robotic action, introducing the Act2Answer protocol to convert action tasks into question-answering for probing underlying knowledge retention.

Key Findings

  • VLA models often lose basic visual and spatial knowledge during action-oriented fine-tuning

  • Act2Answer protocol enables systematic testing of knowledge retention by converting actions to QA format

  • Findings suggest current VLA training pipelines may create capable-but-brittle robotic agents

vision-language-actionroboticsknowledge-retentionevaluationembodied-ai
41 upvotes

Scenes as Objects, Not Primitives

Mijin Yoo, et al. Sungkyunkwan University

Proposes instance-structured 3D tokenization from unposed views, treating scenes as compositions of objects rather than low-level primitives. Enables structured 3D scene understanding without requiring camera pose estimation.

Key Findings

  • Instance-structured tokenization captures 3D scenes as object-centric representations from unposed views

  • Eliminates the need for camera pose estimation in 3D scene understanding pipelines

  • Demonstrates competitive performance on scene reconstruction and understanding benchmarks

3d-visionscene-understandingobject-centrictokenizationpose-free
36 upvotes

GEAR: Guided End-to-End AutoRegression for Image Synthesis

Bin Lin, et al. Zhejiang University, ByteDance

Introduces joint tokenizer-generator training for autoregressive image synthesis, where the tokenizer and generator are co-optimized end-to-end rather than trained in separate stages, improving coherence and quality of generated images.

Key Findings

  • Joint training of tokenizer and generator eliminates the information bottleneck of two-stage approaches

  • End-to-end optimization produces more coherent visual tokens aligned with the generator's capabilities

  • Achieves state-of-the-art results on image generation benchmarks with improved sample efficiency

image-generationautoregressive-modelstokenizationend-to-end-training
28 upvotes

Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks

High Relevance

Young-Jun Lee, et al. University of Minnesota

Introduces a mid-training paradigm that teaches LLMs to evolve solutions across optimization tasks by converting evolutionary search trajectories into supervision, enabling cross-task generalization for discovery agents.

Key Findings

  • Models trained with EFT surpass base counterparts by 10.22% on average across 22 held-out optimization tasks

  • Finch Collection dataset provides 156K trajectories spanning 10 domains and 371 optimization tasks

  • When paired with test-time RL, matches state-of-the-art on circle-packing and outperforms on Erdos minimum-overlap

evolutionary-searchoptimizationmeta-learningmid-trainingdiscovery-agents
23 upvotes

Multi-Block Diffusion Language Models

Yijie Jin, et al. Fudan University

Extends block diffusion language models with inter-block parallelism, enabling multiple text blocks to be generated simultaneously while maintaining coherence through learned inter-block coordination mechanisms.

Key Findings

  • Inter-block parallelism enables simultaneous generation of multiple text blocks for faster inference

  • Learned coordination mechanisms maintain coherence across parallel-generated blocks

  • Complements speculative decoding as an alternative non-autoregressive acceleration approach

diffusion-modelslanguage-modelsparallel-generationinference-optimization
22 upvotes

SkillHone: Continual Agent Skill Evolution Through Persistent Decision History

Zhiwei Li, Yong Hu Independent Researchers

Proposes a continual skill improvement framework for agents that leverages persistent decision history, enabling agents to learn from past successes and failures across tasks rather than starting from scratch each time.

Key Findings

  • Persistent decision history enables agents to accumulate and refine skills across task episodes

  • Continual evolution outperforms episodic approaches that discard inter-task learning signals

  • Framework is agent-architecture-agnostic and applicable to diverse task domains

agent-skillscontinual-learningdecision-historyskill-evolution
21 upvotes

MemLearner: Learning to Query Context Memory for Video World Models

Jiwen Yu, et al. Peking University, Beijing Institute for General Artificial Intelligence

Proposes a learning-based context querying mechanism for video world models that replaces hand-crafted memory retrieval with learned attention over context memory, improving temporal consistency in video generation.

Key Findings

  • Learned context querying outperforms hand-crafted retrieval for video world model memory access

  • Improves temporal consistency and long-range coherence in video generation

  • Demonstrates scalability to longer video sequences through efficient memory management

video-generationworld-modelsmemory-mechanismscontext-learning
18 upvotes

RL with Metacognitive Feedback for Faithful Uncertainty Expression

High Relevance

Gabrielle Liu, et al. Google Research, Yale University

Teaches LLMs to express uncertainty faithfully through reinforcement learning with metacognitive feedback, enabling models to calibrate their confidence expressions based on their actual knowledge state rather than defaulting to overconfidence.

Key Findings

  • RL with metacognitive reward signals significantly improves calibration of LLM uncertainty expressions

  • Models learn to distinguish between what they know and what they are uncertain about

  • Approach generalizes across domains without requiring explicit uncertainty labels in training data

uncertainty-quantificationmetacognitionreinforcement-learningcalibrationLLM-safety
16 upvotes

Managing Procedural Memory in LLM Agents (AFTER benchmark)

Julia Belikova, et al. Yandex, HSE University

Introduces the AFTER benchmark for systematically evaluating procedural memory in LLM agents — the ability to remember and correctly apply learned procedures across diverse task contexts over extended interaction histories.

Key Findings

  • AFTER benchmark provides standardized evaluation of procedural memory retention and application

  • Current LLM agents show significant degradation in procedural memory over extended interactions

  • Identifies key failure modes including procedure conflation, recency bias, and context interference

LLM-agentsprocedural-memorybenchmarksevaluationlong-context
17 upvotes

DataEvolver: Self-Evolving Multi-Agent Data Construction for Text-Rich Image Generation

Siyu Yan, et al. ByteDance

Proposes a self-evolving multi-agent data construction pipeline for text-rich image generation that automatically generates, validates, and refines training data for models that render text within images.

Key Findings

  • Multi-agent pipeline autonomously constructs high-quality training data for text-in-image rendering

  • Self-evolving mechanism improves data quality iteratively without human annotation

  • Significantly improves text rendering accuracy in generated images compared to manually curated datasets

image-generationtext-renderingdata-constructionmulti-agentself-evolving
17 upvotes

Trending Models (12)

GLM-5.2

Zhipu AI (zai-org) · text-generation · MoE

View on HF

Latest generation GLM MoE architecture continuing to consolidate its position as a leading open-weight model with 3,171 likes, the highest-liked model in today's trending.

moeconversationaltransformers
160.0K downloads3.2K likes
gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

yuxinlu1 (Community) · text-generation · 12B

View on HF

GGUF-quantized Gemma 4 12B fine-tuned for coding with Fable 5 and Composer 2.5, maintaining top position among community coding models at 2,553 likes and 597K downloads.

ggufgemma4coding
597.1K downloads2.6K likes
LocateAnything-3B

NVIDIA · image-feature-extraction · 3B

View on HF

Compact 3B-parameter model for image feature extraction and spatial localization, approaching 900K downloads with sustained community adoption at 2,547 likes.

nvidiavisionlocalization
896.1K downloads2.5K likes
Unlimited-OCR

Baidu · feature-extraction · Unknown

View on HF

Vision-language model for comprehensive OCR capabilities, surging past 630K downloads with accelerating adoption and 1,580 likes.

ocrvision-languagemultilingual
630.2K downloads1.6K likes
Qwythos-9B-Claude-Mythos-5-1M-GGUF

Empero AI · text-generation · 9B

View on HF

GGUF-quantized reasoning model with 1M context window, leading by raw downloads at over 1.1M. Strong community adoption for local reasoning workloads.

ggufreasoninglong-context
1.1M downloads1.2K likes
gemma-4-12B-agentic-fable5-composer2.5-v2-GGUF

yuxinlu1 (Community) · text-generation · 12B

View on HF

Agentic variant of Gemma 4 12B fine-tuned for coding and terminal tasks, with 920 likes and 289K downloads reflecting strong demand for agent-capable local models.

ggufgemma4agenticcoding
288.7K downloads920 likes
Ornith-1.0-35B-GGUF

DeepReinforce AI · text-generation · 35B

View on HF

GGUF-quantized 35B parameter model from the Ornith family, with 234K downloads and 611 likes showing broad adoption across the model size range.

gguftext-generationopen-weights
233.7K downloads611 likes
Qwen-AgentWorld-35B-A3B

Alibaba Qwen · image-text-to-text · 35B (3B active)

View on HF

Agent-specialized 35B MoE model with 3B active parameters for multimodal agent tasks. Signals Alibaba's continued investment in agent-native model architectures with 497 likes.

qwenagentsmoemultimodal
34.4K downloads497 likes
Krea-2-Turbo

Krea · text-to-image · Unknown

View on HF

Turbo variant of the Krea-2 image generation model optimized for faster inference in text-to-image generation, with 438 likes and 57K downloads.

diffuserstext-to-imageimage-generation
57.0K downloads438 likes
Ornith-1.0-9B-GGUF

DeepReinforce AI · text-generation · 9B

View on HF

GGUF-quantized 9B parameter Ornith model for local inference, with 191K downloads and 368 likes making it the most accessible entry point to the Ornith family.

gguftext-generationopen-weights
191.4K downloads368 likes
DeepSeek-V4-Pro-DSpark

DeepSeek AI · text-generation · Large MoE

View on HF

DSpark variant of DeepSeek-V4-Pro, continuing DeepSeek's expansion of their V4 model family with 277 likes despite relatively modest download numbers.

deepseektext-generationtransformers
7.6K downloads277 likes
GLM-5.2-NVFP4

NVIDIA · text-generation · MoE (FP4 quantized)

View on HF

NVIDIA's FP4-quantized variant of GLM-5.2, providing efficient deployment of the GLM architecture on NVIDIA hardware with 137K downloads.

nvidiaquantizationglmfp4
136.9K downloads200 likes

Trending GitHub Repos (15)

Complete AI agency framework with specialized expert agents, maintaining dominant position on GitHub trending with 2,114 new stars today and over 123K total stars.

agentsai-agencyframeworkmulti-agent
Shell123.6K+2.1K today20.1K
High RelevanceGitHub

Open-source AI penetration testing tool for automated vulnerability discovery and remediation, surging with 1,211 new stars today.

securitypenetration-testingai-securityvulnerability-scanning
Python29.8K+1.2K today3.2K

Microsoft's 24-lesson AI curriculum crossing 50K stars, reflecting sustained demand for structured AI education materials.

educationtutorialsmicrosoftai-fundamentals
Jupyter Notebook50.5K+1.1K today10.3K

Free AI gateway providing one endpoint to 231+ providers with token compression, smart fallback, and MCP/A2A support. Crossed 9.5K stars with 1,010 new today.

ai-gatewayroutingtoken-compressiondeveloper-tools
TypeScript9.6K+1.0K today1.5K
High RelevanceGitHub

Facebook's open-source design system that is fully customizable and agent-ready, signaling major tech companies building UI frameworks with AI agent consumption as a first-class use case.

design-systemfacebookagent-readyui-framework
TypeScript2.7K+708 today140

Personal AI trading agent from HKU continuing the multi-day trend of AI-powered financial trading tools, with 694 new stars today.

financetradingagentsautonomous
Python16.6K+694 today2.8K

Extension of the browser-use framework enabling coding agents to edit videos, expanding agent capabilities into multimedia production workflows.

agentsvideo-editingbrowser-automationmultimedia
Python13.2K+693 today1.7K

Agent multiplexer for concurrent management of multiple AI agents from a single terminal interface, with 609 new stars today.

agentsterminalmultiplexerdeveloper-tools
Rust9.6K+609 today567

Google's CLI and skills framework for creating, evaluating, and deploying AI agents on Google Cloud, with 586 new stars today.

google-cloudagentsclideployment
Python4.6K+586 today483

Fastest macOS dictation app with on-device speech-to-text and custom AI enhancement model, providing a local alternative to cloud-based dictation.

speech-to-textmacoson-devicedictation
Swift5.5K+572 today332
High RelevanceGitHub

Allen AI's toolkit for PDF linearizing optimized for LLM consumption, maintaining strong traction at 18K stars with 334 new today.

ocrpdf-processingllm-toolsdocument-ai
Python18.3K+334 today1.5K

Converts PDFs and books into Claude Code skills, enabling knowledge extraction and operationalization of reference materials for AI coding assistants.

claude-codeskillsknowledge-extractiondeveloper-tools
Python7.4K+192 today914

Multi-AI persona deliberation framework where multiple AI models with distinct perspectives debate and synthesize responses, gaining 161 new stars today.

multi-agentdeliberationensemblereasoning
Shell2.7K+161 today245

LangChain's agent harness framework at 25.5K stars, providing production-grade agent orchestration and evaluation infrastructure.

langchainagentsorchestrationframework
Python25.5K+80 today3.6K

Tencent Cloud's sandbox environment for secure AI agent execution, reflecting enterprise investment in controlled agent runtime infrastructure.

sandboxagentssecuritytencent
Rust6.8K+79 today570

Sources Checked

03:00 PM UTC
03:00 PM UTC
03:00 PM UTC