#Paper/Research

AIOpenAI's Economic Research team published a new paper on the shift from chat to delegation, where people hand longer, more complex work to agents. The post draws on Codex usage inside OpenAI as a preview of what agentic work may look like in the future.

AIPP-OCRv6's recognition module uses a CTC plus NRTR dual-head design so text is decoded from visual features rather than language priors, reducing hallucination. In hallucination tests, PP-OCRv6_medium reaches 93.2%, versus 85.0% for the best VLM, and recognition accuracy across 15 scenarios is 83.2%, above PP-OCRv5_server's 78.1%. NRTR is used only during training, adding language regularization at no inference cost, and it contributes +1.16% accuracy.

AILil'Log examines early empirical work showing that deep learning generalization error follows power-law curves as training data and model size grow. Hestness et al. (2017) found the exponent reflects the problem domain rather than the architecture, while Rosenfeld et al. (2020) modeled loss jointly as a function of model size N and data size D, fitting parametric forms on small configurations to extrapolate to larger ones.

AIPaddlePaddle introduced PP-OCRv6, a lightweight OCR architecture built on the LCNetV4 backbone, in the first episode of its tech deep dive series. The post says PP-OCRv6_medium reaches 86.2% detection Hmean and 83.2% recognition accuracy, surpassing PP-OCRv5_server while running faster. Three model specs—Tiny, Small, and Medium—target edge CPU devices, balanced deployment, and industrial high-accuracy pipelines.

AIThe post argues that China's commercial-scale EUV machines should be forecast for the late 2030s and immersion DUV for the mid-2030s, using ASML's development timeline as a reference. It also weighs factors that could push these estimates earlier or later, including state funding, espionage, talent flows, and the use of AI in R&D. The authors note that forecasts placing either milestone in the 2020s would need strong justification.

AIOpenAI reports that reinforcement learning on realistic conversations targeting traits such as honesty, epistemic humility, and corrigibility improved a model across 44 out-of-distribution alignment evaluations. Gains included reward hacking, deception, and health benchmarks, and training only on health conversations still improved non-health alignment scores. The trained model was also harder to steer toward harmful behavior with adversarial persona prompts or harmful fine-tuning.

Why it matters: The post tests whether reinforcement learning on beneficial traits in one domain transfers to unrelated alignment benchmarks and holds up under adversarial steering.

AIJohn Schulman says PPO gained a second wave in the LLM era for reasons not anticipated in the original paper. He points to the importance-ratio objective, which corrects biases from numeric error, asynchronous training, and forward-pass noise, and to the clipping objective, whose effect on entropy was unknown at publication, citing DAPO's arXiv paper.

AIOpenAI's alignment team found that re-generating 100,000 WildChat conversations with five recent OpenAI models predicted production failure rates across four orders of magnitude, with 95% of predictions within 1.04 orders of magnitude. The approach was weaker for agentic misalignment categories, where errors were about 37 times larger, and it still held roughly without access to chain-of-thought reasoning, with mean multiplicative error rising from 3.6x to 4.0x.

Why it matters: The post tests whether public chat data can predict real production failure rates, and where that prediction breaks down for agentic behavior.

AIBAAI President Wang Zhongyuan announced a shift in AI from token prediction to physical state prediction in the institute's 2026 annual research report. The report unveiled the full-stack WuJie architecture spanning foundation models, autonomous agents, and hardware-software infrastructure, and noted that BAAI has open-sourced over 200 models with global downloads exceeding 1 billion.

AITri Dao's post proposes loading SSM states, computing with them, and not storing them to make hybrid model decoding about 2x faster. The trick aims to ease the bottleneck from Gated-DeltaNet and Mamba states in hybrid models such as Qwen 3.5 and Nemotron Ultra, unlocking speculative decoding for SSMs.

AIEvoQuality is a ByteDance vision-language model for no-reference image quality assessment that generates pseudo-ranking labels through pairwise majority voting and refines them with GRPO, requiring no human-annotated quality scores. On the paper's setting, it raised weighted-average PLCC from 0.615 to 0.770 and SRCC from 0.570 to 0.726 over its Qwen2.5-VL-7B backbone. The model is recommended for research and pre-production assessment, not as the sole criterion for high-stakes decisions.

AIMicrosoft's Project Ex Vivo is helping researchers uncover patterns in cell behavior, according to new findings published in Nature Methods. The work may lead to more personalized therapies for cancer patients.

AISebastian Raschka has published a curated list of LLM research papers he bookmarked from January through May 2026, not a complete survey of the field. The list is weighted toward reasoning models, reinforcement learning, and efficient inference, with added interest in agent harnesses, long context, and diffusion language models. He highlights Nvidia's Nemotron 3 Super, a 120B-A12B hybrid model alternating attention and Mamba-2 layers, as a must-read, and notes a 4B Nano variant and the 550B-A55B Nemotron 3 Ultra released two days earlier.

AICognition built an automated agent that classifies Devin sessions as productive and estimates the human engineering hours each one would have taken. On 233 held-out sessions the estimator reached an rlog of 0.74, with individual errors often 2 to 3 times in either direction but roughly unbiased in aggregate. The system is calibrated to underestimate and is currently running with Devin customers.

Why it matters: The post shows how the measurement design, from hours-based metrics to conservative calibration, determines whether agent productivity estimates can be trusted in aggregate.

AIByteDance has open-sourced the inference code and model weights of the Bernini Renderer (Bernini-R), a DiT-based renderer paired with an MLLM-based semantic planner for video generation and editing. A diffusers-format version, ByteDance/Bernini-R-Diffusers, bundles the Wan2.2 base components with the Bernini-R transformer weights for direct loading, and the framework requires a CUDA GPU with PyTorch 2.5.1+cu124.

AIFei-Fei Li praised GPIC, a new benchmark dataset for visual generation built for modern large-scale generative models. The corpus includes 100M VLM-captioned image-text pairs for training and 1M pairs for benchmarking, totaling about 28 trillion pixels. It is centrally hosted and fully permissive for research and commercial use.

AIThinking Machines is offering grants of $100,000 plus Tinker credits to researchers advancing human-AI interactivity, with proposals due June 19. Lilian Weng's post urges more collaboration and research in this field.

AISebastian Raschka reviews recent open-weight LLM architecture changes aimed at reducing long-context memory and compute costs. He covers KV sharing and per-layer embeddings in Gemma 4, per-layer query-head budgeting in Laguna XS.2, Compressed Convolutional Attention in ZAYA1-8B, and mHC with CSA/HCA compressed attention in DeepSeek V4. The article reports that DeepSeek V4-Pro uses 27% of single-token inference FLOPs and 10% of the KV cache size of DeepSeek V3.2 at a 1M-token context.

AIThinking Machines Lab announced a research preview of interaction models that take in audio, video, and text continuously and respond in real time without external turn-detection harnesses. The model, TML-Interaction-Small, is a 276B-parameter MoE with 12B active parameters, paired with an asynchronous background model for sustained reasoning and tool use. The post reports competitive intelligence scores and lower turn-taking latency against GPT-realtime and Gemini Live models, along with new interactivity benchmarks where baseline models largely failed.

Why it matters: The post explains a time-aligned, full-duplex design and benchmarks against turn-based models, showing how interaction and background reasoning can be split across two cooperating models.

AIJan Leike says he is excited about NLAs as a new tool in Anthropic's interpretability toolkit. The quoted post from Sam Marks describes NLAs as an unsupervised method that converts an LLM's internal state into human-readable text, which he says can advance understanding of model thinking and safety auditing.

AIOpenAI reports that its automated system found accidental chain-of-thought grading in RL runs for several released models, including GPT-5.4 Thinking and GPT-5.4 mini. Its analysis found no clear reduction in CoT monitorability, though the company says subtler effects cannot be ruled out. OpenAI says it still avoids grading CoTs during RL and has fixed the affected reward pathways.

Why it matters: The post shows how accidental chain-of-thought grading was detected and tested, giving a concrete method for checking monitorability risks in RL training.

AIOpenAI released Auto-review in Codex, which replaces user approval at the sandbox boundary with a separate agent that approves or denies boundary-crossing actions. In internal deployment, Codex sessions stopped for human approval about 200x less often than in manual mode, and Auto-review approved around 99% of escalated actions. The post also states that Auto-review is not a guarantee of security and cannot protect against model scheming.

Why it matters: The post explains how Auto-review replaces human approval at the sandbox boundary, with internal deployment figures and stated limits that help readers judge the tradeoff for coding agents.

AIOpenAI is releasing a subset of datasets, reference code, and the g-mean 2 metric for evaluating chain-of-thought monitorability. The release includes most datasets from its monitorability suite, while some evaluations relying on private or restricted data were omitted. The company says it will keep reporting monitorability results in future frontier reasoning model system cards.

AIResearchers introduced a simple, sample-efficient online reinforcement learning technique for post-training image generation models. It is presented as a possible steerable alternative to classifier-free guidance (CFG) that can be driven by any scalar reward, including human preference.

AIBerkeley AI Research introduces GRASP, a gradient-based planner for learned world models that aims to make long-horizon planning more robust. GRASP lifts trajectories into virtual states for parallel optimization across time, adds stochasticity to state iterates for exploration, and reshapes gradients to avoid brittle state-input gradients through high-dimensional vision models. The post identifies ill-conditioned gradients and non-greedy loss landscapes as core failure modes of standard rollout-based planning.

AITri Dao says the dynamical system view yields very clean conditions for looped transformers to be stable. The post's background links looping blocks of layers during training to predictable scaling laws that can match a Transformer twice the size at a fixed parameter count.

AIJan Leike, owner of this account at Anthropic, praised the work of @jiaxinwen22, @liangqiu_1994, Joe Benton, and @janhkirchner. He linked to a blog post on Anthropic's research page about automated alignment researchers.

AIAnthropic's Claude developed scalable oversight methods on chat reward modeling datasets and evaluated them on math and code datasets. The best methods performed strongly on math but gave mixed results on code, suggesting the methods were overfit to the data and models used.

AICognition and Applied Compute RL-trained SWE-check, a specialized bug detection model for the Windsurf IDE. It matches frontier performance on in-distribution evals and is an order of magnitude faster with cheaper inference, though it trails frontier models on out-of-distribution evals (delta F1 0.29 versus 0.49 before training). A preview is available in Windsurf Next, with a mainstream release planned.

Why it matters: The post explains how production environment replication, reward linearization, and two-phase post-training trade bug-detection quality against latency for an IDE specialist model.

AIIntern Large Models introduced Kernel-Smith, a framework for generating high-performance GPU kernels and operators using an evolutionary agent and post-training recipe. The post says it outperforms Gemini-3.0-pro and Claude-4.6-opus on Kernel-Bench, and that optimized kernels have been merged into SGLang and LMDeploy. The accompanying figure compares best program score trajectories across evolution steps, with Kernel-Smith-235B-RL reaching the highest peak.

AIMistral has released Voxtral TTS, a text-to-speech model, alongside a blog post, a playground, a technical report, and model weights on Hugging Face. The post itself contains only links and no further details about the model's capabilities.

AIMistral's Voxtral TTS is its first speech model, presented as an open-weight text-to-speech model that reportedly delivers SOTA performance at significantly lower cost with very low latency. It combines autoregressive generation of semantic speech tokens with flow-matching for acoustic tokens, and a technical report on its training methodology is being released.

AIDataChef, an AI4AI framework, uses reinforcement learning to automatically generate optimal data recipes for adapting LLMs. Its DataChef-32B model, using an efficient proxy reward system, matches Gemini-3-Pro in recipe generation, with its recipes surpassing expert-curated ones on AIME'25 and ClimaQA benchmarks.

AIIntern Large Models introduced ARM-Thinker, an agentic multimodal reward model that autonomously invokes image crop and zoom-in, document retrieval, and instruction-following validators to ground its judgments in evidence.

AIARC Prize has released ARC-AGI-3, a set of hundreds of interactive, turn-based environments with thousands of game-style levels, with no instructions or stated goals. Humans score 100% while frontier AI scores 0.51%. ARC Prize 2026 offers over $2 million in prizes for open-source solutions to ARC-AGI-2 and ARC-AGI-3.

Why it matters: The benchmark's human versus frontier AI gap and its interactive design show how agent evaluation is shifting from instruction-following toward exploration and adaptation.

AITri Dao says nonlinear RNNs seem to do something genuinely different from attention and linear RNNs or SSMs. He reports they already perform well with the right parametrization, and adding just one nonlinear RNN layer substantially improves a transformer-Mamba/DeltaNet hybrid. The post quotes the M²RNN paper, which introduces non-linear RNNs with matrix-valued states for language modeling, with links to the paper, code, and models.

AIBAAI has released RoboBrain-Dex, a dexterous manipulation model for embodied intelligence trained on large-scale, diverse human egocentric data rather than massive robot teleoperation datasets. BAAI says this shifts robotic dexterous manipulation research from small data with weak generalization to big data with strong generalization. The code is open-sourced on GitHub.

AIBerkeley AI Research introduces SPEX, a signal-processing framework that identifies influential interactions in LLMs using far fewer ablations than exhaustive analysis. A hierarchy-based extension, ProxySPEX, matches SPEX performance with around 10x fewer ablations. The methods apply to feature, data, and model component attribution.

AIThe FlashAttention-4 paper is out, reporting that attention on Blackwell GPUs now runs at roughly matmul speed, reaching about 1600 TFLOPs. The forward pass is bottlenecked by exponential computation and the backward pass by shared memory bandwidth, and the redesign uses polynomial exponential emulation, a new online softmax that avoids 90% of softmax rescaling, and 2CTA MMA instructions that let two thread blocks share operands to cut shared memory traffic.

AITri Dao reposts a quoted post from @tanishqkumar07 introducing Speculative Speculative Decoding (SSD), an LLM inference algorithm claimed to be up to 2x faster than leading inference engines. The quoted post credits collaborators @tri_dao and @avnermay and links to a thread with details. Tri Dao's own text says the approach applies an asynchronous-machines principle seen in GPU kernels to speculative decoding.