Updated
Updated
Items with an AI score under 20 are hidden. Show low-relevance items
Prime Intellect@PrimeIntellectAI score23AIPrime Intellect says long-context agent serving depends on retaining history, scheduling new work, and moving cached state efficiently. It optimized three paths separately: prefill topology and scheduling, compressed KV with a fused attention kernel, and a transfer-friendly cache layout.
Prime Intellect@PrimeIntellectAI score20AIPrime Intellect has introduced Prime Inference, an inference service it says has served trillions of tokens for reinforcement learning and dedicated customer deployments. The company argues that owning your intelligence requires owning your inference, and the post promises to unpack its inference stack.
Prime Intellect@PrimeIntellectAI score38AIPrime Intellect says its production stack now processes roughly 600B tokens daily on its own compute. The company also states its GLM-5.3 deployment ranks among the fastest GLM-5.3 endpoints on OpenRouter.
Guillermo Rauch@rauchgAI score26AIVercel has added Jev to the AI SDK for Python, and the team tested it in two experiments: detecting whether typed text is Python or English, and writing Python one decision at a time. The main post is a short endorsement praising a writeup about Jev and Python.
Vercel@vercelAI score22AIVercel has added Jev to the AI SDK for Python. The team tested it in two experiments: detecting whether typed text is Python or English as it is entered, and writing Python one decision at a time.
AIBaseten tested the MetaInfer skills-only approach by having Claude Code build an inference engine, VibeQwen, for Qwen-3.6-35B-A3B in NVFP4 on a single B200. On single-stream text, VibeQwen decoded 90% faster than a tuned vLLM 0.25.1 deployment (1,792 vs. 943 TPS) and cut time to first token from 28 ms to 12 ms, with a 71% throughput gain at concurrency 32. The author notes this was an outcome-focused run that allowed some numerically different outputs as long as accuracy stayed at or above the BF16 baseline.
Why it matters: The post tests a skills-only inference engine method on a real model and states the speed and accuracy constraints used, helping readers judge how far such automated optimization can be trusted.
Muse@MuseAI score33AIMuse has released Muse Gadgets, open-source ESP32 firmware and a Linux SDK for building hardware devices that work with Muse. Developers can get an API token at gadgets.muse.ai and use a coding agent with the GitHub repository to build custom peripherals.
Aravind Srinivas@AravSrinivasAI score62AIPerplexity has released several open source projects, including the pplx-decider-v1-27b multimodal decision model, the pplx-embed-v2-context-9b-preview contextual embeddings model, and the Lily local inference engine for Apple silicon. The post also lists the 0.6B on-device PII-Tracer classifier with its PII-TRACE benchmark, the WANDR research agent benchmark, and the Numbat and Bumblebee security tools, and says more open source releases are coming soon.
AIAnthropic released Claude Code v2.1.288, adding $.ui.selection() for mods, a built-in gh api for cloud sessions without the GitHub CLI, and --max-findings for /code-review. The release also fixes many issues, including mid-response API timeouts, resume and compaction bugs, and auto mode denials and model switching on Bedrock and Mantle.
AIThe vLLM team integrated Helion, a PyTorch-native kernel DSL, into vLLM's linear backend, using per-shape autotuning to select among Standard GEMM, Split-K, and Swap-AB variants. On NVIDIA Hopper GPUs, the Helion backend outperformed the default CUTLASS and DeepGEMM backends across the evaluated models, with more than 10% throughput gains for some workloads. The work focuses on FP8 and INT8 quantized GEMM.
SGLang@sgl_projectAI score38AISGLang has released v0.5.20, bringing Intel XPU into standard releases alongside RL sampling masks that make rollouts more reliable with up to 52% faster decode. The update also adds Unified Radix Tree SWA branching-point caching, which the project says lifts cache hit rate about 20 points and cuts TTFT by roughly one-third, plus up to 12.5× faster ROCm model loading. New models named in the release include GLM-5.3-Flash, Qwen3.8-Flash-Next, K2 Horizon, Hy4-Preview, FastH3, and VDN-H3.
SGLang@sgl_projectAI score39AISGLang's update adds a /v1/score endpoint that returns scores for requested labels such as Yes/No or A/B/C, avoiding the label loss of generate with top-k logprobs. Its multi-item scoring computes shared context once and keeps each candidate isolated, with 16-candidate p95 on Qwen3-8B dropping from 54.1 ms (Generate) to 20.6 ms.
SGLang@sgl_projectAI score28AISGLang demonstrated Qwen3.8-27B as a multimodal decision model that beat Pokémon FireRed's Elite Four and champion with sub-100 ms decisions from live game state. The company says its native /v1/decisions API lets LLMs and VLMs be used for classification and scoring. It also announced /v1/systemone for running Jev-like open models with the TypeSafe SDK.
SGLang@sgl_projectAI score58AISGLang has released v0.5.21 with a native Decisions API that turns an LLM or VLM into a low-latency classifier and scorer. The release also lets /v1/score rerank search or RAG results in one call, lets PD instances switch between prefill and decode without restarting, and adds support for models including DeepSeek-V4.1 Flash, Kimi K3, and GLM-5.3-Flash on AMD MI355X. The announcement reports a 22% faster first token on long prompts for DeepSeek-V4.1 Flash and 20.6% higher prefill throughput for Kimi K3 in PD serving.
LiveKit@livekitAI score23AIAssemblyAI's Universal 3.6 Pro speech-to-text model is now available in LiveKit Inference, with 45% fewer wrong yes/no confirmations and about 30% less background speech transcribed. It supports 32 languages plus code-switching and endpointing that waits out phone numbers and emails, at the same $0.45/hr price, accessible by switching to universal-3-6-pro.
AIThe Linux Foundation Education has launched a PyTorch Certified Associate (PTCA) Certification Pathway that combines four self-paced learning modules with the PTCA exam. The pathway includes 15–17 hours of self-paced learning and hands-on labs covering tensors, data handling, model development, and performance optimization. The source recommends additional hands-on practice before taking the exam.
AIGitHub Copilot code review can now be requested through the REST and GraphQL APIs, with an optional review effort level set per request. Balanced became the default review effort level for new and existing repositories and organizations as of September 28, 2026, while users who explicitly selected Lite keep that setting. The changes are generally available to Copilot Pro, Pro+, Max, Business, and Enterprise plans.
AIEpoch AI estimates that compute built from projected 2025 to 2027 high-bandwidth memory shipments could support tens to hundreds of millions of frontier AI agents, or billions of cheaper ones. Running nonstop, the top-tier agents would match the working hours of 140 million to 700 million full-time employees, and the central DeepSeek V4 Pro estimate of about 1.9 billion agents would match 8 billion workers.
Why it matters: The estimate converts memory shipments into agent capacity and revenue ranges, showing how hardware supply could translate into labor and sales if demand keeps up.
Sara Hooker@sarahookrAI score26AIAdaption Labs has made Invent, its tool for generating AI training datasets from a plain-language description, available through an API. Developers can reportedly produce AI-ready training datasets in minutes with a few lines of code, according to the quoted post. Documentation is available at docs.adaptionlabs.ai.
AIAs of October 2, 2026, GitHub deprecated Gemini 3.5 Flash, Gemini 3.6 Flash, Kimi K2.7 Code, and Claude Opus 4.7 across all Copilot experiences. Suggested replacements are Gemini 3.8 Flash, Kimi K3, and Claude Opus 5.5, and Enterprise administrators may need to enable them through model policies.
François Chollet@fcholletAI score28AIKeras is moving to a pluggable backend design, with MLX and PaddlePaddle backends upcoming as add-on libraries. The team is reducing the operations needed to ship new backends and streamlining unit testing so a single harness can test all ops, such as casting consistency. KerasHub also gains many new models and is shifting its preprocessing from tf-text to PyGrain.
Harrison Chase@hwchase17AI score38AILangChain's LangSmith Custom Apps lets agent teams build their own review UI over their traces and publish it directly into the workspace. Developers build the interface on their LangSmith data, while hosting, authentication, and permissions are handled by the platform.
Cursor@cursor_aiAI score42AICursor introduced Rollouts, a tool that writes a monitoring plan and watches changes as they deploy to catch regressions before users see them. When Rollouts detects a regression, it identifies the offending PR and opens an issue, and one click starts a cloud agent to fix it. Rollouts usage credits are included through Oct 3.
GitHub@githubAI score44AIGitHub has made the Project HydraFusion research preview available in the GitHub Copilot app and @code, where it orchestrates multiple models rather than acting as a single model. New models from Anthropic (Fable 5.1 and Opus 5.5) and OpenAI (GPT-6.1 Sol) are also now selectable in the Copilot model picker.
Together AI@togethercomputeAI score34AITogether AI's CPO and product team outlined how they use AI to make the whole team more productive, not just individuals. The approach includes a shared context repo readable by any AI harness, cutting half a day of research to about 5 minutes, and evals that test their product the way agents actually use it.
Microsoft AI@MicrosoftAIAI score41AIMicrosoft's MAI-Transcribe-2-Streaming, MAI-Voice-2.1, and MAI-Voice-2.1-Flash are now live on LiveKit for building voice agents. LiveKit says MAI-Transcribe-2-Streaming debuts at #1 on the Artificial Analysis accuracy leaderboard, and suggests pairing it with MAI-Voice-2.1-Flash for efficient, expressive voice agents.
Microsoft Copilot@MSFTCopilotAI score20AIMicrosoft's Copilot Code is designed to help more people turn ideas into apps, workflows, and solutions for their work. Microsoft Copilot EVP Jacob Andreou discusses how the product expands who gets to build.
AIHost Vicki Reyzelman of Akamai argues that AI agents can now probe networks, coordinate with other agents, and make purchases faster than organizations can respond. She cites an OpenAI agent that reportedly bypassed security controls while researching Australia's Medicare system, with OpenAI taking 54 days to identify the incident and another month to notify the government. Major model releases are arriving roughly every 17 days, and Meta says its Muse ecosystem has about 1,500 developer connectors.
Google AI@GoogleAIAI score62AIGoogle AI announced that its Project Suncatcher prototype satellite, built with Planet, has launched into orbit on SpaceX's Transporter-18 rideshare mission. The initial mission will gather data on how Google TPUs handle the physical stress and extremes of spaceflight. The post says low Earth orbit systems could generate up to 8x more solar power than on Earth, and that future work may link multiple satellite constellations for scaled machine learning.
Jerry Liu@jerryjliu0AI score44AILlamaIndex released Extract v2.5, a set of document extraction agents that it says reach 93%–96%+ accuracy on long-list extraction, including records spanning pages. The post claims the agents outperform frontier VLMs, which it says stop early, miss repeated records, and struggle to attribute values to sources, while LlamaIndex attributes every extracted value to its source. The agents are available through LlamaParse.
Google Research@GoogleResearchAI score34AIGoogle Research introduced a next-generation Federated Learning system that uses Trusted Execution Environments to deliver verifiable differential privacy. The design moves computation server-side, which the post says cuts training times.
Mustafa Suleyman@mustafasuleymanAI score36AIMicrosoft AI's Voice and Transcribe Streaming model is now available on Vercel for building agents, and the post claims it ranks first for quality and speed. The post says it is cheaper than other hyperscalers and 60% cheaper than Eleven Labs.
Latent.Space@latentspacepodAI score31AIFormer Meta Llama leader Ahmad Al-Dahle, now Airbnb CTO, is applying an inside-out AI strategy that transforms internal operations before changing customer experiences. The approach includes Everest, an internal tool that helped speed up a product launch.
clem 🤗@ClementDelangueAI score44AIllama.cpp can now run decision models on-device, according to Clément Delangue of Hugging Face. He says the setup is free, fast, and private, and gives the command llama serve -hf ggml-org/Kev-4B-GGUF to start it.
AIAI is changing developer work, and the article recommends three skills: directing AI agents, reviewing AI output instead of trusting the first answer, and using saved time for judgment-heavy problems such as customer needs and tradeoffs. It cites GitHub Copilot's built-in Rubber Duck agent, which uses a second model to critique plans, code, and tests. The author argues that developers remain responsible for outcomes while AI handles more implementation.
AIGoogle's September 2026 roundup highlights Gemini 4 Argon, a frontier model with a 1-million-token output limit aimed at complex tasks such as cybersecurity defense. Argon is rolling out first to trusted cyber defenders through the Fairwind Program, with developer, enterprise, and consumer access to follow after guardrail feedback. The post also covers Gemini 3.8 Flash, Connected Apps in Gemini, and WeatherNext 3.
AIGoogle announces a next-generation federated learning system that uses Trusted Execution Environments to provide verifiable, auditable data anonymization. The system publishes access policies to a public transparency log and is deployed in Gboard, which has launched English and Japanese next-word prediction models with stronger privacy guarantees and improved accuracy. Training time has also sped up significantly because computation moved to the server and is parallelized across many machines.
Why it matters: The post shows how Trusted Execution Environments make federated learning's privacy claims externally verifiable, rather than relying on trust in the server operator.
merve@mervenoyannAI score36AIllama.cpp now supports decision models, which route tickets, moderate content, or choose an agent's next step by returning a probability for every option. Five open models from 144M to 27B parameters are supported at launch, and the team says more will follow in the coming days. Because most decision models do not need large GPUs, they are a good fit for llama.cpp, and a Hugging Face blog post explains how to set them up.
Georgi Gerganov@ggerganovAI score34AIGeorgi Gerganov announced that decision models are now available in the latest llama.cpp builds through a new /v1/systemone endpoint. The endpoint supports local, private inference with multiple open models, and more are planned.
AIAirbnb CTO Ahmad Al-Dahle, who joined from Meta in January, says 60% of the company's code is now AI-authored and pull-request throughput per engineer is up about 1.6x. Roughly half of Airbnb's support tickets are now resolved purely by AI, which the company tested with synthetic data before production. Airbnb's internal context graph Everest helped speed up the grocery delivery and airport pickup services, which took eight to nine months and about six weeks to build, respectively.