Skip to contentSkip to stories

Updated

#Deployment/Engineering

Items with an AI score under 20 are hidden. Show low-relevance items

Sep 28

Sep 28Mon
  1. vLLM BlogAI score54

    vLLM guide explains disaggregated serving for prefill and decode

    AIThe vLLM blog guide explains how separating prefill and decode, and moving tokenization to a CPU-only render tier, can keep token streams from stalling under load. In a two-L40S test on Qwen2.5-7B, collocated p99 inter-token latency reached 169 ms at 0.4 req/s while disaggregated serving stayed between 25 and 52 ms. The guide notes that the gain depends on fast KV cache transfer, and it includes setup code for NIXL-based serving and the render/derender API.

  2. DatabricksAI score38

    Claude Sonnet 5.5 now available on Databricks across AWS, Azure, GCP

    AIDatabricks now offers Anthropic's Claude Sonnet 5.5 on AWS, Azure, and GCP, governed through Unity Gateway. The post says Sonnet 5.5 is more efficient than Sonnet 5 for coding and agentic use and reaches Opus 5-level accuracy on document understanding, parsing, and search. It joins Claude Opus 5.5, Claude Fable 5.1, and 60+ other open-source and frontier models on the platform.

    Video from @databricks's post
  3. IEEE Spectrum · AIAI score25

    Charlie Kemp Builds Assistive Mobile Robots to Help People Live Independently

    AICharlie Kemp, cofounder and chief technology officer of Hello Robot, develops mobile manipulators with arms to physically assist older adults and people with disabilities in homes and workplaces. His work began with humanoid robots at MIT and led to assistive robotics research, including a collaboration with Henry Evans through the Robots for Humanity effort. The profile is part of IEEE Spectrum's "A Day in the Life of a Roboticist" series.

  4. Microsoft ResearchAI score30

    Microsoft Research Asia – Singapore marks one year advancing AI research, partnerships and talent

    AIMicrosoft Research Asia – Singapore, opened July 24, 2025 as Microsoft's first Southeast Asian research lab, reports progress after its first year. The lab's work spans next-generation AI models and agentic systems, domain-specific AI for real-world impact, AI-native research practices, and ecosystem and talent development. Its healthcare collaborations on multimodal and agentic AI for clinical decision-making are being deployed through partnerships across Singapore's healthcare ecosystem.

  5. François CholletAI score32

    K3-Node: a Keras 3 GNN library running on JAX, PyTorch, and TF

    AIK3-Node is a graph neural network library built natively on Keras 3, with models that run on JAX, PyTorch, and TensorFlow with hardware acceleration including Apple Silicon and TPU. According to the post, it achieves 100% public API parity with PyG and incorporates foundation models and architectures from Spektral and StellarGraph.

  6. SemiAnalysisAI score43

    How GLM-5.3 Sparse Attention Affects HBM and Serving Costs on GB200, GB300, and MI355X

    AISparse attention cuts per-operation KV cache reads but does not reduce overall memory capacity, so top-k cache misses still depend on HBM. SemiAnalysis's InferenceX estimates GB200 at about $0.044 per million total tokens at 150 tokens per second, roughly 12% below MI355X running ATOM at $0.049. Neither system holds a uniform cost advantage across the tested 100, 125, and 150 tokens-per-second targets.

  7. Ali GhodsiAI score62

    Databricks finds Opus 5.5 cheaper and better, GPT-6 Luna 20x cheaper per task

    AIDatabricks tested recent AI models across 2,400 engineers and found Opus 5.5 offers the highest quality mid-tier performance, with about 20% lower same-task costs than Opus 4.8. The company is now encouraging Opus 5.5 as a default model for coding, and reports that GPT-6 Luna is at least 20 times cheaper per task than Opus 5.5, roughly matching Opus 4.6 on one difficult evaluation suite. The Luna findings are preliminary.

  8. RadixArkAI score46

    RadixArk releases Miles v0.1.1 with multi-LoRA and expanded model support

    AIRadixArk has released Miles v0.1.1, adding multi-LoRA with Tinker API compatibility so multiple training jobs can share one base model. The update also supports agentic training with harnesses like Claude Code and runs Harbor tasks in sandboxes including AgentENV, Daytona, E2B, and Modal. It further reduces memory needs for training larger models on validated NVIDIA and AMD GPUs and adds stable support for Qwen3.8-Flash-Next, GLM-5.3-Flash, and Kimi-K3.

    Image from @radixark's post
  9. Google Cloud · AI & Machine LearningAI score40

    Why startups should pair open models like Gemma 4 with frontier APIs

    AIGoogle Cloud argues startups should combine open-weight models with frontier APIs rather than routing every request to one frontier model. It cites Gemma 4, which spans five sizes including a 31B dense model and a 26B A4B Mixture-of-Experts model, released under Apache 2.0. The article's examples report a 44% latency drop for Cue, from 876 ms to 488 ms, and a $0 server cost for BetterSpeak's on-device Gemma 4 E2B.

  10. François CholletAI score36

    Chollet says LRMs make hand-written code less worthwhile

    AIFrançois Chollet says he no longer reads or writes code and instead directs a large reasoning model, though he does not consider its code quality perfect or its instructions reliably followed. He argues LRMs enable faster ways to test, audit, visualize, and red-team a codebase, achieving the benefits of code review through new workflows. He concludes that the return on hand-writing code no longer looks good, since these workflows can be more productive than the old ones.

  11. clem 🤗AI score49

    Hugging Face proposes egress usage monitoring for OpenShell agent sandboxes

    AIHugging Face is contributing egress usage monitoring to NVIDIA's OpenShell, part of the newly launched Open Agent Safety Platform, arguing that allowlists alone restrict where agents can go but not what they do. The proposed features include per-sandbox network budgets for requests, writes, and bytes, drift detection against each sandbox's baseline and cohort, and a fleet view that flags many sandboxes writing to one host even when every request is allowed.

    Video from @ClementDelangue's post
  12. Kling AIAI score42

    Kling 4.0 Flash launches now for Ultra Yearly subscribers; Kling 4.0 arrives October

    AIKling AI says its Kling 4.0 Flash is live now for Ultra Yearly subscribers, with the full Kling 4.0 coming this October. The update advertises up to 4K resolution, 10-bit HDR output, stereo audio, and native 30-second generation. It also adds Omni Reference supporting up to 15 multimodal references and multi-keyframe control with up to 10 keyframes.

    Video from @Kling_ai's post
  13. Philipp SchmidAI score52

    Gemini Managed Agents adds a Credentials API that keeps secrets out of sandboxes

    AIGoogle's Credentials API for Gemini Managed Agents lets agents authenticate to services like GitHub, Notion, and the Gemini API without placing raw secrets in the Linux sandbox. Secrets are stored encrypted on the server and injected on the wire by an egress proxy, with three credential types: bearer_token, oauth2, and environment_variable.

  14. Sierra BlogAI score34

    Sierra's Ghostwriter becomes a proactive Slack and Teams teammate for AI agents

    AISierra has turned its Ghostwriter tool into an always-on teammate in Slack and Teams that proactively suggests ideas, flags problems, and proposes experiments. Ghostwriter reviews recent customer calls, recommends which changes to try first, runs experiments, and reports when results are statistically significant. Sierra said it will begin rolling the feature out more broadly next week.

  15. Lovable BlogAI score57

    Lovable apps can now run inside a company's Microsoft tenant

    AILovable announced a partnership with Microsoft that lets users publish apps into their company's Microsoft Entra tenant using Copilot Managed Runtime. Apps can connect to Microsoft 365, Fabric, Dataverse, and SQL data, and staff sign in with their work login. Copilot Managed Runtime is in public preview, and Microsoft 365 connectors, Fabric, and Microsoft sign-in are available on every Lovable plan, while Entra workspace sign-in is included on Business and Enterprise.

  16. NVIDIAAI score34

    NVIDIA launches Open Agent Safety Platform to control AI agent access

    AINVIDIA has launched the Open Agent Safety Platform to help teams control what AI agents can access and do. NVIDIA OpenShell enforces permissions around agent work, while BlueField-4 and DOCA add independent monitoring and security controls in the infrastructure beyond the agent's reach. Together, these components aim to give organizations defined permissions, oversight, and protection for long-running agent tasks.

    Image from @nvidia's post
  17. KhazixAI score31

    Solo developer rewrites AIHOT with multi-model AI workflow in three days

    AIThe developer behind AIHOT rewrote the entire project over three days, then launched it after a 12-step AI-assisted workflow. The process used Claude Opus 5.5, Claude Fable 5.1, and GPT-6 Astra for distillation, rewriting, audits, testing, and a six-hour shadow-system rehearsal before cutover. The post frames this as an amateur's experience and includes a quoted suggestion to distill the source project into a feature document and rewrite it directly with the latest models.

    Image from @Khazix0918's post
  18. Import AIAI score52

    Import AI 474 covers Michael Levin's mind-pattern paper, robot post-training, Google's space TPUs, and Zhipu's self-improvement loop

    AIImport AI 474 is a research newsletter by Jack Clark that surveys four developments and one fiction piece. It covers Michael Levin's paper proposing minds as patterns that ingress into bodies, Stanford researchers' call for a universal post-training recipe for robotics, Google's plan to send TPUs to space with Planet, and Zhipu's use of GLM-5.3 to speed up its own inference infrastructure.

  19. Rest of WorldAI score46

    SK Hynix and Samsung race for bigger roles in U.S. AI chip boom

    AITwo South Korean companies, SK Hynix and Samsung, control 83% of the global memory chip market and are competing to deepen ties with U.S. AI firms. Samsung has more than doubled its market share over the past year, while SK Hynix has held a long lead in high-bandwidth memory and is building a $4 billion advanced packaging facility in Indiana. Both remain exposed to China, where they face new U.S. licensing requirements and growing domestic competition.

  20. Jensen HuangAI score42

    NVIDIA releases open agent safety platform combining OpenShell and Sentry

    AINVIDIA's Open Agent Safety Platform Reference Design combines NVIDIA OpenShell and NVIDIA Sentry to secure AI agents. OpenShell, an open-source secure runtime, enforces clear boundaries and policy on agent actions while tracing them as they work. NVIDIA Sentry adds hardware-based enforcement on NVIDIA BlueField, continuously monitoring agent activity and enabling millisecond-scale containment and quarantine.

    Image from @JensenHuang's post