#Tutorial/How-to

AIGoogle's new Gemini 3.8 TTS models generate conversations between multiple voices, with over 2,000 preset voices available and voice cloning supported. Simon Willison says the models are super-cheap and built a small UI to try them, with Claude writing a script in which two pelicans debate moving to Pacifica Pier.

AIAnthropic says it made claude.ai 3x faster in two weeks, and the same speedup applies to the Desktop app. A linked blog post explains how the team used Claude to measure, debug, and improve performance, and includes prompts and methods.

AICursor's Eric Zakariasson shared a prompt for improving an LLM agent harness to lower token cost per completed task without losing quality. The prompt covers the system prompt, tool definitions, cache layout, tool results, compaction, and subagents, and reports that one team's round of these changes cut overall token cost about 7%.

Why it matters: The prompt gives a concrete checklist for cutting agent token cost per completed task, with tested figures on cache layout, tool offloading, and compaction.

AIAnthropic published a write-up on how it made the Claude frontend faster using agentic optimization techniques. The post coincides with Max Woolf's separate blog post showing that prompting agents can make code faster than current state-of-the-art libraries, with prompts and benchmark results included.

AIInferact says vLLM maintainers used megakernel optimization to reach 700 tokens per second per user on TPUv7 running Kimi K3. SemiAnalysis, which shared the work, reports this is 56% better performance than Nvidia's GB200 NVL72. Inferact links a full technical breakdown of the TPU megakernel work on its blog.

AIGitHub rebuilt the pull request view in the GitHub Copilot app to keep review fast on very large diffs, testing it on an open source pull request with 2,200 files, over a million changed lines, and more than 400 inline review comments. The core difficulty is that review comment heights can only be measured at render time, which breaks the fixed-geometry virtualization used for code-only diffs. GitHub split the document height into a deterministic code domain and a separately measured domain for comment blocks.

AIWrite-up and megakernel: 2/2

AIMicrosoft Research reports that running physical AI inference on onboard GPUs can limit robot performance and battery life, while offloading inference to edge or cloud GPUs improved results in mobile manipulation tests. In its evaluation, smaller onboard GPUs slowed mapping and planning by up to 383% compared with an A100, and large onboard GPUs such as Jetson Thor drained robot batteries by up to 160%.

Why it matters: The study measures how offloading robot inference to edge or cloud GPUs changes task success, battery life, and model size, offering evidence for infrastructure design.

AICursor announced improvements to the token efficiency of its agent harness, linking to a blog post with the details. The post itself offers no figures or specifics beyond that headline claim.

AIKarl's AI Watts (@aiwarts) has open-sourced Awesome Seedance on GitHub, a collection of AI video prompts. It includes 463 cases traced to original posts, 264 cross-model retest runs with public verdicts, 25 copy-ready templates, and 60 installable AI-video Skills.

AIThe author compiled 436 AI videos made with Seedance into a prompt collection and a Skill, now available on GitHub as awesome-seedance. The post asks GitHub users to star the repository to help it reach a thousand stars in a day, and notes the X post has about 400,000 reads.

AIAnthropic's Cat Wu points users to ways to try Opus 5.5 and Claude Tag in Slack. The main post carries no further details on access, features, or availability.

AITinker says an open LLM can serve a Jev-like interface that takes discrete options and returns fast probabilities, since next-token prediction is already a probabilistic classifier. A post by @ekzhang1 reports that a $5, 10-minute supervised fine-tuning run on Tinker improved Qwen3.6-35B-A3B's handling of Jev-style prompts, with +8% on GPQA Diamond and +12% on MMLU-Pro.

AIGoogle announced that the Antigravity SDK supports local agent workflows, with initial support for Gemma 4 26B A4B through Google AI Edge's LiteRT. The post includes Python setup steps and says a recommended machine has more than 24GB VRAM or unified memory. It also describes a hybrid pattern in which a cloud Gemini 3.8 Flash planner hands work to local Gemma 4 26B models, with 97.2% of tokens in one recorded run staying local.

Why it matters: The source shows how to run an agent with a local Gemma 4 26B model using LiteRT, plus a hybrid cloud-planner pattern that keeps most tokens on-device.

AIThe Together AI blog shows how to fine-tune a Qwen3.5 4B base model into a classification model using about 38,000 examples sampled from six Hugging Face datasets, at a training cost of roughly $17.0. The tutorial covers cloning the tev1 repository, normalizing data with provided scripts, launching a Together AI fine-tuning job that takes about 25 minutes, and deploying the result to a dedicated H100 endpoint.

AISwitching effort levels mid-session on Opus 5.5 does not break the prompt cache, according to Lydia Hallie of Anthropic. This holds when running Claude Code v2.1.280 or later.

AIA prompt shared by Alex Albert asks Claude to recreate San Francisco's Market Street as it stood on April 17, 1906, before the earthquake, using Blender. It requires building a source file from Sanborn fire insurance maps, the Miles Brothers film, period photos, and USGS topography, with reusable Blender Python generators for facades, street lamps, and vehicles, ending in a 10-second video up the street.

AIStepFun released an install script for Step Code that runs on macOS, Linux, or WSL with a single curl command. WSL is the recommended route on Windows, while PowerShell support is currently in beta. The project accepts issues and pull requests on GitHub.

AIOpenBMB thanked a developer for testing MiniCPM5-2B as a worker in a multi-agent workflow handling invoice matching, short payments, duplicate references, and disputes through tool calls. The background post says GPT-6 Astra coordinated the MiniCPM5-2B workers, verifying 32 synthetic invoices in 67.8 seconds with 232 executed tool calls. The demo does not move money.

AISuno Studio includes a compressor plugin that reduces dynamic range by turning down peaks and applying makeup gain to raise quieter parts. Its controls include threshold, ratio, attack, and release, and it is especially useful for shaping uploaded or recorded audio. Studio is browser-based and comes free with every Suno Premier subscription.

AITencent Hunyuan says it shrank the 770B-parameter Hy4 preview from roughly 1.5TB to 214 GiB while keeping the parameter count unchanged. The quoted Zhihu post by a Tencent Hunyuan quantization team member describes the method: a 1.25-bit sparse ternary encoding, mixed precision across expert layers, and STQ1_0 CUDA kernels in llama.cpp. The author reports nearly unchanged MRCR retrieval and a small decline in math.

Why it matters: The quoted Zhihu post explains how Hy4 preview's weights were quantized and kept usable at inference, a concrete engineering case for compressing large MoE models.

AISpaceXAI says its combined support team handled a 175% rise in tickets without hiring, crediting Grok Bot, which it says would otherwise have required about 200 additional staff. The company reports resolving tickets for $0.20 to $0.30 each, versus the $1 to $4 per resolution it attributes to traditional AI support tools. Grok Bot is also reported to resolve 99% of refund requests without human intervention.

AITogether AI's canary rollouts shift production traffic between two model deployments on the same endpoint in staged percentages, with optional metric gates between steps. Operators can choose canary, blue-green, or rolling strategies, and a rollout starts only when explicitly launched; it can be paused, canceled, or reversed. The platform scales the target before moving traffic and waits for routing to converge before draining the source.

AIMike Knoop notes that logprobs used to be widely exposed by LLM inference APIs and sees the market maturing so that parts of the LLM stack can be packaged in new, useful ways. He links this to Bryan Helmig's post on prompting with max_tokens: 1 plus logprobs for fast, parallel judgments, which Helmig says has a lot more depth than he expected.

AIThe article explains how Mixture of Experts models change inference by making prefill, midfill, decode attention, and decode experts distinct workloads. It describes how KV cache state, expert routing, and parallelism choices shape compute, memory, and network demands across an inference cluster.

AIMax Woolf reports that prompting agents to iteratively optimize code can make it faster than current state-of-the-art libraries. He says the blog post includes his prompts and benchmark results.

AILMSYS Org shared a blog post about NVFP4 KV cache, a topic linked from its 2026-09-16 article. The post itself contains only a link, so no further technical details, figures, or results can be confirmed from this source.