#On-device

AIAmazon's Alexa Plus, powered by generative AI, now responds in three to five seconds and handles multistep smart home commands, cooking questions, and calendar imports more reliably than the original Alexa, according to a year-long test by The Verge. The reviewer says its personal assistant features remain underbaked and frustrating, and that ads on Echo Show displays are excessive. Alexa Plus costs $19.99 a month in the U.S. unless users have an Amazon Prime membership, and the Echo Dot Max is recommended as the ad-free option.

AIClément Delangue of Hugging Face says he loves the building-in-public approach, responding to Matth Lapeyre's post about Microduck's battery testing. Lapeyre reports the new custom board ran over 3 hours on a 2600 mAh battery, with average current dropping from about 1.13 A to 0.82 A and peak CPU temperature falling from 114°C to 60°C without throttling.

AIGoogle AI announces that SynthID.com is now available globally in English for verifying AI-generated images, video, and audio. The post also lists Nano Banana 2.1, EmbeddingGemma 2, Gemma 4 with BOTANIC-1, a Gemini business agent, and Guided Vision in Gemini Live.

AIOpenBMB reports that its MiniCPM5-2B model runs at 37 tokens per second on an iPhone Air. The post presents this as evidence that small open multimodal models can run on mobile devices without a cloud GPU, with NobodyWho noting the model is available in its Chat app.

AIA Chinese podcast transcript argues that Opus 5.5 makes code generation, game modding, and language migration much faster and cheaper. It cites examples such as game remakes, Photoshop clones, and ESP32 firmware projects, and says legal and open-source barriers are struggling to keep pace.

AIGoogle released Google AI Edge Foresight, a Mac app that captures meeting notes offline using the on-device EmbeddingGemma 2 model with 740 million parameters. The app offers split-screen shorthand and AI-generated notes, transcripts, and a Gemma 4-powered assistant that can answer questions from uploaded documents. Google's FAQ says it is optimized for Apple Silicon.

AIMicrosoft Copilot announced Hybrid Intelligence for Windows, which balances cloud and locally run agents to handle tasks like file wrangling and workflows on the PC. According to Satya Nadella, Copilot can use context on the PC with user permission and draw on local models when appropriate. The feature is described as coming soon.

AIAtomic Agent Desktop is a local AI-first agent available for Mac, Windows, and Linux. It offers a 4x larger context window on local models using TurboQuant, and Atomic Fusion orchestrates cloud and local models to reduce costs.

AIA ComfyUI developer generated 15-second 448×256 video in 15 seconds or less on one RTX 5090 using MiniMax H3 with FastVideo's FastH3 V2 checkpoint in four sampling steps. The setup combined sparse attention, a smaller ClipProj text encoder, a pruned INT8 checkpoint, and a fused FP4 MLP, cutting VRAM needs from 80GB to under 30GB. The custom ComfyUI node is open source.

AILiquid AI is building personal AI that runs on devices such as phones, wearables, PCs, and cars, using its Liquid Context layer, which is optimized for Snapdragon processors, to sit between models, agents, and hardware. The company's agent harness uses its own models to decide which user context to retain and how to compress it within fixed compute limits. Liquid AI is also collaborating with Mercedes-Benz Group AG to bring on-device AI to its cars and plans observability and continuous improvement loops for self-improving agents.

AIGoogle has released AI Edge Foresight, a free experimental note-taking app that transcribes meetings and audio files entirely offline on macOS. It runs on the on-device EmbeddingGemma 2 model and turns shorthand notes into polished notes based on the transcript. Google says files, meeting audio, and notes never leave the computer, and the app is currently optimized only for Macs with Apple Silicon.

AINous Research says Hermes Agent is now available on the new ASUS ProArt RTX Spark PCs, with MuseTree and ComfyUI integrations and local model support on up to 128 GB of unified memory. The post presents it as a creative stack that runs entirely on the user's own machine.

AIllama.cpp v0.6.0 adds support for multimodal Jev-like models and a performance upgrade for Metal, according to Merve Noyan. The post says models can be served with a single command, `llama serve -hf ggml-org/Clef-Flash-GGUF`, and points to a trending list of decision models on Hugging Face.

AILenovo's YOGA Pro 15 RTX Spark laptop, powered by the NVIDIA RTX Spark N1X superchip, opened blind pre-orders on October 8 at 9:00. The machine offers up to 1 Petaflop FP4 local AI compute, up to 128GB unified memory and 2TB storage, and comes preloaded with a 35B local model.

AIMicrosoft Windows and devices head Pavan Davuluri confirmed the Copilot+ PC brand has not been discontinued, saying more than 40% of commercial laptops are Copilot+ PCs shipping in tens of millions annually. He said these devices run over 2 trillion local inferences per month across search, image processing, and video calls. Microsoft plans to strengthen them through hybrid intelligence with local context, local actions, and local models.

AIGoogle's AI Edge Team open-sourced ML Drift under Apache 2.0, a GPU compute engine for on-device AI inference across OpenGL ES, OpenCL, Metal, and WebGPU. It serves as the core GPU acceleration engine within LiteRT and succeeds the legacy TFLite GPU delegate, which will no longer receive new features. The post cites benchmarks showing up to 40% lower frame latency in YouTube Shorts and up to 30% faster on-device performance in Adobe Lightroom and Photoshop.

Why it matters: The post explains how ML Drift unifies GPU shaders across platforms and replaces the TFLite GPU delegate, which matters for developers deploying on-device models.

AILiquid AI's local d1 3B model, running on a single RTX 3090, made decisions in 8 ms and ate 86 apples in a Snake game, versus 3 apples for OpenAI's API, which took 345 ms per call. The post, shared via Atomic Chat, also credits the d1 model with 82 moves per second.

AINVIDIA and Microsoft announced RTX Spark laptops and compact desktops that run the full NVIDIA AI stack locally, with laptop preorders open today and sales from October 16. Microsoft also announced general availability of Microsoft Execution Containers (MXC), an OS-level infrastructure for agents to run securely in the background, while NVIDIA previewed DGX Station for Windows with 748GB of coherent memory and up to 20 petaFLOPS of FP4 compute.

Why it matters: The announcement pairs Windows agent infrastructure with local hardware, showing how agents may move onto personal computers and enterprise desktops rather than only cloud services.

AILiquid AI and NVIDIA Robotics announced a collaboration around Liquid AI's models on NVIDIA hardware. The main post is brief and gives no further technical detail or figures.

AILiquid AI has released its d1 decision models, with d1-3B recommended for high-quality text and vision tasks and d1-omni-600M offered as an experimental option for smaller footprints. The weights are available for download, fine-tuning, and local deployment.

AILiquid AI's Open d1 models run across NVIDIA DGX, RTX, and Jetson hardware, with day-one llama.cpp support for deployment anywhere. Measured one request at a time, the d1-3B model's single-question latency is 8 ms on an NVIDIA RTX 4090, 16 ms on Jetson AGX Thor, 26 ms on Jetson AGX Orin 64 GB, and 50 ms on Jetson Orin Nano.

AILiquid AI released two open-weight decision models, d1-3B and d1-omni-600M (experimental), built on its Liquid Foundation Models and available on Hugging Face. d1-3B scores 48.57 on the Decision Index 0.2.1, the highest among decision models under 10B parameters, and answers a question in 16 ms on an NVIDIA Jetson AGX Thor and under 50 ms on a Jetson Orin Nano. The models support text and images (d1-3B) or text with image or audio (d1-omni-600M).

AIPerplexity is open-sourcing pplx-embed-v2-late, multi-vector embedding models for text and images in one shared space, in 9B and 0.6B sizes. The 9B model can index multimodal data, the 0.6B model can run queries on device, and PDF pages can be searched without OCR. The author reports 92.4% on MADQA and 64% on BrowseComp+, with weights available on Hugging Face.