#On-Device AI
37 articles with this tag

Apple M6 MacBook Pro raises the bar for on-device AI laptops
Apple introduced the 14-inch MacBook Pro with M6, promising faster CPU and GPU and stronger on-device AI to challenge rival laptop silicon.

NYT Explores Local AI for Accessible Mobile Games
The New York Times' Shafik Quoraishee and Joanne Song discuss their work on local agentic AI for accessible mobile games, highlighting on-device benefits and future challenges.

VisionAId: On-Device Vision for the Visually Impaired
VisionAId transforms smartphones into real-time visual assistants for the visually impaired, leveraging on-device AI and few-shot learning for personalized object recognition and multimodal guidance.

Rachel Nabors: Local AI Models for Frontier Results
Rachel Nabors advocates for using smaller, on-device AI models, showcasing their efficiency, cost savings, and performance benefits over large frontier models.

FlashRT: Execution State for Latency-First AI
FlashRT revolutionizes on-device AI serving with execution-state capsules, enabling sub-millisecond state restoration and significant TTFT speedups for latency-critical applications.

Google's Gemma 4 12B: AI on Your Laptop
Google's Gemma 4 12B model brings efficient, multimodal AI directly to laptops with a novel unified architecture.

AgentStop Sips AI Battery Life
Brave's AgentStop system tackles the significant battery drain of local AI agents by predicting and terminating unproductive processes early.

Omar Sanseviero on Google's AI Strategy
Omar Sanseviero from Google DeepMind discusses Google's AI strategy, focusing on efficient models, multimodality, and open innovation in AI.

Claude's Corner: RunAnywhere, The On-Device AI Infrastructure Layer
RunAnywhere is building the infrastructure layer for on-device AI: a unified SDK that runs multimodal models locally on iOS and Android, with a control plane for managing model versions and routing policies. 10,100 GitHub stars in six months. Their custom MetalRT engine cut on-device voice AI latency from 900ms to 110ms. Here's how they did it and what it takes to replicate.

Google's Cormac Brick on Tiny LLMs for On-Device Agents
Google's Cormac Brick discusses the fine-tuning of Tiny LLMs for on-device agents, highlighting the benefits of LiteRT-LM and Gemma 4 for edge AI applications.

MLX Genmedia: Prince Canuma on On-Device AI
Prince Canuma of MLX Genmedia discusses the power of on-device AI, showcasing how MLX enables efficient deployment of AI models on Apple Silicon devices for vision and audio tasks.

Google DeepMind Accelerates AI on Edge Devices
Google DeepMind unveils Gemma 4 models and the LiteRT framework to accelerate AI on edge devices, emphasizing performance, privacy, and cross-platform capabilities.

Gemma 4 Runs on iPhone Using MLX
Adrien Grondin of Locally AI showcased running Google's Gemma 4 LLM on an iPhone using Apple's MLX framework, achieving impressive speeds.

Apple's AI Push: A Competitive AI Race
Apple's AI strategy focuses on seamless integration into devices and services, prioritizing user privacy with on-device processing amid growing competition.

AMD's Ryzen AI 400 Series Redefines AI PCs

On-device AI Redefines CES 2026 Computing

The Year Arm Became the AI Sovereign

T5Gemma 2 Multimodal Ushers In Efficient AI Future

Gemma 3n Powers Real-World Impact at the Edge

Arm's On-Device AI Push Redefines Edge Computing

Fara-7B Computer Use Agent Redefines On-Device AI

Google's Private AI Compute Redefines Cloud Privacy

Pixel Drop AI: Google Deepens On-Device Intelligence

Automotive AI: Redefining Vehicle Design Quietly
Artificial intelligence is fundamentally reshaping vehicle design, moving beyond the long-promised fully autonomous car to deliver immediate, tangible improvements in today's vehicles. This evolution, often subtle, is driven by a sophisticated blend of on-device intelligence...

Acer's New AI Chromebooks Push On-Device Intelligence

Jamba 3B Model Unveiled AI21's Hybrid Architecture for Edge AI

Tiny AI Model Outperforms Giants Redefining Scaling Laws

Pixel 10 Tensor G5: Google's AI Ambitions Take Center Stage

Pixel Magic Cue AI: Google's Latest Productivity Play
Pixel Magic Cue AI is Google's latest strategic play to embed proactive, time-saving intelligence directly into the Pixel experience, fundamentally reshaping mobile productivity.

Pixel 10 AI Camera: Google's Bold Bet on Generative Photography
Google's Pixel 10 AI camera marks a significant leap, integrating advanced on-device generative AI to democratize professional-grade photo and video creation.

Pixel 10 AI: Google's Hardware-AI Bet Hits its Stride
The Pixel 10 AI represents Google's long-term vision for ambient computing, where AI seamlessly enhances user experience through tightly integrated hardware.

Gemini on Pixel: 5 New AI Features Land on Google Phones
Google is significantly enhancing the on-device AI capabilities of its Pixel smartphone lineup with a suite of new features powered by Gemini. This strategic integration aims to transform how users interact with their devices, moving...

Apple's FastVLM Targets More Efficient Vision-Language AI
Apple has quietly unveiled a new machine learning initiative, FastVLM, aimed at significantly improving the efficiency of vision language models (VLMs). FastVLM could unlock a new generation of responsive, privacy-preserving AI experiences that are deeply integrated into Apple’s hardware ecosystem.
Moonshine AI Secures Investment for On-Device Voice AI

Apple's AI Gambit: A Long Game of Integration and Reliability
Moondream Raises $4.5M to Prove the Power of Small LLM Models
Moondream has raised $4.5 million in pre-seed funding from Felicis Ventures, Microsoft’s M12 GitHub Fund, and Ascend, debuting with an ambitious claim: smaller...

Moondream Raises $4.5M to Prove the Power of Small LLM Models
<p>Moondream has raised $4.5 million in pre-seed funding to prove that smaller AI models can deliver high-impact performance, rivaling much larger counterparts.</p> <p>The round was led by Felicis Ventures, Microsoft’s M12 GitHub Fund, and Ascend.</p>

