Posts tagged “On-Device AI”

A streaming video model keeps the captions it wrote and drops the frames, and the same text decides what it remembers and when to speak.

A new benchmark measures how an assistant should work with you, and finds the memory breaks at write time, not at recall.

An open streaming diarizer runs on one CPU thread with flat memory, for the price of a one-second delay on speaker labels.

An open detector puts the discarded tone layer back into a transcript, and the accuracy is the honest part of the story.

Qualcomm gave the earbud a radio that reaches the cloud without the phone, and a 1-bit model that holds about four minutes of talk.

Qualcomm's claim of a 3B model at 45 tokens a second on the VR Glasses chip needs the puck's entire memory bus, by my arithmetic.

NVIDIA mapped the four ways to wire diarization into streaming ASR, and only the cheapest corner fits inside a wearable's power budget.

Apple's Watch now summarizes your conversations but refuses to keep a transcript or name the speaker, and that refusal is where the market lives.

On-device NPUs and edge voice models converged in the same week - the ambient wearable can finally build context locally.

Streaming diarization at sub-300ms unlocks the relationship graph that makes ambient coaching personal.

Google's SensorFM proves the ambient AI coach needs a physiological foundation model alongside the LLM.

Four states now classify neural data as sensitive - always-on mic data fits the same legal definition.

Muse Spark matches Llama 4 Maverick at 10x less compute and ships on $299 glasses.

Apple shipped a three-tier privacy stack that turns your messages, mail, and screen into agent infrastructure.