Back to Blog
Posts tagged “Meta”
When the Agent Is Free, the Loss Budget Wins
Meta priced the glasses near cost and will give Muse away free; the Reality Labs loss is the subsidy that pendant startups cannot match.- Market
- Wearable AI
- Meta
- Proactive AI
- Ambient Computing
Approving a Purchase Out Loud
Muse asks before it spends your money. Camera-free glasses have no screen to ask on, so the approval has to land on another device.- Smart Glasses
- Wearable AI
- Agent Architecture
- Security
- Trust UX
- Meta
Lip-Sync Debt
Meta's avatar model draws 320 ms chunks that an agent's turn can hide. Driven by a live caller's voice, a chunk would put lips at least 340 ms late.- Smart Glasses
- Wearable AI
- Speech AI
- Foundation Models
- Meta
Can Meta's Cloud Remember What It Cannot Read?
Meta's Private Processing was built to forget. Its design for AI glasses remembers: ciphertext on Meta's servers, the key on your device.- Privacy
- Smart Glasses
- Personal Context
- Security
- Agent Architecture
- Meta
Nine and a Quarter Milliseconds
Meta's FDA filing puts its glasses hearing loop at 9.25 ms. In an open ear that delay is audible, and its costs belong to the frame, not firmware.- Smart Glasses
- Wearable AI
- Sensing
- Speech AI
- Meta
What the Puck Can Afford to Think
Qualcomm's claim of a 3B model at 45 tokens a second on the VR Glasses chip needs the puck's entire memory bus, by my arithmetic.- On-Device AI
- Edge Computing
- Smart Glasses
- Agent Architecture
- Meta
The Silicon at Both Ends of Meta's Tether
By my arithmetic, Meta's VR Glasses panels need up to 40 Gbps uncompressed, more than the Qualcomm chip's one DisplayPort 1.4 output carries.- Smart Glasses
- Sensing
- Edge Computing
- Platform Architecture
- Meta
Final Day at Meta: Four Years Complete
My last day at Meta. Reflections on the journey, gratitude for the team, and anticipation for what's next.- Meta
- Farewell
- Career
- Reflection
- VPS
Decision Made: Leaving Meta
After four years building VPS, I've decided to leave Meta. The reasoning, the emotions, and what comes next.- Career
- Decision
- Meta
- Transition
- Future
Generative AI Meets Spatial Computing
How large language models and generative AI are changing spatial computing - from scene understanding to content creation.- Generative AI
- LLM
- Spatial Computing
- VPS
- Meta
Approaching Four Years: Reflections on the Meta Journey
Three and a half years building VPS at Meta - from inception to platform. Considering what's next.- Retrospective
- Meta
- Career
- VPS
- Reflection
Quest 3 Launch: VPS at Consumer Scale
Quest 3 brings VPS to mainstream consumers - the largest deployment yet and what we learned.- Quest 3
- Launch
- Scale
- VPS
- Meta
VPS for Ray-Ban Meta AI Glasses
Bringing visual positioning to consumer smart glasses - extreme power constraints and new use cases.- Smart Glasses
- Ray-Ban Meta
- VPS
- Wearables
- Meta
Preparing VPS for Quest 3
Quest 3's improved hardware creates opportunities for VPS - better cameras, more compute, and MR-first design.- Quest 3
- Hardware
- VPS
- Preparation
- Meta
Two Years at Meta: From Zero to Platform
VPS evolved from concept to platform in two years - reflecting on the journey, the team, and what's next.- Retrospective
- Meta
- VPS
- Platform
- Leadership
Quest Pro Launch: VPS in Mixed Reality
Launching VPS as part of Quest Pro's mixed reality system - integration challenges, launch metrics, and lessons.- Launch
- Quest Pro
- Mixed Reality
- VPS
- Meta
Crowdsourced Mapping: Scaling Through Users
Enabling users to contribute to mapping - the technical architecture, privacy model, and quality challenges.- Crowdsourcing
- Mapping
- Scale
- Privacy
- Meta
Quest Pro and Mixed Reality: New Requirements for VPS
How Quest Pro's mixed reality capabilities change the requirements for visual positioning - higher accuracy, lower latency, always-on.- Quest Pro
- Mixed Reality
- VPS
- Requirements
- Meta
Neural Map Compression: Shrinking 3D Maps 100x
Using neural representations to dramatically compress 3D maps - enabling device-side map storage and faster queries.- Neural Networks
- Compression
- Maps
- VPS
- Meta
One Year at Meta: VPS Progress Report
A year of building Visual Positioning Service: what shipped, what stalled, and what I would do differently.- Retrospective
- Meta
- VPS
- Year Review
Scaling the Team: From 15 to 50
Growing a team 3x in one year - hiring, onboarding, structure, and maintaining culture through rapid growth.- Team Building
- Hiring
- Leadership
- Scaling
- Meta
Production ML Systems: Beyond Model Training
What it takes to run ML in production at scale - monitoring, versioning, deployment, and all the things that aren't training.- MLOps
- Production
- Infrastructure
- Deep Learning
- Meta
Indoor Visual Positioning: Different Beast Entirely
Why indoor localization is much harder than outdoor - GPS absence, feature similarity, and the path forward.- Indoor
- Localization
- VPS
- Challenges
- Meta
VPS for Smart Glasses: Ray-Ban Stories Considerations
Adapting visual positioning for smart glasses form factor - different sensors, different constraints, different use cases.- Smart Glasses
- Ray-Ban
- VPS
- Wearables
- Meta
Scaling Mapping Operations
From 50 to 500 mapped locations - the operational challenges of scaling 3D mapping worldwide.- Mapping
- Operations
- Scale
- VPS
- Meta
VPS MVP Launch: First Real Users
Launching the first version of Visual Positioning Service to external developers - what worked, what didn't, and what we learned.- Launch
- VPS
- MVP
- Product
- Meta
Privacy-Preserving Visual Localization
How to localize without compromising privacy - on-device processing, feature design, and differential privacy approaches.- Privacy
- Localization
- Security
- VPS
- Meta
Virtual Engineering: Designing Hardware in Simulation
Using high-fidelity simulation to design and validate perception hardware before silicon exists - extending synthetic data to hardware design.- Virtual Engineering
- Simulation
- Hardware Design
- Sensors
- Meta
Keeping Maps Fresh: The Temporal Challenge
Maps go stale as the world changes. Strategies for detecting and handling changes in visual positioning.- Mapping
- Change Detection
- Maintenance
- VPS
- Meta
Learned Features for Visual Localization
Moving from hand-crafted to learned feature descriptors for VPS - training, deployment, and performance gains.- Deep Learning
- Features
- Localization
- Computer Vision
- Meta
Integrating VPS with Quest: On-Device Constraints
The challenges of bringing visual positioning to Quest headsets - power, latency, and the cloud-device split.- Quest
- VPS
- Integration
- Embedded
- Meta
Six Months at Meta: Reflections on Scale
Half a year in - what I've learned about operating at Meta scale and building VPS from inception.- Meta
- Reflection
- Scale
- VPS
- Leadership
Synthetic Data at Meta Scale
Bringing synthetic data practices from Magic Leap to Meta - what scales, what doesn't, and new opportunities.- Synthetic Data
- Scale
- Training Data
- Deep Learning
- Meta
6DoF Localization: From Image to Pose
The technical pipeline for localizing a device using visual features - retrieval, matching, and pose estimation.- Localization
- Computer Vision
- Feature Matching
- VPS
- Meta
Global-Scale 3D Mapping: The Data Challenge
Building 3D maps of the entire world - data sources, quality challenges, and the path to coverage.- 3D Mapping
- Data
- Scale
- VPS
- Meta
Visual Positioning System: Architecture Overview
High-level architecture of the Visual Positioning Service - how XR devices can localize themselves in the world.- VPS
- Architecture
- Localization
- 3D Mapping
- Meta
Joining Meta: Day One in Reality Labs
First impressions joining Meta's Reality Labs to lead Visual Positioning Service - different scale, familiar problems.- Meta
- Career
- VPS
- Reality Labs
- New Job