Meta's DINOv3 and SAM Power Edge-Based Assistive Robotics at Pittsburgh
Original titleReimagining Independence: How Meta’s AI Models Are Helping the University of Pittsburgh Transform Assistive Robotics
AISummary
The University of Pittsburgh's RAMMP team is integrating Meta's DINOv3 and SAM models into on-device assistive robotics to detect door buttons, cups, and curbs for navigation assistance.
The models run on compact, battery-powered hardware, with optimizations such as reduced memory footprint and lower precision, enabling real-time perception without network connectivity.
RAMMP's perception system pairs SAM-based auto-labeling with an RF-DETR detector fine-tuned on DINOv2 embeddings, and the team is now testing voice and touch input for object selection.
Source: Meta AI Blog · ai.meta.comPublished · added here