Feasibility of Real Time 3D Object Detection for Accessibility Use Cases

Muhammad Haj Ali, Rafael Damouni, Amjad Nassar, Ilan Shimshoni, Sarit F.A. Szpiro

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Augmented Reality (AR) holds promise for improving visibility and accessibility of real-world objects. AR systems, however, often rely on 2D overlays or marker-based methods, which face limitations such as camera's poor performance in low-light. We present a new approach to improve visual accessibility in AR. We developed a Unity-based application for the HoloLens 2, integrating Azure Object Anchors (AOA) for real-time 3D object detection with depth sensors. Using pre-scanned 3D models, the application detects and then projects virtual overlays on objects to increase their visibility while also logging eye gaze and spatial movement to enable evaluation of user interactions.

Original languageAmerican English
Title of host publicationProceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1178-1179
Number of pages2
ISBN (Electronic)9798331514846
DOIs
StatePublished - 2025
Event2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025 - Saint-Malo, France
Duration: 8 Mar 202512 Mar 2025

Publication series

NameProceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025

Conference

Conference2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
Country/TerritoryFrance
CitySaint-Malo
Period8/03/2512/03/25

Keywords

  • Accessibility
  • Augmented Reality
  • Visual Impairments

All Science Journal Classification (ASJC) codes

  • Media Technology
  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Human-Computer Interaction

Fingerprint

Dive into the research topics of 'Feasibility of Real Time 3D Object Detection for Accessibility Use Cases'. Together they form a unique fingerprint.

Cite this