Picture shows person pointing stylus to plastic model of a biological cell; webcam (not pictured) views model and stylus; computer, connected to webcam, announces "Nucleolus"

CamIO

CamIO (short for “Camera Input-Output”) is a system to make physical objects (such as documents, maps, devices and 3D models) accessible to blind and visually impaired persons, by providing real-time audio feedback in response to the location on an object that the user is touching. CamIO currently works on iOS using the built-in camera and an inexpensive hand-held stylus made out of paper and cardboard or wood.

See a video demonstration of CamIO here, showing how the user can create a new "hotspot" location (i.e., audio label), then get spatial guidance to help find this hotspot, which is triggered when the stylus touches the hotspot location.

See a presentation (pdf available here) of the latest CamIO research on March 12, 2020 at the CSUN Assistive Technology 2020 conference in Anaheim. This research describes a new accessible annotation feature that allows a blind or visually impaired user to independently create and record their own audio labels. This research is described in our CSUN Journal paper, "Towards Accessible Audio Labeling of 3D Objects," which was awarded the 2020 Dr. Arthur I. Karshmer Award for Assistive Technology Research!

CamIO is supported by a four-year grant from NIH/NEI (R01EY025332) and by the NIDILRR RERC grant (90RE5024-01-00).

Tabs

Conference Papers
Coughlan, J., Biggs, B., Rivière, M. - A., & Shen, H.. (2020). An Audio-Based 3D Spatial Guidance AR System for Blind Users. In 17th International Conference on Computers Helping People with Special Needs.
Mascetti, S., Gerino, A., Bernareggi, C., D’Acquisto, S., Ducci, M., & Coughlan, J.. (2017). JustPoint: Identifying Colors with a Natural User Interface. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). ACM: Baltimore, MD.
Coughlan, J., & Miele, J.. (2017). Evaluating Author and User Experience for an Audio-Haptic System for Annotation of Physical Models. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). ACM: Baltimore, MD.
Shen, H., Edwards, O., Miele, J., & Coughlan, J.. (2013). CamIO: a 3D computer vision system enabling audio/haptic interaction with physical objects by blind users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (p. 41). ACM.
  • Collage of RERC staff mebers and RERC projects

    Rehabilitation Engineering Research Center

    The Center's research goal is to develop and apply new scientific knowledge and practical, cost-effective devices to better understand and address the real-world problems of blind, visually impaired, and deaf-blind consumers

    Read More
Current