Picture shows person pointing stylus to plastic model of a biological cell; webcam (not pictured) views model and stylus; computer, connected to webcam, announces "Nucleolus"

CamIO

CamIO (short for “Camera Input-Output”) is a system to make physical objects (such as documents, maps, devices and 3D models) accessible to blind and visually impaired persons, by providing real-time audio feedback in response to the location on an object that the user is touching. CamIO currently works on two platforms, a Windows computer with a conventional webcam and iOS using the built-in camera.

See a video demonstration of CamIO here, showing how the system begins announcing information about a "hotspot" location as soon as the stylus touches that location, and immediately ceases this announcement when the stylus moves away from the hotspot.

See a presentation (pdf available here) of the latest CamIO research on March 14, 2019 at the CSUN Assistive Technology 2019 conference in Anaheim.

CamIO is supported by a four-year grant from NIH/NEI (R01EY025332) and by the NIDILRR RERC grant (90RE5024-01-00).

Tabs

Conference Papers
Mascetti, S., Gerino, A., Bernareggi, C., D’Acquisto, S., Ducci, M., & Coughlan, J.. (2017). JustPoint: Identifying Colors with a Natural User Interface. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). Baltimore, MD: ACM. (Original work published 2017)
Coughlan, J., & Miele, J.. (2017). Evaluating Author and User Experience for an Audio-Haptic System for Annotation of Physical Models. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). Baltimore, MD: ACM. (Original work published 2017)
Coughlan, J., & Miele, J.. (2017). AR4VI: AR as an Accessibility Tool for People with Visual Impairments. In AR for Good, part of ISMAR 2017. Nantes, France: IEEE. (Original work published 2017)
Shen, H., Edwards, O., Miele, J., & Coughlan, J.. (2013). CamIO: a 3D computer vision system enabling audio/haptic interaction with physical objects by blind users. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (p. 41). ACM.
  • Coughlan Lab

    The goal of our laboratory is to develop and test assistive technology for blind and visually impaired persons that is enabled by computer vision and other sensor technologies.

    Read More