L to R: Huiying Shen, Ali Cheraghi, Brandon Biggs, James Coughlan, Charity Pitcher-Cooper, Giovanni Fusco

Coughlan Lab

The goal of our laboratory is to develop and test assistive technology for blind and visually impaired persons that is enabled by computer vision and other sensor technologies.

Tabs

Journal Articles
Ahmetovic, D., Manduchi, R., Coughlan, J., & Mascetti, S.. (2017). Mind your crossings: Mining GIS imagery for crosswalk localization. Acm Transactions On Accessible Computing (Taccess), 9(4). http://doi.org/10.1145/3046790
Tekin, E., Vásquez, D., & Coughlan, J.. (2013). S-K Smartphone Barcode Reader for the Blind. Journal On Technology And Persons With Disabilities, 1.
Manduchi, R., & Coughlan, J.. (2012). (Computer) vision without sight. Communications Of The Acm, 55, 96–104.
Shen, H., Coughlan, J., & Ivanchenko, V.. (2009). Figure-ground segmentation using factor graphs. Image And Vision Computing, 27, 854–863.
Yuille, A. L., Coughlan, J., & Konishi, S.. (2003). The KGBR viewpoint-lighting ambiguity. Journal Of The Optical Society Of America (Josa) A, 20(1).
Yuille, A. L., Coughlan, J., & Konishi, S.. (2001). The KGBR viewpoint-lighting ambiguity and its resolution by generic constraints. Computer Vision, 2001. Iccv 2001. Proceedings. Eighth Ieee International Conference On, 2, 376–382.
Conference Papers
Coughlan, J., Biggs, B., Rivière, M. - A., & Shen, H.. (2020). An Audio-Based 3D Spatial Guidance AR System for Blind Users. In 17th International Conference on Computers Helping People with Special Needs.
Fusco, G., Cheraghi, S. Ali, Neat, L., & Coughlan, J.. (2020). An Indoor Navigation App using Computer Vision and Sign Recognition. In 17th International Conference on Computers Helping People with Special Needs.
Fusco, G., & Coughlan, J.. (2020). Indoor Localization for Visually Impaired Travelers Using Computer Vision on a Smartphone. In 17th International Web for All Conference: Automation for Accessibility.
Biggs, B., Coughlan, J., & Coppin, P.. (2019). Design and Evaluation of an Audio Game-Inspired Auditory Map Interface. In The 25th International Conference on Auditory Display (ICAD 2019). Northumbria University, Newcastle-upon-Tyne, UK: Northumbria University, Newcastle-upon-Tyne, UK.
Fusco, G., & Coughlan, J.. (2018). Indoor Localization using Computer Vision and Visual-Inertial Odometry. In International Conference on Computers Helping People with Special Needs (ICCHP '18). Linz, Austria: Linz, Austria.
Mascetti, S., Gerino, A., Bernareggi, C., D’Acquisto, S., Ducci, M., & Coughlan, J.. (2017). JustPoint: Identifying Colors with a Natural User Interface. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). ACM: Baltimore, MD.
Coughlan, J., & Miele, J.. (2017). Evaluating Author and User Experience for an Audio-Haptic System for Annotation of Physical Models. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). ACM: Baltimore, MD.
Coughlan, J., & Miele, J.. (2017). AR4VI: AR as an Accessibility Tool for People with Visual Impairments. In AR for Good, part of ISMAR 2017. IEEE: Nantes, France.
Rituerto, A., Fusco, G., & Coughlan, J.. (2016). Towards a Sign-Based Indoor Navigation System for People with Visual Impairments. In 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM: Reno, NV.
Active
  • map pose and exit detection image
    Active

    A Computer Vision-Based Indoor Wayfinding Tool

    The ability to navigate safely and confidently is a fundamental requirement for independent travel and access to many settings such as work, school, shopping, transit and healthcare. Navigation is particularly challenging for people with visual impairments, who have limited ability to see signs, landmarks or maps posted in the environment.

    Read More
  • Active

    Audiom

    Audiom is a tool that allows blind and visually impaired individuals to view maps completely in audio. It is a web component and can be embedded into any webpage, similar to Google Maps.

    Read More
  • Picture shows person pointing stylus to plastic model of a biological cell; webcam (not pictured) views model and stylus; computer, connected to webcam, announces "Nucleolus"
    Active

    CamIO

    CamIO (short for “Camera Input-Output”) is a system to make physical objects (such as documents, maps, devices and 3D models) accessible to blind and visually impaired persons, by providing real-ti

    Read More
  • Active

    Computer Vision Journal Club

    The Computer Vision Journal Club meets periodically to discuss papers on topics in computer vision, machine learning and other topics of interest such as assistive technologies for persons who are

    Read More
  • Sample indoor sign showing automatic detection in yellow
    Active

    Sign Finder

    This project seeks to develop a computer vision-based system that allows a visually impaired traveler to find and read informational signs, such as signs labeling office doors, streets, restrooms a

    Read More
  • Active

    Tactile Graphics Helper (TGH)

    Tactile graphics use raised lines, textures, and elevations to provide individuals with visual impairments access to graphical materials through touch.

    Read More
  • ZoomBoard overview
    Active

    ZoomBoard: an Affordable, Portable System to Improve Access to Presentations and Lecture Notes for Low Vision Viewers

    Read More
Completed
Current
Past

Principal Investigator:

Photo of James Coughlan wearing glasses and blue shirt

James Coughlan

Contact: 

2318 Fillmore St. San Francisco CA 94115 (415) 345-2146

External Collaborators: 

Roberto Manduchi

Funding: 

Enabling Audio-Haptic Interaction with Physical Objects for the Visually Impaired

EAGER: Collaborative Research: Malleable Media to Support Interaction through Bi-Directional Touch Displays

Leveraging Maps and Computer Vision to Support Indoor Navigation for Blind Travelers

ZoomBoard: An Affordable, Portable System to Improve Access to Presentations and Lecture Notes for Low Vision Viewers

Tactile Graphics Helper iOS App Project