
Coughlan Lab
The goal of our laboratory is to develop and test assistive technology for blind and visually impaired persons that is enabled by computer vision and other sensor technologies.
Tabs









-
Rehabilitation Engineering Research Center
View CenterThe Center's research goal is to develop and apply new scientific knowledge and practical, cost-effective devices to better understand and address the real-world problems of blind, visually impaired, and deaf-blind consumers
-
Video Description Research and Development Center
View CenterThe Smith-Kettlewell Video Description Research and Development Center (VDRDC) investigates innovative technologies and techniques for making online video more accessible to blind and visually-impaired students and consumers. Through collaboration with a broad array of partners and stakeholders in the Description Leadership Network, we are developing advanced video annotation methods for use in a wide variety of educational settings, as well as helping educators and other description providers make better use of the tools already available.
-
Active
A Computer Vision-Based Indoor Wayfinding Tool
The ability to navigate safely and confidently is a fundamental requirement for independent travel and access to many settings such as work, school, shopping, transit and healthcare. Navigation is particularly challenging for people with visual impairments, who have limited ability to see signs, landmarks or maps posted in the environment.
-
Active
-
Active
-
Active
Computer Vision Journal Club
The Computer Vision Journal Club meets periodically to discuss papers on topics in computer vision, machine learning and other topics of interest such as assistive technologies for persons who are
-
Active
Magic Map
The Magic Map is an interactive 3D map installed at the Magical Bridge Playground in Palo Alto, California. It consists of a 1/100 scale 3D bronze representation of the playground, which includes over seventy play structures organized into multiple play zones and paths. When the tip of the "Magic Wand" tethered to the map is pointed to a specific feature on the map, the name and description of the feature are read aloud in audio. This interactivity makes the map accessible to visitors with visual impairments, and without requiring them to read braille.
-
Active
Sign Finder
This project seeks to develop a computer vision-based system that allows a visually impaired traveler to find and read informational signs, such as signs labeling office doors, streets, restrooms a
-
Active
Tactile Graphics Helper (TGH)
Tactile graphics use raised lines, textures, and elevations to provide individuals with visual impairments access to graphical materials through touch.
-
Active
-
Completed
-
Completed
Crosswatch
Crosswatch is a smartphone-based system developed for providing real-time guidance to blind and visually impaired travelers at traffic intersections.
-
Completed
Display Reader
The goal of the Display Reader project is to develop a computer vision system that runs on smartphones and tablets to enable blind and visually impaired persons to read appliance displays.
-
Completed
Regressions in Braille Reading
This project explores regressions (movements to re-read text) in braille reading.
The image on the right plots the braille reading finger movements in blue and regressions in black.
-
Completed
Tutorials and Reference
These are tutorials and reference materials I have written on various topics in probability and geometry over the years.
-
Completed
- Ali Cheraghi - Postdoctoral Fellow
- Brandon Biggs - Engineer
- Charity Pitcher-Cooper - Scientific Program Coordinator
- Christopher Toth - Engineer
- Huiying Shen - Staff
- Ryan Crabb - Computer Vision Engineer
- Alejandro Rituerto - Head of R&D in Vision at Mybrana
- Daisy Lei - Lab Assistant
- Ender Tekin - Associate Scientist at The University of Wisconsin-Madison
- Giovanni Fusco - Engineering Manager and Lead Machine Learning Eng., Pixofarm
- Laura Walker - Senior Visual Experience Engineer, Apple, Cupertino CA
- Pannag Sanketi - Tech Lead Manager/Senior Staff Software Engineer at Google
- Santani Teng - Associate Scientist
- Valerie Morash - Postdoctoral Fellow, Psychology
- Vidya Murali - Technical expert in applied machine learning at Ford Research
- Volodymyr Ivanchenko - Software Engineer at Waymo
-
SKERI Receives Rehabilitation Engineering Research Center (RERC) grant on...
Smith-Kettlewell is proud to announce the newly awarded Rehabilitation Engineering Research Center (RERC) grant on Blindness and Low Vision. This is a five-year grant from the National Institute on Disability, Independent Living, and Rehabilitation Research, establishing Smith-Kettlewell as a center promoting the independence and well-being of people with visual impairments through research and development to improve the understanding of, and provide solutions for, challenges facing the blind and low-vision community. -
SKERI Engineer Featured on the Blind Abilities Podcast
SKERI engineer, Brandon Biggs, was featured on the Blind Abilities podcast to discuss Audiom - a SKERI Rehabilitation Engineering Research Center -
Audiom allows for accessible, virtual visits to the Magical Bridge...
The Magical Bridge Foundation mission is to bring inclusive, accessive playgrounds that can be enjoyed by all children. For the first time, it is now possible for blind and visually impaired visitors to view a nonvisual map of the Magical Bridge Playground in Palo Alto, at home, directly from their web browser using Audiom . Audiom was developed by Smith-Kettlewell researcher, Brandon Biggs , is... -
SKERI Researcher talks Indoor Navigation & Mapping on Blind Bargains
The work of Dr. James Coughlan and Brandon Biggs was again recognized at the annual CSUN conference, where Brandon was interviewed for a podcast on Blind Bargains, a source for news and resources for the blind community. -
SKERI Research Recognized with the Dr. Arthur I. Karshmer Award for...
We congratulate Dr. James Coughlan , Dr. Huiying Shen and Brandon Biggs, MDes on winning the Dr. Arthur I. Karshmer Award for Assistive Technology Research with their publication Towards Accessible Audio Labeling of 3D Objects that aims to harness smart phone-based technology to query information about a multitude of objects in users' daily lives. The award is given out annually to the top... -
Brandon Biggs brings his ideas for accessibility to SKERI
We’re excited to welcome Brandon Biggs to the Smith-Kettlewell Eye Research Institute. Brandon arrived in August to collaborate with Dr. Coughlan, Dr. Shen and Dr. Fusco to work on accessibility research and development. This collaboration started last year, when Brandon met Dr. Coughlan at the Association for Education and Rehabilitation of the Blind and Visually Impaired (AER) International Conference in Reno, Nevada. Brandon was then enrolled in a Master’s program in Inclusive Design at OCAD University in Toronto, Canada, which he completed in June. -
Scientists Receive NEI Grant Aiding Blind Interaction with Physical Objects
James Coughlan, PhD, Senior Scientist at the Smith-Kettlewell Eye Research Institute, San Francisco, California, was recently awarded a four-year grant from NIH-NEI (R01EY025332) entitled, “Enabling Audio-Haptic Interaction with Physical Objects for the Visually Impaired Summary". -
Dr. Coughlan's Bar Code Reader, BLaDE, Featured in Scientific American
Work by Drs. James Coughlan and Ender Tekin on bar code readers as an accessibility tool is discussed in Scientific American. The work with using these tools is specifically focused for people who are blind or who have visual impairments.