Rehabilitation Engineering Research Center
The Center's research goal is to develop and apply new scientific knowledge and practical, cost-effective devices to better understand and address the real-world problems of blind, visually impaired, and deaf-blind consumers. The RERC has many ongoing R&D projects and collaborative relationships, both internal and external to Smith-Kettlewell. Primary funding for the RERC comes from the National Institute on Disability and Rehabilitation Research, with other important sources of support, including the National Eye Institute, and The Smith-Kettlewell Eye Research Institute.
Please check out the latest news about the RERC on Twitter.
Tabs
Journal Articles
. (2023). A Lightweight Approach to Localization for Blind and Visually Impaired Travelers. Sensors, 23(5). http://doi.org/https://doi.org/10.3390/s23052701
. (2023). You Described, We Archived: A Rich Audio Description Dataset. Journal On Technology And Persons With Disabilities, 11.
. (2023). VR Training to Facilitate Blind Photography for Navigation. Journal On Technology And Persons With Disabilities.
. (2022). Getting in Touch with Tactile Map Automated Production: Evaluating Impact and Areas for Improvement. Journal On Technology And Persons With Disabilities, 10.
. (2021). Higher Visual Function Deficits in Children With Cerebral Visual Impairment and Good Visual Acuity. Frontiers In Human Neuroscience , 15. http://doi.org/10.3389/fnhum.2021.711873
. (2021). Motion processing deficits in children with Cerebral Visual Impairment and good visual acuity. Date Published 09/2021.
. (2020). Simple Vision Function Tests that Distinguish Eyes with Early to Intermediate Age-related Macular Degeneration. Ophthalmic Epidemiology, 10, 1-12. http://doi.org/10.1080/09286586.2020.1793371
. (2018). Vision Function in Early to Intermediate AMD: Progression to Advanced AMD. Investigative Ophthalmology Vis. Sci., 59(9).
. (2017). Reading Performance in Intermediate Age-related Macular Degeneration: Context Effects. Investigative Ophthalmology & Visual Science, 58(8), 4701.
. (2017). How a diverse research ecosystem has generated new rehabilitation technologies: Review of NIDILRR's Rehabilitation Engineering Research Centers. Journal Neuroengineering Rehab, 14, 109.
Conference Papers
. (2022). Evaluation of a Non-Visual Auditory Choropleth and Travel Map Viewer. In International Conference on Auditory Display (ICAD) 2022. Virtual: Virtual. Retrieved from PMCID: PMC10010675
. (2022). Non-Visual Access to an Interactive 3D Map. In Joint International Conference on Digital Inclusion, Assistive Technology & Accessibility (ICCHP-AAATE '22).
. (2021). Point and Listen: Bringing a 3D Map to Life with Audio-Based AR. In 6th Annual Frameless XR Symposium.
. (2021). A Tangible Block Editor for the Scratch Programming Language. In CHI 2021. ACM: Yokohama, Japan.
. (2020). Indoor Localization for Visually Impaired Travelers Using Computer Vision on a Smartphone. In 17th International Web for All Conference: Automation for Accessibility.
. (2019). Modeling echo-target acquisition in blind humans. In Conference on Cognitive Computational Neuroscience. Conference on Cognitive Computational Neuroscience: Berlin, Germany.
. (2019). Design and Evaluation of an Audio Game-Inspired Auditory Map Interface. In The 25th International Conference on Auditory Display (ICAD 2019). Northumbria University, Newcastle-upon-Tyne, UK: Northumbria University, Newcastle-upon-Tyne, UK.
. (2017). JustPoint: Identifying Colors with a Natural User Interface. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). ACM: Baltimore, MD.
. (2017). Evaluating Author and User Experience for an Audio-Haptic System for Annotation of Physical Models. In 19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017). ACM: Baltimore, MD.
. (2017). AR4VI: AR as an Accessibility Tool for People with Visual Impairments. In AR for Good, part of ISMAR 2017. IEEE: Nantes, France.
Presentations/Posters
. (2022). Audiom: an Auditory Web-Based Geographic Map Viewer Showing COVID-19 State Data and a Travel Map. International Conference on Auditory Display (ICAD) 2022.
. (2021). Assessment and management of cerebral visual impairment (CVI). . Date Published 04/2021, CTEBVI.
. (2021). The spectrum of reading difficulties in children with Cerebral Visual Impairment (CVI): a qualitative study. Date Published 05/2021, ARVO.
. (2021). Characterization of Higher Visual Function Deficits (HVFDs) with a Question Inventory in children with Cerebral Visual Impairment (CVI) and good visual acuity (VA). Date Published 05/2021, ARVO.
. (2021). Neural representations of temporal and spectral regularities of reverberant environments. Date Published 11/2021, 50th Society of Neuroscience Annual Meeting: Chicago/ Virtual.
. (2021). Making remote studies accessible during COVID: A SKERI case study on web-based psychophysical research with blind participants. Date Published 07/2021, Rehabilitation Engineering and Assistive Technology Society of North America (RESNA) Annual Meeting: Virtual.
. (2021). Visual experience modulates sensitivity to statistics of reverberation. Date Published 05/2021, Vision Sciences Society Annual Meeting: Virtual.
. (2020). The haptic kinematics of two-handed braille reading in blind adults. Date Published 09/2020, Eurohaptics: Semi-virtual; Leiden, The Netherlands. Retrieved from https://www.ski.org/project/haptic-kinematics-two-handed-braille-reading-blind-adults
. (2018). Reading in mild to moderate traumatic brain injury (mTBI). Date Published 10/2018.
Other Publications
. (2022). Remote Co-Design in the Digital Age. In Handbook of Disability.
. (2021). The Unstoppable Utility of YouDescribe. Wireless RERC 2021 State of Technology Forum Proceedings. Date Published 09/2021.
. (2012). Towards a real-time system for finding and reading signs for visually impaired users. In Computers Helping People with Special Needs (pp. 41–47). Springer Berlin Heidelberg.
. (2010). Assistive Technologies for the Blind. In Sage Encyclopedia of Perception (pp. 64-67). Goldstein, B. (Ed.) Sage Publications: Thousand Oaks, CA.
. (2010). Sensory Rehabilitation. In Sage Encyclopedia of Perception (pp. 881-883). Goldstein, B. (Ed) Sage Publications: Thousand Oaks, CA.
. (2008). Vision. In Lange, M (Ed.) Fundamentals in Assistive Technology: An Introduction in Assistiave Technology Implementation in the Lives of People with Disabilities (4th ed., pp. 293-311). Resna Press: Arlington, VA.
. (2007). Aids for people who are blind or visually impaired. In Cooper, RA, Ohnabe H, Hobson D, (Eds.) An Introduction to Rehabilitation Engineering (pp. 287-313). Taylor & Francis: New York.
. (2006). Sensory Aids. In Akay, M. (Ed), Wiley Encyclopedia of Biomedical Engineering. John Wiley & Sons: New Jersey.
. (2000). Signage and wayfinding. In Silverstone, Lang, Rosenthal & Faye (Eds), The Lighthouse Handbook on Visual Impairment and Vision Rehabilitation (Vol. 1–2). Oxford University Press: New York.
. Visual Impairment: Ergonomic Considerations in Blind and Low Vision Rehabilitation. In Kumar, S. (Ed.), Perspectives in Rehabilitation Ergonomics (Vol. 1). Taylor & Francis: London.
Upcoming Events
There are no Upcoming Events at this time
Past Events
-
A State of the Science Virtual Conference on Rehabilitation Technology and Methods in Blindness and Low Vision
Past Event Date:
The goal of this conference is to identify needs for future research in rehabilitation technology, methods for the blind and visually impaired population, and those with dual sensory loss.
View Past Event -
A State of the Science Conference On Rehabilitation Technology & Methods For a Changing Population
Past Event Date:
The goal of this invitation-only conference is to identify needs for future research in rehabilitation technology, methods for the blind and visually impaired population, and those with dual sensory loss.
View Past Event
-
Chandna Lab (SEELAB)
We use rigorous scientific research with the goal to improve detection and treatment outcomes for individuals with strabismus, amblyopia, and cerebral visual impairment.
View Lab -
-
Shanidze Lab
Our laboratory is interested in the mechanisms of eye and head movement and coordination and how those mechanisms are altered when visual or vestibular inputs are compromised.
View Lab -
Teng Lab
We aim to better understand how people perceive, interact with, and move through the world, especially when vision is unavailable. To this end, the lab studies perception and sensory processing in multiple sensory modalities, with particular interests in echolocation and braille reading in blind persons. We are also interested in mobility and navigation, including assistive technology using nonvisual cues. These are wide-ranging topics, which we approach using a combination of psychophysical, neurophysiological, engineering, and computational tools.
View Lab -
Verghese Lab
Our laboratory studies the mechanisms of healthy vision and action, as well as the basis of attention and visual adaptation in clinical populations.
View Lab
Active
-
ActiveComputer Vision Journal Club
The Computer Vision Journal Club meets periodically to discuss papers on topics in computer vision, machine learning and other topics of interest such as assistive technologies for persons who are
View Project -
ActiveAcoustic Cues for Wayfinding
This project aims to do a detailed analysis of the environmental acoustic cues that help some blind navigate successfully.
View Project -
ActiveTactile Graphics Helper (TGH)
Tactile graphics use raised lines, textures, and elevations to provide individuals with visual impairments access to graphical materials through touch.
View Project -
Active
Reading in mTBI
People with mTBI often complain about dificulty in reading in spite of normal results in usual eye exams.
View Project -
ActiveHuman Echolocation
What is echolocation? Sometimes, the surrounding world is too dark and silent for typical vision and hearing.
View Project -
ActiveCamIO
CamIO (short for “Camera Input-Output”) is a system to make physical objects (such as documents, maps, devices and 3D models) accessible to blind and visually impaired persons, by providing real-ti
View Project -
Active
Investigating Reading in Individuals with Cerebral Visual Impairment (CVI)
In this project, we aim to understand (i) how CVI affects reading, (ii) how current rehabilitation techniques or assistive technologies help improve reading in CVI and (iii) what more can be done to assist those individuals with CVI
View Project -
Activet-Scratch: Tangible Programming Environment
tScratch: Tangible Programming Environment Targeted for Students who are Blind or Visually Impaired
View Project -
ActiveCerebral Visual Impairment (CVI): An in-depth study of visual functioning in everyday life
The purpose of this research study is to learn about how cerebral visual impairment affects everyday visually guided behaviours and determine interventions to treat the difficulties. This study is conducted remotely through telephone or video link and also in person at the laboratory.
View Project -
ActiveA Computer Vision-Based Indoor Wayfinding Tool
The ability to navigate safely and confidently is a fundamental requirement for independent travel and access to many settings such as work, school, shopping, transit and healthcare. Navigation is particularly challenging for people with visual impairments, who have limited ability to see signs, landmarks or maps posted in the environment.
View Project -
Active -
ActiveYouDescribe
YouDescribe is a free, web-based platform for adding audio description to YouTube content.
View Project -
ActiveSign Finder
This project seeks to develop a computer vision-based system that allows a visually impaired traveler to find and read informational signs, such as signs labeling office doors, streets, restrooms a
View Project -
Active -
ActiveThe 3 Ps of 3D: Perception, Pedagogy, and Practice for 3D Printing
3D printing is increasingly used in STEM education. How can it be made accessible to students who are blind or visually impaired?
View Project
-
CompletedRegressions in Braille Reading
This project explores regressions (movements to re-read text) in braille reading.
The image on the right plots the braille reading finger movements in blue and regressions in black.
View Project -
Completed -
CompletedThe Smith-Kettlewell Haptics Symposium
The Smith-Kettlewell Haptics Symposium was held on March 29, 2018 to honor and remember Dr. Val Morash and her research.
View Project -
Completed
Video-Based Speech Enhancement for Persons with Hearing and Vision Loss
Observing the visual cues from a speaker such as the shape of the lips and facial expression can greatly improve the speech comprehension capabilities of a person with hearing loss. However, concurrent vision loss can lead to a significant loss in speech perception. We propose developing a prototype device that utilizes a video camera in addition to audio input to enhance the speech signal from a target speaker in everyday situations.
View Project -
CompletedCrosswatch
Crosswatch is a smartphone-based system developed for providing real-time guidance to blind and visually impaired travelers at traffic intersections.
View Project -
CompletedBLaDE
BLaDE (Barcode Localization and Decoding Engine) is an Android smartphone app designed to enable a blind or visually impaired user find and read product barcodes.
View Project -
CompletedDisplay Reader
The goal of the Display Reader project is to develop a computer vision system that runs on smartphones and tablets to enable blind and visually impaired persons to read appliance displays.
View Project -
CompletedAudio/Tactile Graphics Using LiveScribe Smartpen
Active from 2007 to 2010, this project was the first exploration of using a digital smartpen as a platform for creating and presenting audio/tactile graphics – a system of using touch-based audio t
View Project -
CompletedTactile Map Automated Production (TMAP)
Smith-Kettlewell's Tactile Map Automated Production (TMAP) Project was initiated with the goal of developing the first web-based software tool for rapid production of highly specific, tactile street maps of any location in the USA.
View Project -
CompletedAudio/Tactile BART Station Maps
This collaborative project between Smith-Kettlewell and the San Francisco LightHouse applies Smartpen-Based audio/tactile graphics tools to improve orientation and wayfinding by travelers with visual disabilities in and around unfamiliar transit stations.
View Project -
CompletedHearing Aid for Blind Travelers with Hearing Loss
Blind travelers rely on subtle acoustic cues for independent mobility. When hearing becomes impaired, as in the normal aging process, a special type of hearing aid may be needed to enhance these cues.
View Project -
Completed
Assessment of Speechreading with Dual Sensory Loss: Visual and Hearing Impairments
The purpose of this research study is to test subjects who have various hearing and vision problems on their lipreading, visual and auditory skills in order to understand the relationships between
View Project
-
InactiveLow Vision Computer Access
Dr. Deborah Gilden wants to ensure that people who work with low vision students, clients, or patients, or have a visually impaired friend or family member, know that many features built into the Windows OS, MS Office applications, and the Internet, often can serve as tools for low vision computer access.
View Project -
InactiveRobotic Fingerspelling Hand for Communicating with Deaf-Blind People
A robotic fingerspelling hand would give anyone who can type the ability to communicate with deaf-blind people who know tactile fingerspelling. It also would have the potential to provide computer access to deaf-blind people who do not read Braille.
View Project -
InactiveBraille, Assistive Technology, and Reading Comprehension
This project explores the impact of presentation mode (braille vs.
View Project -
InactiveClassification and Coding Projects
One of Dr Colenbrander's persistent interests has been in classification and coding. In the 1960’s he participated in the development of a new ophthalmic coding system in the Netherlands.
View Project -
InactiveFunctional Assessment - Guidelines and Reports
Combining his interests in classification and in vision rehabilitation, Dr. Colenbrander has promoted a better understanding of the various aspects of vision loss, their causes, and above all their consequences for the person.
View Project -
InactiveLow Vision Support Group
Join Dr. Don Fletcher, one of the world’s leading authorities on Low Vision Rehabilitation, to share experiences and learn about the things that help you maintain a full and happy life while living with low vision.
View Project -
InactiveFunctional Assessment - Book Chapters
Categorization of visual functioning requires appropriate measurement methods. Dr.
View Project -
InactiveFunctional Assessment - Contrast Sensitivity
For eye doctors measuring contrast sensitivity loss during routine eye exams is not a priority, since contrast losses are n
View Project -
InactiveFunctional Assessment - Reading
Difficulty reading is the most common complaint of low vision patients. It is the Activity of Daily Living that is most closely
View Project -
Inactive
-
InactiveFunctional Assessment - Visual Fields
Most patients are unaware of their visual field defects and scotomata, be it from AMD, from glaucoma, from RP, or from other causes. Dr. Colenbrander developed an improved functional scoring system for visual fields, as part of the Functional Vision Score system (see Guidelines)
View Project -
InactiveBlind Arduino Project
The Blind Arduino Project grew out of a community effort led by Dr.
View Project -
Inactive
Wearabraille
WearaBraille is a research project into wearable computing, and the use of MEMS sensors as novel input technology to mobile devices such as laptops, PDAs and smartphones. Our prototype device funct
View Project -
Inactive -
InactiveoverTHERE
overTHERE is a virtual Talking Signs iPhone app for blind and visually-impaired pedestrians that demonstrates a powerful audio/haptic interface to location information about businesses and other points of interest.
View Project -
InactiveRERC Center Grant
The RERC Center Grant funds a number of projects for blind and visually impaired persons. The projects broadly fall into the categories of Functional Assessment, Access to Spatial and Graphic Information, and STEM Education.
View Project -
InactiveDescribeathon 2019 Announced!
Join Describeathon 2019! Help make YouTube videos more accessible to blind viewers by adding your voice to this day of description.
Use YouDescribe, our free web-based description tool, to describe the visuals of your favorite YouTube videos and have fun doing it!
View Project -
Inactive
Current
- Al Lotze - Research Assistant
- Anca Velisar - Research Associate
- Arvind Chandna - Senior Clinician-Scientist/Pediatric Ophthalmologist & Adult Strabismus Surgeon
- Charity Pitcher-Cooper - Scientific Program Coordinator
- Gunilla Haegerstrom-Portnoy - Affiliate Senior Scientist
- Helen J. Simon - Scientist
- Huiying Shen - Staff
- James Coughlan - Senior Scientist - Coughlan Lab Director
- John Brabyn - Smith-Kettlewell Executive Director and RERC Director
- Natela Shanidze - Scientist
- Preeti Verghese - Senior Scientist
- Santani Teng - Associate Scientist
- Sile O'Modhrain
- William Good - Senior Scientist (Clinical)
-
SKERI scientists release Tactile Graphics Helper app for free download
TGH (short for “Tactile Graphics Helper”) is a free iOS app from The Smith-Kettlewell Eye Research Institute that makes tactile graphics more accessible to people with visual impairments.
View News -
Relaunch of YouDescribe
On May 18, 2017, in honor of the sixth Global Accessibility Awareness Day (GAAD), Smith-Kettlewell relaunched the award- winning YouDescribe with new features, expanded capabilities, and exciting possibilities for the future of audio description. YouDescribe is a free web-based platform for adding audio description to YouTube videos to improve accessibility for the blind. Conceived in 2011 by Smith-Kettlewell scientist Dr. Joshua Miele in 2011, YouDescribe is a unique platform that allows sighted describers to add audio description to any YouTube video and share those descriptions with blind viewers.
View News -
DescribeAthon 17 'Marathon'
On January 26, 2017, in San Francisco, the Smith-Kettlewell Eye Research Institute’s Rehabilitation and Engineering Research Center (RERC) hosted DescribeAthon 17 -- an event that used the Institute’s YouDescribe technology, developed by scientist Dr. Josh Miele, to raise awareness about video accessibility on the web for blind viewers. YouDescribe is an enhanced video program for YouTube in which recorded voices describe what cannot be seen.
View News -
-
Smith-Kettlewell Announces New Wayfinding App for Blind and Visually-...
Remote Infrared Signage (also known as “Talking Signs”) was invented at The Smith-Kettlewell Eye Research Institute in San Francisco. This powerful system used infrared beams to provide blind travelers with information about the location of transmitters marking bathrooms, bus stops, businesses, buildings, and beyond. Users could point hand-held receivers to accurately locate and identify the “signs” in that direction.
View News -
Scientists Receive NEI Grant Aiding Blind Interaction with Physical Objects
James Coughlan, PhD, Senior Scientist at the Smith-Kettlewell Eye Research Institute, San Francisco, California, was recently awarded a four-year grant from NIH-NEI (R01EY025332) entitled, “Enabling Audio-Haptic Interaction with Physical Objects for the Visually Impaired Summary".
View News -
Dr. Coughlan's Bar Code Reader, BLaDE, Featured in Scientific American
Work by Drs. James Coughlan and Ender Tekin on bar code readers as an accessibility tool is discussed in Scientific American. The work with using these tools is specifically focused for people who are blind or who have visual impairments.
View News