Smith-Kettlewell Announces New Wayfinding App for Blind and Visually-Impaired Travelers

A hand icon hovers over a 2-D globe. Two grey arrows circle the globe counterclockwise.

Accessibility research goes from lab to App Store in the form of overTHERE – a free iPhone app that uses a unique gestural interface to give blind pedestrians quick and easy access to accurate location information about nearby businesses and other points of interest. Blind and visually-impaired pedestrians can now simply point their iPhones in any direction to hear what’s “over there.”

Over 30 years ago, Remote Infrared Signage (also known as “Talking Signs”) was invented at The Smith-Kettlewell Eye Research Institute in San Francisco. This powerful system used infrared beams to provide blind travelers with information about the location of transmitters marking bathrooms, bus stops, businesses, buildings, and beyond. Users could point hand-held receivers to accurately locate and identify the “signs” in that direction. Talking Signs researchers included William Crandall, Jack Loomis, James Marston, Erich Sutter, William Loughborough, and Ward Bond. Rigorous research showed the system to be extraordinarily effective for blind travelers, but equipment costs inhibited broad adoption of this powerful system.

In 2011, Smith-Kettlewell initiated the Virtual Talking Signs Project, motivated by the possibility of leveraging mobile and cloud-based technologies to provide some of the benefits of infrared signage at a fraction of the cost. ”We wanted to see if we could use map pins as virtual signs and an iPhone as the virtual receiver,” said project lead, Dr. Miele. After several years of research and prototyping at Smith-Kettlewell, overTHERE was conceived in the summer of 2015 at a Google-sponsored accessibility MakeAthon in San Francisco. The event introduced prominent accessibility researcher Joshua Miele of Smith-Kettlewell to developers Dmitrijs Prohorenkovs and Ivette Doss of LABS301, to produce the first alpha version of overTHERE which won the event’s Improved Mobility prize. A year later, the team’s combined expertise in blind navigation, accessibility, haptics, and sensor integration brings this tool to the public with a simple yet powerful new way for blind people to find out what’s “over there.”

overTHERE uses a similar interface to Smith-Kettlewell’s historical Talking Signs and offers many of their advantages, but now the “transmitters,” are Google Places and the “receiver,” is an iPhone.

Smith-Kettlewell's work on overTHERE was made possible by a grant from NIDILRR supporting the Rehabilitation Engineering Research Center on Low Vision and Blindness.

overTHERE Project Page