JustPoint: Identifying Colors with a Natural User Interface

TitleJustPoint: Identifying Colors with a Natural User Interface
Publication TypeConference Paper
Year of Publication2017
AuthorsMascetti, S, Gerino, A, Bernareggi, C, D’Acquisto, S, Ducci, M, Coughlan, J
Conference Name19th Int’l ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017)
Date Published10/2017
Conference LocationBaltimore, MD
Other NumbersPMCID: PMC5714614

People with severe visual impairments usually have no way of identifying the colors of objects in their environment. While existing smartphone apps can recognize colors and speak them aloud, they require the user to center the object of interest in the camera’s field of view, which is challenging for many users. We developed a smartphone app to address this problem that reads aloud the color of the object pointed to by the user’s fingertip, without confusion from background colors. We evaluated the app with nine people who are blind, demonstrating the app’s effectiveness and suggesting directions for improvements in the future.

Refereed DesignationRefereed


Related Centers, Labs, Projects