Huiying Shen, Ph.D.
Senior Programmer/System Analysist,
(415) 345-2141
hshen@ski.org
Research Interests
My research interests are of two aspests: graphical model/randon markov field and belief propagation, and development of practical algorithms for blind/low vision persons. Current projects include: 1. finding crosswalk, 2. finding text signs in the natural environment, and 3. LCD/LED display reader for Symbian camera cell phone.
Platform for Blind/Low Vision Users
People have built many devices for blind/low vision users. Special, and single purpose devices have inherent disadvantages: being expensive, limited upgrade path, and taking up valuable real estate (A blind person can only carry so many things). Choice of Symbian camera cell phones addresses these problems. A single cell phone can function as many devices: a helper for crossing street, a LCD/LED display reader for many electical appliances, a street name/address reader. After all that, you can still make phone calls with it.
Symbian OS is an open system, with majority of the cell phone market share, with Nokia as its major supporter. The SDK can be frreely downloaded. One can program it in C++, Java, even Python. It is well documented.
Collaborators:
Publication:
H. Shen, J. Coughlan and V. Ivanchenko. “Figure-Ground Segmentation Using Factor Graphs.” Special Issue of Image and Vision Computing. 2009. doi:10.1016/j.imavis.2009.02.006 pdf
V. Ivanchenko, H. Shen and J. Coughlan. "Elevation-Based Stereo Implemented in Real-Time on a GPU." 2009 IEEE Workshop on Applications of Computer Vision (WACV 2009). Snowbird, Utah. Dec. 2009. pdf
V. Ivanchenko, J. Coughlan and H. Shen. “Staying in the Crosswalk: A System for Guiding Visually Impaired Pedestrians at Traffic Intersections.” Association for the Advancement of Assistive Technology in Europe (AAATE 2009). Florence, Italy. Sept. 2009. pdf
H. Shen, K.Y. Chan, J. Coughlan and J. Brabyn. “A Mobile Phone System to Find Crosswalks for Visually Impaired Pedestrians.” Technology and Disability, Vol. 20, Number 3, pp. 217-224. 2008. pdf
V. Ivanchenko, J. Coughlan and H. Shen. "Crosswatch: a Camera Phone System for Orienting Visually Impaired Pedestrians at Traffic Intersections." 11th International Conference on Computers Helping People with Special Needs (ICCHP '08). Linz, Austria. July 2008. pdf
V. Ivanchenko, J. Coughlan, B. Gerrey and H. Shen. “Computer Vision-Based Clear Path Guidance for Blind Wheelchair Users.” 10th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2008). Halifax, Canada. Oct. 2008. pdf
V. Ivanchenko, J. Coughlan and H. Shen. "Detecting and Locating Crosswalks using a Camera Phone." Fourth IEEE Workshop on Embedded Computer Vision, in conjunction with Computer Vision and Pattern Recognition (CVPR ‘08). Anchorage, Alaska. June 2008. Received Best Paper Award in Workshop on Embedded Computer Vision. pdf
J. Coughlan and H. Shen. "Dynamic Quantization for Belief Propagation in Sparse Spaces." Computer Vision and Image Understanding (CVIU) Special issue on Generative-Model Based Vision. Volume 106, Issue 1, pp. 47-58. April 2007. pdf
J. Coughlan and H. Shen. "Terrain Analysis for Blind Wheelchair Users: Computer Vision Algorithms for Finding Curbs and Other Negative Obstacles." To appear in Conference and Workshop on Assistive Technology for People with Vision and Hearing Impairments (CVHI '07). Granada, Spain. August 2007. pdf
H. Shen and J. Coughlan. "Grouping Using Factor Graphs: an Approach for Finding Text with a Camera Phone." Workshop on Graph-based Representations in Pattern Recognition (GbR '07, associated with The International Association for Pattern Recognition). June 2007. Alicante, Spain. pdf
H. Shen and J. Coughlan. “Finding Text in Natural Scenes by Figure-Ground Segmentation. International Conference on Pattern Recognition (ICPR ‘06). August 2006. Hong Kong. pdf
J. Coughlan, R. Manduchi and H. Shen. "Computer Vision-Based Terrain Sensors for Blind Wheelchair Users." 10th International Conference on Computers Helping People with Special Needs (ICCHP ’06). Linz, Austria. July 2006. Preprint: pdf
H. Shen and J. Coughlan. "Reading LCD/LED Displays with a Camera Cell Phone." 2nd IEEE Workshop on Embedded Computer Vision (ECVW '06), in conjunction with CVPR 2006. New York. June 2006. Preprint: pdf
J. Coughlan, R. Manduchi and H. Shen. "Cell Phone-based Wayfinding for the Visually Impaired." 1st International Workshop on Mobile Vision, in conjunction with ECCV 2006. Graz, Austria. May 2006. pdf.
J. Coughlan and H. Shen. “A Fast Algorithm for Finding Crosswalks using Figure-Ground Segmentation.” 2nd Workshop on Applications of Computer Vision, in conjunction with ECCV 2006. Graz, Austria. May 2006. pdf.
J. Coughlan and H. Shen. “Shape Matching with Belief Propagation: Using Dynamic Quantization to Accommodate Occlusion and Clutter.” Generative-Model Based Vision (GMBV 2004, in conjunction with CVPR 2004). Washington, DC. June 2004. pdf.