Scientific

Zoom Colloquium: The 3 Ps of 3D: Perception, Pedagogy, and Practice for 3D  Printing

Zoom Colloquium: The 3 Ps of 3D: Perception, Pedagogy, and Practice for 3D Printing

Abstract – Nonscriptum LLC (www.nonscriptum.com) is a consulting and training firm founded in 2015 by Joan Horvath and Rich “Whosawhatsis” Cameron, based in Pasadena, California. Nonscriptum focuses on teaching educators and scientists how to use maker tech, and together have authored 7 books for the Apress imprint of Springer-Nature, and numerous courses for LinkedIn Learning (formerly Lynda.com). Joan is an MIT alumna, recovering rocket scientist and educator, and Rich is an open-source 3D printer hacker who designed the RepRap Wallace and Bukito 3D printers. In this colloquium we will be highlighting our Geometry Lesson Plans for Blind/Visually Impaired Learners. We have been collaborating on the development of open-source lesson plans and a repository of 3D models. These cover various topics in geometry at the middle- and high-school level. These lesson plans are aimed at teachers of blind and visually-impaired learners. Our book Make: Geometry is also now available on Amazon for pre-order, should you want even more hands-on math!

Dr Nicola McDowell, Massey University, New Zealand

Zoom Colloquium: The CVI Practice Framework: An approach to Supporting Children with Cerebral Visual Impairment (CVI)

Abstract – Cerebral visual impairment (CVI) is the most common cause of visual impairment affecting children in the developed world. For her doctoral research, to help meet the needs of children with CVI, Nicola proposed a practice framework that can be used within an education or rehabilitation context. Nicola’s framework was based on her experience of developing a successful rehabilitation programme to improve her own visual and overall functioning, following a late CVI diagnosis. Nicola identified three main components that led to her improvements, including: developing an individual CVI profile, creating an individualised programme, and empowerment through increasing knowledge and understanding of her condition. Her research on each component of the framework, and on the framework as a whole, showed that it may be an effective approach for supporting children with CVI. https://www.massey.ac.nz/massey/research/higher-research-degrees/phd-student-profiles/doctoral-my-story.cfm?studid=FuwubVvVyNI Improving Zoom accessibility for people with hearing impairments People with hearing impairments often use lipreading and speechreading to improve speech comprehension. This approach is helpful but only works if the speaker’s face and mouth are clearly visible. For the benefit of people with hearing impairments on Zoom calls, please enable your device’s camera whenever you are speaking on Zoom, and face the camera while you speak. (Feel free to disable your camera when you aren’t speaking.) Abstract – Cerebral visual impairment (CVI) is the most common cause of visual impairment affecting children in the developed world. For her doctoral research, to help meet the needs of children with CVI, Nicola proposed a practice framework that can be used within an education or rehabilitation context. Nicola’s framework was based on her experience of developing a successful rehabilitation programme to improve her own visual and overall functioning, following a late CVI diagnosis. Nicola identified three main components that led to her improvements, including: developing an individual CVI profile, creating an individualised programme, and empowerment through increasing knowledge and understanding of her condition. Her research on each component of the framework, and on the framework as a whole, showed that it may be an effective approach for supporting children with CVI. https://www.massey.ac.nz/massey/research/higher-research-degrees/phd-student-profiles/doctoral-my-story.cfm?studid=FuwubVvVyNIImproving Zoom accessibility for people with hearing impairments People with hearing impairments often use lipreading and speechreading to improve speech comprehension. This approach is helpful but only works if the speaker’s face and mouth are clearly visible. For the benefit of people with hearing impairments on Zoom calls, please enable your device’s camera whenever you are speaking on Zoom, and face the camera while you speak. (Feel free to disable your camera when you aren’t speaking.)  

Zoom Colloquium: ACTION AUDIO: Accessible Sports Broadcasting

Zoom Colloquium: ACTION AUDIO: Accessible Sports Broadcasting

Abstract – Billions of people in the world watch sport media broadcasts to follow their favorite sports, e.g., tennis, soccer, cricket, golf, or Olympic games. They enjoy the actions captured by cameras and microphones on and around the fields. They also socially engage with other fans at home, at a local club, in a stadium and on social media. However, if you are blind or have low-vision (BLV), your overall experience is limited. While TV is providing the state-of-the-art experience for sighted people, BLV need to tune in to radio broadcasts. Although used widely by BLV, radio cannot provide all the actions in real time, in particular the movement of the objects such as the ball, puck, and players, ball kids, referees etc. Action Audio aims to provide frameworks that will make sport media broadcasting accessible to BLV. It provides alternative modalities and allow BLV access all the actions on sports broadcasting. It will also create technologies that let people experience the events live in sport venues. https://research.monash.edu/en/persons/cagatay-goncu https://www.action-audio.com/

Zoom Brown Bag: Multisensory interactions in the primary visual and auditory cortex of humans: Evidence from source-imaged visua

Zoom Brown Bag: Multisensory interactions in the primary visual and auditory cortex of humans: Evidence from source-imaged visual and auditory evoked potentials

Abstract – Our environment is multisensory; at any given time, information can be received through multiple senses. While it was previously believed that multisensory processing in the cortex was restricted to higher-order regions, there is now evidence to suggest that multisensory interactions may occur as early as in primary sensory regions (Kayser et al., 2009; Murray et al., 2016). For instance, both the primary visual and auditory cortex exhibit crossmodal sensitivity (Calvert et al., 1997; Brang et al., 2015) and direct connections between both regions have been reported (Beer et al., 2011, 2013). However, whether multisensory inputs actually converge in sensory regions of the cortex remains unclear. In this brown bag, I will present results from a study where we used source-imaged steady-state visual and auditory evoked potentials to address this open question. The goal of the study was to determine whether the primary visual and auditory cortex respond to crossmodal sensory stimulation and are locations of early multisensory input convergence in the cortex. We used a frequency-tagged approach in which a visual (FV) and auditory (FA) stimulus were presented at distinct modulation frequencies, either alone or concurrently. Significant responses at the harmonic frequencies of the visual (nFV) and auditory stimulus (nFA) were localized in both the primary visual and auditory cortex, even when the stimulus was presented alone. Moreover, significant responses at intermodulation (IM) frequencies (FV±FA), reflecting the convergence of visual and auditory inputs, were also observed and localized to these regions when the visual and auditory stimuli were presented concurrently. Overall, our results demonstrate that the visual and auditory cortex are multisensory: both regions respond to crossmodal stimulation and are cortical locations of multisensory signal convergence. https://ski.org/users/audrey-wong-kee-you

Zoom Colloquium: Harnessing Augmented Reality to Assist People who are Blind with Orientation and Mobility

Zoom Colloquium: Harnessing Augmented Reality to Assist People who are Blind with Orientation and Mobility

Abstract – Smartphones have been a massive boon for people who are blind in terms of their ability to access physical environments. For instance, GPS navigation apps and ride-sharing apps have enabled people who are blind to independently, efficiently, and confidently travel, including places they have never been to before. Despite this progress, there remain situations that are difficult for blind people to navigate. In particular, navigating through unfamiliar indoor environments presents a substantial challenge. In this talk, I will present the work that my group is doing to try to improve the accessibility of indoor environments using smartphone technology. In particular, I will discuss my group’s work, both in the lab and in the field, on harnessing augmented reality technology to perform tasks such as navigation, mapping, and route recording. Lastly, I’ll present some of our successes and also discuss ongoing and future work. https://www.olin.edu/faculty/profile/paul-ruvolo/

Zoom Brown Bag: An Indoor Navigation System using Computer Vision and Sign Recognition

Zoom Brown Bag: An Indoor Navigation System using Computer Vision and Sign Recognition

Abstract – Indoor navigation is a significant challenge for people with visual impairments, who often lack access to visual cues such as informational signs, landmarks, and structural features that people with normal vision rely on for wayfinding. I will describe various approaches to recognizing and analyzing informational signs, such as Exit and restroom signs, in a building. These approaches will be incorporated in iNavigate, a smartphone app we are developing that provides accessible indoor navigation assistance. The app combines a digital map of the environment with computer vision and inertial sensing to estimate the user’s location on the map in real-time. These approaches can recognize and analyze any sign from a small number of training images to multiple types of signs be processed simultaneously in each video frame. When a sign is recognized in the environment, we can estimate the sign’s distance from the camera, which provides useful information to help iNavigate estimate the user’s location on the map. https://ski.org/users/ali-cheraghi

Zoom Colloquium: Deficits beyond visual acuity in amblyopia

Zoom Colloquium: Deficits beyond visual acuity in amblyopia

Abstract – There is growing evidence that the clinical emphasis on visual acuity in both the diagnosis and the treatment of amblyopia is not sufficient. My research has focused on deficits in motion perception that are present in fellow eyes that have normal visual acuity and also in amblyopic eyes that show improved visual acuity following treatment. Deficits in motion perception occur in several developmental disorders, and they are commonly attributed to vulnerability in the dorsal visual stream. Amblyopia, however, is not a clear example of dorsal stream vulnerability because the motion deficits are most evident at slow speeds that activate regions of both ventral and dorsal visual cortex, and the well-documented spatial vision deficits involve the ventral stream. In addition to uncertain neural correlates, the real-world functional impact of deficits on computer-generated psychophysical measures of 2-dimensional motion sensitivity is not known. To address these issues, my research on amblyopia has expanded to include assessments of reading and visuomotor skills, which have more obvious functional impact and have been attributed to the functioning of the dorsal visual stream. In this talk, I will present recent data showing binocular deficits on specific components of reading ability and visually-guided reaching in children with amblyopia. Interestingly, performance on these tasks shows significant associations with stereopsis and/or motion perception. http://www.giaschilab.ca

Zoom Brown Bag: Improving Vision Therapy for Binocular Dysfunction Through Performance Feedback

Zoom Brown Bag: Improving Vision Therapy for Binocular Dysfunction Through Performance Feedback

Abstract – The prevalence of binocular dysfunction in the general population is greater than any other visual condition besides refractive error and is expected to increase in the coming years. Deficits in binocular coordination can disrupt learning, attention, and daily life. Current treatment approaches predominately require extensive clinical oversight and has been shown to be no more effective than a placebo. In this talk, I will review two experimentally successful training paradigms for improving binocular coordination. Then argue that these paradigms target different underlying motor processes, fusion initiating and fusion sustaining vergence components, and that a novel combined protocol will be more effective at improving treatment outcomes. I’ll also propose that such training can be enhanced through the use of real-time performance feedback and/or a task-relevant sensorimotor decision. Finally, I’ll discuss how such a training protocol can take advantage of advances in eye tracking and display technology to be developed for both remote and widespread use. https://ski.org/users/brent-parsons

Zoom Brown Bag: Macular Degeneration: Implications for scotoma overlap in the two eyes

Zoom Brown Bag: Macular Degeneration: Implications for scotoma overlap in the two eyes

Abstract – I will describe two projects in the lab on functional vision in macular degeneration. Individuals with macular degeneration typically lose vision in the central region of one or both eyes. A binocular scotoma occurs when vision loss occurs in overlapping locations in both eyes, i.e. the intersection of the scotomata in the two eyes. To examine the consequences of a binocular scotoma, we carefully mapped out its extent, and measured accuracy and eye movements in a visual search task. Individuals with binocular scotomata had unique challenges (and adaptations) to visual search, while those with non-overlapping scotomas performed similarly to controls. In another ongoing project we tested the prediction that stereopsis is impacted by the union of the two eyes’ scotomata. In other words, a scotoma in either eye will impact stereopsis, whether or not it is in a binocularly overlapping region. To test this hypothesis, we mapped the periphery with local disparity stimuli to compare functional stereopsis to the pattern of vision loss in each eye. Our results show that regions with impaired stereopsis are indeed consistent with the union of the scotoma in the two eyes.