Heinen lab overview

Heinen Lab

Action for Vision and Thought

Our laboratory studies eye movements to understand basic neural circuitry that moves the eyes for clear vision, and as a tool to probe mental processes that are distinctly human. Our ultimate goal is to understand the substrate of neurological function and dysfunction, leading to development of non-invasive diagnosis and therapy for brain trauma and psychiatric disorders.

 

Vision without eye movements

Dog Image 4

A single, static retina severely limits vision and perception- limitations that eye movements minimize. For starters, each retina “sees” ~120 deg, and both together see only ~210 degees since the eyes are roughly aligned. Eye (and head, and body) movements expand our field of view. But the retina limits vision in two other significant ways. First, high acuity vision is possible only with our tiny fovea (~4 deg). To view an entire scene at high resolution we almost continuously scan it with rapid, saccadic eye movements. Second, retinal circuitry that preprocess images before they enter the brain is sluggish, causing images to blur when they move on the retina. To preserve image clarity, vestibulo-ocular (VOR) and optokinetic (OKN) reflexes stabilize images subconsciously to compensate for self-motion, while smooth pursuit and fixation systems stabilize moving and stationary object images voluntarily. Our laboratory studies smooth pursuit, fixation and saccades.

Representative work: -  Voluntary stabilizing eye movements in normals

Badler, J. B., Watamaniuk, S. N., & Heinen, S. J. (2019). A common mechanism modulates saccade timing during pursuit and fixation. Journal of neurophysiology, 122(5), 1981-1988.

-  Voluntary stabilizing eye movements in patients with age-related macular degeneration (AMD)

Shanidze, N., Heinen, S. & Verghese, P. (2017) Monocular and binocular smooth pursuit in central field loss. Vision Research, 141, 181-190.

-  Binocular eye movement control that aids 3D vision

Heinen, S., Watamaniuk, S., Candy, T. R., Badler, J., & Chandna, A. (2019). A covered eye does not always follow objects moving smoothly in depth. Vision Sciences Society Annual Meeting, St. Pete Beach, FL, May 2019.

 

Eye movements are a sensitive assay of normal and damaged brain function

Knowledge of how specific neural structures generate eye movements is extensive and growing, and our laboratory has contributed significantly to this literature. Eye movement structures are ubiquitous and include visual, parietal and frontal cortices, the basal ganglia, the brainstem and the cerebellum. Furthermore, oculomotor pathways overlap those involved in perception, motor control and executive function, and therefore studying them provides insight into general brain operation. Consequentially, when trauma or psychiatric disorders afflict the brain (e.g., Parkinson’s disease, Alzheimer’s, dyslexia, schizophrenia, autism), and in age-related neurodegeneration, characteristic eye movement deficits present. Therefore measuring eye movements provides a non-invasive window on normal and broken brain operation. 

Representative work:

Missal, M. & Heinen, S.J. (2017) Stopping smooth pursuit. Phil. Trans. R. Soc. B 372(1718), 20160200.

Yang, S-N. & Heinen, S.J. (2014) Contrasting the roles of the supplementary and frontal eye fields in ocular decision making. J. Neurophysiol. DOI: 10.1152/jn.00543.2013.

Our laboratory is also developing a computer gaming system for diagnosing mild traumatic brain injury (mTBI)

 

Reading the human mind with eye movements 

Dog Image 2

Eye movements not only indicate what we see, but where and how we allocate our mental resources, and are therefore a sensitive, dynamic and objective readout of distinctly human thought processes. Furthermore, they are measured efficiently and non-invasively with relatively inexpensive, portable commercial devices, giving eye movement recording significant advantages over other neural imaging technologies. 

Eye movements reveal bottom-up, reflexive attention allocation to sudden and salient events that our survival may depend upon. But they also indicate emotional states and numerous top-down, cognitive processes e.g. our perceptions, how we anticipate and predict, how we allocate attention and make decisions, areas our lab has contributed to. They read out high-level processes related to memory, planning, problem solving and face recognition, but our work shows they also reflect inattentive, subconscious mental processes.

Furthermore, eye movement recording has practical applications including aiding cockpit design, using gaze patterns of experts both to train novices and evaluate performance in tasks including surgery, clinical diagnosis, sports, airplane inspection, and driving. They also elucidate what people find interesting in advertising and other media - we have contributed here showing they indicate interesting frames for video summarization.

Representative work:

 -  Subconscious control of movement

Watamaniuk, S.N., Bal, J. & Heinen, S.J. (2017) A subconscious interaction between fixation and anticipatory pursuit. J. Neurosci, 37(47), 11424-11430.

-  Eye movements for video summarization

Ma, Z., Wu, J., Zhong, S., Jiang J., & Heinen S. J. (2019)"Human Eye Movements Reveal Video Frame Importance," in Computer, vol. 52, no. 5, pp. 48-57, May 2019.doi: 10.1109/MC.2019.2903246

-  Anticipation and prediction

Heinen, S.J., Badler, J.B. & Ting, W.W. (2005) Timing and velocity randomization similarly affect anticipatory pursuit. J. Vision5:6, 493-503.

-  Decision making

Heinen, S.J., Rowland, J., Lee, B.T & Wade, A.R. (2006) An oculomotor decision process revealed by functional magnetic resonance imaging. J. Neurosci.26:52, 13515-13522.

-  Attention allocation

Watamaniuk, S. & Heinen, S.J. (2015) Allocation of attention during pursuit of large objects is no different than during fixation. J. Vision15(9), 9-9.

Tabs

Journal Articles
A covered eye fails to follow an object moving in depth. (2021). A covered eye fails to follow an object moving in depth. Scientific Reports, 11. http://doi.org/https://doi.org/10.1038/s41598-021-90371-8
Human Eye Movements Reveal Video Frame Importance. (2019). Human Eye Movements Reveal Video Frame Importance. Computer, 52(5), 48–57. http://doi.org/10.1109/MC.2019.2903246
Foveated convolutional neural networks for video summarization. (2018). Foveated convolutional neural networks for video summarization. Multimedia Tools And Applications, 77(22), 29245-29267. http://doi.org/https://doi.org/10.1007/s11042-018-5953-1
A Subconscious Interaction between Fixation and Anticipatory Pursuit. (2017). A Subconscious Interaction between Fixation and Anticipatory Pursuit. Journal Of Neuroscience, 37(47), 11424-11430. http://doi.org/10.1523/JNEUROSCI.2186-17.2017

Pages

  • Brain image with activated brain seen through a transparent skull

    Smith-Kettlewell Brain Imaging Center

    The Smith-Kettlewell Brain Imaging Center supports a wide variety of human brain imaging modalities, including MRI, MRI morphometry, functional MRI, fMR Iretonogrphy, fMRI dynamics, functional connectivity, Granger-causal connectivity, DTI, DTI tractography, whole-head EEG, EEG functional connectivity, ERG, EEG eye tracking, electroblepharography, etc. Our work centers on human visual neuroscience and computational vision, especially in the areas of human visual processing in adults, of the diagnosis of eye diseases and cortical deficits in infants and adults, on brain plasticity in relation to low vision and blindness, and on the processes of blindness rehabilitation. We are particularly interested in the normal capabilities of binocular visual processing and its disruption by forms of traumatic brain injury.

    View Center
Active Completed
  • Completed

    Go and Nogo Decision Making

    The decision to make or withhold a saccade has been studied extensively using a go-nogo paradigm, but little is known about the decision process underlying pursuit of moving objects. Prevailing models describe pursuit as a feedback system that responds reactively to a moving stimulus. However, situations often arise in which it is disadvantageous to pursue, and humans can decide not to pursue an object just because it moves. This project explores mechanisms underlying the decision to pursue or maintain fixation. Our paradigm, ocular baseball, involves a target that moves from the periphery toward a central zone called the "plate".

    Read More
  • Completed

    Integration and Segregation

    Traditionally, smooth pursuit research has explored how eye movements are generated to follow small, isolated targets that fit within the fovea. Objects in a natural scene, however, are often larger and extend to peripheral retina. They also have components that move in different directions or at different speeds (e.g., wings, legs). To generate a single velocity command for smooth pursuit, motion information from the components must be integrated. Simultaneously, it may be necessary to attend to features of the object while pursuing it.

    Read More
Current
Past

Principal Investigator:

Photograph of Stephen Heinen

Steve Heinen

Internal Collaborators: 

Arvind Chandna

External Collaborators: 

Scott Watamaniuk

Funding: 

Attention Allocation for Voluntary Smooth Eye Movements