Heinen Lab


Action for Vision and Thought

Our laboratory studies eye movements to understand basic neural circuitry that moves the eyes for clear vision, and as a tool to probe mental processes that are distinctly human. Our ultimate goal is to understand the substrate of neurological function and dysfunction, leading to development of non-invasive diagnosis and therapy for brain trauma and psychiatric disorders.

 



Vision without eye movements

Dog Image 4


A single, static retina severely limits vision and perception- limitations that eye movements minimize. For starters, each retina “sees” ~120 deg, and both together see only ~210 degees since the eyes are roughly aligned. Eye (and head, and body) movements expand our field of view. But the retina limits vision in two other significant ways. First, high acuity vision is possible only with our tiny fovea (~4 deg). To view an entire scene at high resolution we almost continuously scan it with rapid, saccadic eye movements. Second, retinal circuitry that preprocess images before they enter the brain is sluggish, causing images to blur when they move on the retina. To preserve image clarity, vestibulo-ocular (VOR) and optokinetic (OKN) reflexes stabilize images subconsciously to compensate for self-motion, while smooth pursuit and fixation systems stabilize moving and stationary object images voluntarily. Our laboratory studies smooth pursuit, fixation and saccades.


Representative work:
-  Voluntary stabilizing eye movements in normals

Badler, J. B., Watamaniuk, S. N., & Heinen, S. J. (2019). A common mechanism modulates saccade timing during pursuit and fixation. Journal of neurophysiology, 122(5), 1981-1988.

-  Voluntary stabilizing eye movements in patients with age-related macular degeneration (AMD)

Shanidze, N., Heinen, S. & Verghese, P. (2017) Monocular and binocular smooth pursuit in central field loss. Vision Research, 141, 181-190.

-  Binocular eye movement control that aids 3D vision

Heinen, S., Watamaniuk, S., Candy, T. R., Badler, J., & Chandna, A. (2019). A covered eye does not always follow objects moving smoothly in depth. Vision Sciences Society Annual Meeting, St. Pete Beach, FL, May 2019.


Eye movements are a sensitive assay of normal and damaged brain function

Knowledge of how specific neural structures generate eye movements is extensive and growing, and our laboratory has contributed significantly to this literature. Eye movement structures are ubiquitous and include visual, parietal and frontal cortices, the basal ganglia, the brainstem and the cerebellum. Furthermore, oculomotor pathways overlap those involved in perception, motor control and executive function, and therefore studying them provides insight into general brain operation. Consequentially, when trauma or psychiatric disorders afflict the brain (e.g., Parkinson’s disease, Alzheimer’s, dyslexia, schizophrenia, autism), and in age-related neurodegeneration, characteristic eye movement deficits present. Therefore measuring eye movements provides a non-invasive window on normal and broken brain operation. 


Representative work:

Missal, M. & Heinen, S.J. (2017) Stopping smooth pursuit. Phil. Trans. R. Soc. B 372(1718), 20160200.

Yang, S-N. & Heinen, S.J. (2014) Contrasting the roles of the supplementary and frontal eye fields in ocular decision making. J. Neurophysiol. DOI: 10.1152/jn.00543.2013.

Our laboratory is also developing a computer gaming system for diagnosing mild traumatic brain injury (mTBI)



Reading the human mind with eye movements 

Dog Image 2

Eye movements not only indicate what we see, but where and how we allocate our mental resources, and are therefore a sensitive, dynamic and objective readout of distinctly human thought processes. Furthermore, they are measured efficiently and non-invasively with relatively inexpensive, portable commercial devices, giving eye movement recording significant advantages over other neural imaging technologies. 

Eye movements reveal bottom-up, reflexive attention allocation to sudden and salient events that our survival may depend upon. But they also indicate emotional states and numerous top-down, cognitive processes e.g. our perceptions, how we anticipate and predict, how we allocate attention and make decisions, areas our lab has contributed to. They read out high-level processes related to memory, planning, problem solving and face recognition, but our work shows they also reflect inattentive, subconscious mental processes.

Furthermore, eye movement recording has practical applications including aiding cockpit design, using gaze patterns of experts both to train novices and evaluate performance in tasks including surgery, clinical diagnosis, sports, airplane inspection, and driving. They also elucidate what people find interesting in advertising and other media - we have contributed here showing they indicate interesting frames for video summarization.


Representative work:

 -  Subconscious control of movement

Watamaniuk, S.N., Bal, J. & Heinen, S.J. (2017) A subconscious interaction between fixation and anticipatory pursuit. J. Neurosci, 37(47), 11424-11430.

-  Eye movements for video summarization

Ma, Z., Wu, J., Zhong, S., Jiang J., & Heinen S. J. (2019)"Human Eye Movements Reveal Video Frame Importance," in Computer, vol. 52, no. 5, pp. 48-57, May 2019.doi: 10.1109/MC.2019.2903246

-  Anticipation and prediction

Heinen, S.J., Badler, J.B. & Ting, W.W. (2005) Timing and velocity randomization similarly affect anticipatory pursuit. J. Vision5:6, 493-503.

-  Decision making

Heinen, S.J., Rowland, J., Lee, B.T & Wade, A.R. (2006) An oculomotor decision process revealed by functional magnetic resonance imaging. J. Neurosci.26:52, 13515-13522.

-  Attention allocation

Watamaniuk, S. & Heinen, S.J. (2015) Allocation of attention during pursuit of large objects is no different than during fixation. J. Vision15(9), 9-9.

Tabs

Journal Articles
Ma, Z., Wu, J., Zhong, S. -hua, Jiang, J., & Heinen, S. J.. (2019). Human Eye Movements Reveal Video Frame Importance. Computer, 52(5), 48–57. http://doi.org/10.1109/MC.2019.2903246
Wu, J., Sheng-hua, Z., Ma, Z., Heinen, S. J., & Jiang, J.. (2018). Foveated convolutional neural networks for video summarization. Multimedia Tools And Applications, 77(22), 29245-29267. http://doi.org/https://doi.org/10.1007/s11042-018-5953-1
Heinen, S. J., Badler, J. B., & Watamaniuk, S. N. J.. (2018). Choosing a foveal goal recruits the saccadic system during smooth pursuit. Journal Of Neurophysiology , 120(2), 489-496. http://doi.org/ 10.1152/jn.00418.2017
Watamaniuk, S. N. J., Bal, J., & Heinen, S. J.. (2017). A Subconscious Interaction between Fixation and Anticipatory Pursuit. Journal Of Neuroscience, 37(47), 11424-11430. http://doi.org/10.1523/JNEUROSCI.2186-17.2017
Conference Papers
Heinen, S. J. (1994). Evidence of a timing mechanism for predictive smooth pursuit in frontal cortex. In Contemporary Oculomotor and Vestibular Research: A Tribute to David A Robinson.

Pages

  • Brain image with activated brain seen through a transparent skull

    Smith-Kettlewell Brain Imaging Center

    The Smith-Kettlewell Brain Imaging Center supports a wide variety of human brain imaging modalities, including MRI, MRI morphometry, functional MRI, fMR Iretonogrphy, fMRI dynamics, functional conn

    View Center
Active
  • Characteristics of Smooth Pursuit in Individuals with Central Field Loss
    Active

    Characteristics of Smooth Pursuit in Individuals with Central Field Loss

    This project investigates the properties of smooth pursuit eye movements in individuals with macular degeneration. Commonly believed to be a fovea-linked eye movement, smooth pursuit has not been previously investigated in individuals with central field loss, despite its importance for tracking moving objects, such as vehicles or pedestrians on a busy street.

    Read More
  • Active

    Go and Nogo Decision Making

    The decision to make or withhold a saccade has been studied extensively using a go-nogo paradigm, but little is known about the decision process underlying pursuit of moving objects.

    Read More
  • Active

    Integration and Segregation

    Traditionally, smooth pursuit research has explored how eye movements are generated to follow small, isolated targets that fit within the fovea.

    Read More
Current
Past
  • Gerrit Maus - Assistant Professor at Nanyang Technological University, Singapore
  • Marcus Missal - Professor of Neuroscience at UCL
  • Natela Shanidze - Associate Scientist
  • Sean Taffler - Founder CEO at Acooustiic
  • Shun-Nan Yang - Director of Research at Vision Performance Institute, College of Optometry, Pacific University
  • Supriya Ray - Assistant Professor at University of Allahabad
  • Zheng Ma - Researcher, Marketing Science at SBG
  • Zhenlan Jin - Researcher at University of Electronic Science and Technology of China

Principal Investigator:

Photograph of Stephen Heinen

Steve Heinen

Funding: 

Attention Allocation for Voluntary Smooth Eye Movements