Heinen Lab

Action for Vision and Thought

Our laboratory studies eye movements to understand basic neural circuitry that moves the eyes for clear vision, and as a tool to probe mental processes that are distinctly human. Our ultimate goal is to understand the substrate of neurological function and dysfunction, leading to development of non-invasive diagnosis and therapy for brain trauma and psychiatric disorders.


Vision without eye movements

Dog Image 4

A single, static retina severely limits vision and perception- limitations that eye movements minimize. For starters, each retina “sees” ~120 deg, and both together see only ~210 degees since the eyes are roughly aligned. Eye (and head, and body) movements expand our field of view. But the retina limits vision in two other significant ways. First, high acuity vision is possible only with our tiny fovea (~4 deg). To view an entire scene at high resolution we almost continuously scan it with rapid, saccadic eye movements. Second, retinal circuitry that preprocess images before they enter the brain is sluggish, causing images to blur when they move on the retina. To preserve image clarity, vestibulo-ocular (VOR) and optokinetic (OKN) reflexes stabilize images subconsciously to compensate for self-motion, while smooth pursuit and fixation systems stabilize moving and stationary object images voluntarily. Our laboratory studies smooth pursuit, fixation and saccades.

Eye movements are a sensitive assay of normal and damaged brain function

Knowledge of how specific neural structures generate eye movements is extensive and growing, and our laboratory has contributed significantly to this literature. Eye movement structures are ubiquitous and include visual, parietal and frontal cortices, the basal ganglia, the brainstem and the cerebellum. Furthermore, oculomotor pathways overlap those involved in perception, motor control and executive function, and therefore studying them provides insight into general brain operation. Consequentially, when trauma or psychiatric disorders afflict the brain (e.g., Parkinson’s disease, Alzheimer’s, dyslexia, schizophrenia, autism), and in age-related neurodegeneration, characteristic eye movement deficits present. Therefore measuring eye movements provides a non-invasive window on normal and broken brain operation. 

Representative work:

Missal, M. & Heinen, S.J. (2017) Stopping smooth pursuit. Phil. Trans. R. Soc. B 372(1718), 20160200.

Yang, S-N. & Heinen, S.J. (2014) Contrasting the roles of the supplementary and frontal eye fields in ocular decision making. J. Neurophysiol. DOI: 10.1152/jn.00543.2013.

Our laboratory is also developing a computer gaming system for diagnosing mild traumatic brain injury (mTBI)

Reading the human mind with eye movements 

Dog Image 2

Eye movements not only indicate what we see, but where and how we allocate our mental resources, and are therefore a sensitive, dynamic and objective readout of distinctly human thought processes. Furthermore, they are measured efficiently and non-invasively with relatively inexpensive, portable commercial devices, giving eye movement recording significant advantages over other neural imaging technologies. 

Eye movements reveal bottom-up, reflexive attention allocation to sudden and salient events that our survival may depend upon. But they also indicate emotional states and numerous top-down, cognitive processes e.g. our perceptions, how we anticipate and predict, how we allocate attention and make decisions, areas our lab has contributed to. They read out high-level processes related to memory, planning, problem solving and face recognition, but our work shows they also reflect inattentive, subconscious mental processes.

Furthermore, eye movement recording has practical applications including aiding cockpit design, using gaze patterns of experts both to train novices and evaluate performance in tasks including surgery, clinical diagnosis, sports, airplane inspection, and driving. They also elucidate what people find interesting in advertising and other media - we have contributed here showing they indicate interesting frames for video summarization.


Journal Articles
Ma, Z., Wu, J., Zhong, S. -hua, Jiang, J., & Heinen, S. J.. (2019). Human Eye Movements Reveal Video Frame Importance. Computer, 52(5), 48–57. http://doi.org/10.1109/MC.2019.2903246
Heinen, S. J., Badler, J. B., & Watamaniuk, S. N. J.. (2018). Choosing a foveal goal recruits the saccadic system during smooth pursuit. Journal Of Neurophysiology , 120(2), 489-496. http://doi.org/ 10.1152/jn.00418.2017
Wu, J., Sheng-hua, Z., Ma, Z., Heinen, S. J., & Jiang, J.. (2018). Foveated convolutional neural networks for video summarization. Multimedia Tools And Applications, 77(22), 29245-29267. http://doi.org/https://doi.org/10.1007/s11042-018-5953-1
Watamaniuk, S. N. J., Bal, J., & Heinen, S. J.. (2017). A Subconscious Interaction between Fixation and Anticipatory Pursuit. Journal Of Neuroscience, 37(47), 11424-11430. http://doi.org/10.1523/JNEUROSCI.2186-17.2017
Conference Papers
Heinen, S. J. (1994). Evidence of a timing mechanism for predictive smooth pursuit in frontal cortex. In Contemporary Oculomotor and Vestibular Research: A Tribute to David A Robinson.


  • Brain image with activated brain seen through a transparent skull

    Smith-Kettlewell Brain Imaging Center

    The Smith-Kettlewell Brain Imaging Center supports a wide variety of human brain imaging modalities, including MRI, MRI morphometry, functional MRI, fMR Iretonogrphy, fMRI dynamics, functional conn

    View Center