Naturalistic 3D vision   | Perceptual decisions and actions |   Persistent activity and memory   


Naturalistic 3D vision

We have focused on understanding how the dynamic patterns of light falling upon the two retinae are decoded to extract the trajectory of moving objects through 3D. To date, this line of work has produced convergent evidence that motion processing stages typically thought to encode flat (2D) motion signals actually perform inter-ocular computations to represent 3D directions. We are now extending our understanding of how these more realistic motions are processed by moving into the study of naturally-occurring visual motions that are sculpted by eye and body movements. This work entails wireless eyetracking and neurophysiology, as well as analysis of natural image statistics and continuous behaviors.

A review:

Huk, A.C., Czuba, T.B., Knoell, J., & Cormack, L.K. (2017). Binocular mechanisms of 3D motion processingAnnual Review of Vision Science[link] 

Representative empirical publications:

Bonnen, K.T., Czuba, T.B., Whritner, J., Kohn, A., Huk, A.C., & Cormack, L.K.  (2020). Binocular viewing geometry shapes the neural representation of the dynamic three-dimensional environment. Nature Neuroscience, 23: 113–121. [link] [code&data]

Czuba, T.B., Huk, A.C., Cormack, L.K. & Kohn, A. (2014). Area MT encodes three-dimensional motion. Journal of Neuroscience, 34(47):15522–15533. [pdf]

Rokers, B., Cormack, L.K., & Huk, A.C. (2009). Disparity- and velocity- based signals for 3D motion perception in human MT+Nature Neuroscience, 12(8), 1050-1055. [pdf]

Perceptual decisions and actions

We are interested not just in how sensory information about the world is encoded (see above), but how such sensory information is used in cognitive processes that guide actions (as well as how it is remembered for later use; see below). In our decision-making work, we previously focused on using classical psychophysical tasks to understand how the brain integrates information over time to form a decision. Some of our surprising results pushed us to think more broadly about multi-area networks, mixtures of decision-relevant and -irrelevant signals, and how more continuous and naturalistic behaviors are performed (and whether the brain computations and circuits are the same as in highly-trained, more artificial tasks). We are currently focused on building strong links between the classical and ecological task frameworks, and using more continuous and naturalistic tasks as an entrance point for the study of what we believe most brains evolved to do, and do everyday.


Huk, A.C., Bonnen, K.T., He, B.J. (2018). Beyond trial-based paradigms: Continuous behavior, ongoing neural activity, and natural stimuli. Journal of Neuroscience,  [link]

Huk, A.C., Katz, L.N., Yates, J.L. (2017). The role of the lateral intraparietal area in (the study of) decision makingAnnual Review of Neuroscience, 40: 349-372. [link]

Representative empirical publications:

Knöll, J., Pillow, J.W., & Huk, A.C. (2018). Lawful tracking of visual motion in humans, macaques, and marmosets in a naturalistic, continuous, and untrained behavioral context. Proceedings of the National Academy of Sciences, 115 (44) E10486-E10494. [link

Yates, J.L., Park, I.M., Katz, L.N., Pillow, J.P., & Huk, A.C. (2017). Functional dissection of signal and noise in MT and LIP during decision-makingNature Neuroscience, 20, 1285–1292. [link]

Katz, L.N.*, Yates, J.L.*, Pillow, J.W., & Huk, A.C. (2016). Dissociated functional significance of decision-related activity in the primate dorsal stream. Nature, 535: 285–288. [link]

Persistent activity and memory

Persistent neural activity is classically thought of as the core computation that allows the brain to remember and contemplate information acquired from the senses. It is qualitatively ubiquitous in the primate brain, but exactly what the time course of persistent activity reflects, and how it is generated and maintained, are only starting to become tractable given new biological and analytic techniques. We are using a variety of neurophysiological and computational techniques to understand this phenomenon.

Representative empirical publications:

Hart, E., & Huk, A.C. (2020). Recurrent circuit dynamics underlie persistent activity in the macaque frontoparietal network. eLife, 9:e52460. [link]