Nuo Li

Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex

Object recognition is challenging because each object produces myriad retinal images. Responses of neurons from the inferior temporal cortex (IT) are selective to different objects, yet tolerant (“invariant”) to changes in object position, scale, and pose. How does the brain construct this neuronal tolerance? We report a form of neuronal learning that suggests the underlying solution. Targeted alteration of the natural temporal contiguity of visual experience caused specific changes in IT position tolerance. This unsupervised temporal slowness learning (UTL) was substantial, increased with experience, and was significant in single IT neurons after just 1 hour. Together with previous theoretical work and human object perception experiments, we speculate that UTL may reflect the mechanism by which the visual stream builds and maintains tolerant object representations.

Neural coding during active somatosensation revealed using illusory touch

Active sensation requires the convergence of external stimuli with representations of body movements. We used mouse behavior, electrophysiology and optogenetics to dissect the temporal interactions among whisker movement, neural activity and sensation of touch. We photostimulated layer 4 activity in single barrels in a closed loop with whisking. Mimicking touch-related neural activity caused illusory perception of an object at a particular location, but scrambling the timing of the spikes over one whisking cycle (tens of milliseconds) did not abolish the illusion, indicating that knowledge of instantaneous whisker position is unnecessary for discriminating object locations. The illusions were induced only during bouts of directed whisking, when mice expected touch, and in the relevant barrel. Reducing activity biased behavior, consistent with a spike count code for object detection at a particular location. Our results show that mice integrate coding of touch with movement over timescales of a whisking bout to produce perception of active touch.

A motor cortex circuit for motor planning and movement

Activity in motor cortex predicts specific movements seconds before they occur, but how this preparatory activity relates to upcoming movements is obscure. We dissected the conversion of preparatory activity to movement within a structured motor cortex circuit. An anterior lateral region of the mouse cortex (a possible homologue of premotor cortex in primates) contains equal proportions of intermingled neurons predicting ipsi- or contralateral movements, yet unilateral inactivation of this cortical region during movement planning disrupts contralateral movements. Using cell-type-specific electrophysiology, cellular imaging and optogenetic perturbation, we show that layer 5 neurons projecting within the cortex have unbiased laterality. Activity with a contralateral population bias arises specifically in layer 5 neurons projecting to the brainstem, and only late during movement planning. These results reveal the transformation of distributed preparatory activity into movement commands within hierarchically organized cortical circuits.

Procedures for behavioral experiments in head-fixed mice

The mouse is an increasingly prominent model for the analysis of mammalian neuronal circuits. Neural circuits ultimately have to be probed during behaviors that engage the circuits. Linking circuit dynamics to behavior requires precise control of sensory stimuli and measurement of body movements. Head-fixation has been used for behavioral research, particularly in non-human primates, to facilitate precise stimulus control, behavioral monitoring and neural recording. However, choice-based, perceptual decision tasks by head-fixed mice have only recently been introduced. Training mice relies on motivating mice using water restriction. Here we describe procedures for head-fixation, water restriction and behavioral training for head-fixed mice, with a focus on active, whisker-based tactile behaviors. In these experiments mice had restricted access to water (typically 1 ml/day). After ten days of water restriction, body weight stabilized at approximately 80% of initial weight. At that point mice were trained to discriminate sensory stimuli using operant conditioning. Head-fixed mice reported stimuli by licking in go/no-go tasks and also using a forced choice paradigm using a dual lickport. In some cases mice learned to discriminate sensory stimuli in a few trials within the first behavioral session. Delay epochs lasting a second or more were used to separate sensation (e.g. tactile exploration) and action (i.e. licking). Mice performed a variety of perceptual decision tasks with high performance for hundreds of trials per behavioral session. Up to four months of continuous water restriction showed no adverse health effects. Behavioral performance correlated with the degree of water restriction, supporting the importance of controlling access to water. These behavioral paradigms can be combined with cellular resolution imaging, random access photostimulation, and whole cell recordings.

Robust neuronal dynamics in premotor cortex during motor planning

Neural activity maintains representations that bridge past and future events, often over many seconds. Network models can produce persistent and ramping activity, but the positive feedback that is critical for these slow dynamics can cause sensitivity to perturbations. Here we use electrophysiology and optogenetic perturbations in the mouse premotor cortex to probe the robustness of persistent neural representations during motor planning. We show that preparatory activity is remarkably robust to large-scale unilateral silencing: detailed neural dynamics that drive specific future movements were quickly and selectively restored by the network. Selectivity did not recover after bilateral silencing of the premotor cortex. Perturbations to one hemisphere are thus corrected by information from the other hemisphere. Corpus callosum bisections demonstrated that premotor cortex hemispheres can maintain preparatory activity independently. Redundancy across selectively coupled modules, as we observed in the premotor cortex, is a hallmark of robust control systems. Network models incorporating these principles show robustness that is consistent with data.

Updating Visual Space during Motion in Depth

Whether we are riding in a car or walking, our internal map of the environment must be continuously updated to maintain spatial constancy. Using a memory eye movement task, we examined whether nonhuman primates can keep track of changes in the distance of nearby objects when moved toward or away from them. We report that memory-guided eye movements take into account the change in distance traveled, illustrating that monkeys can update retinal disparity information in order to reconstruct three-dimensional visual space during motion in depth. This ability was compromised after destruction of the vestibular labyrinths, suggesting that the extraretinal signals needed for updating can arise from vestibular information signaling self-motion through space.

Neurodata Without Borders: Creating a Common Data Format for Neurophysiology

The Neurodata Without Borders (NWB) initiative promotes data standardization in neuroscience to increase research reproducibility and opportunities. In the first NWB pilot project, neurophysiologists and software developers produced a common data format for recordings and metadata of cellular electrophysiology and optical imaging experiments. The format specification, application programming interfaces, and sample datasets have been released.

Neuronal Learning of Invariant Object Representation in the Ventral Visual Stream Is Not Dependent on Reward

Neurons at the top of primate ventral visual stream [inferior temporal cortex (IT)] have selectivity for objects that is highly tolerant to variation in the objects appearance on the retina. Previous nonhuman primate (Macaca mulatta) studies suggest that this neuronal tolerance is at least partly supported by the natural temporal contiguity of visual experience, because altering that temporal contiguity can robustly alter adult IT position and size tolerance. According to that work, it is the statistics of the subjects visual experience, not the subjects reward, that instruct the specific images that IT treats as equivalent. But is reward necessary for gating this type of learning in the ventral stream? Here we show that this is not the case—temporal tolerance learning proceeds at the same rate, regardless of reward magnitude and regardless of the temporal co-occurrence of reward, even in a behavioral task that does not require the subject to engage the object images. This suggests that the ventral visual stream uses autonomous, fully unsupervised mechanisms to constantly leverage all visual experience to help build its invariant object representation.

A Map of Anticipatory Activity in Mouse Motor Cortex.

Activity in the mouse anterior lateral motor cortex (ALM) instructs directional movements, often seconds before movement initiation. It is unknown whether this preparatory activity is localized to ALM or widely distributed within motor cortex. Here we imaged activity across motor cortex while mice performed a whisker-based object localization task with a delayed, directional licking response. During tactile sensation and the delay epoch, object location was represented in motor cortex areas that are medial and posterior relative to ALM, including vibrissal motor cortex. Preparatory activity appeared first in deep layers of ALM, seconds before the behavioral response, and remained localized to ALM until the behavioral response. Later, widely distributed neurons represented the outcome of the trial. Cortical area was more predictive of neuronal selectivity than laminar location or axonal projection target. Motor cortex therefore represents sensory, motor, and outcome information in a spatially organized manner.

Corrigendum: Robust neuronal dynamics in premotor cortex during motor planning

This corrects the article DOI: 10.1038/nature17643