Original Research
Frontiers in Cellular Neuroscience ·
Volume 20 - 2026 | https://doi.org/10.3389/fncel.2026.1850197
Reward contingency reorganizes lateral orbitofrontal cortex pyramidal neuron activity from reward-aligned to action-aligned during associative learning
- Zicheng Yang1*corresponding author
- Xiaolan Chen1
- Xiaohong Sun1
- Huimeng Lei1*corresponding author
- School of Basic Medical Sciences, Beijing Key Laboratory of Neural Regeneration and Repair, Key Laboratory for Neurodegenerative Diseases of the Ministry of Education, Laboratory for Clinical Medicine, Capital Medical University, Beijing, China
Abstract
Animals must learn not only which cues predict reward, but also when to act to obtain it. Although the orbitofrontal cortex (OFC) encodes reward-related information, whether reward contingency is sufficient to reorganize the temporal alignment of OFC activity remains unclear. We recorded calcium signals from lateral OFC pyramidal neurons (lOFC-PNs) in wild-type (WT) and Sapap3 knockout (KO) mice using fiber photometry, during sequential learning of Pavlovian and instrumental contingencies in a single-odor reward association task. We further used a cue-free lick test and linear mixed-effects modeling to dissociate the contribution of reward contingency from that of licking behavior. Licking behavior and lOFC-PN activity were comparable between WT and KO mice, supporting pooled analysis. Under Pavlovian contingencies, licking and lOFC-PN activity were concentrated around reward delivery. Under instrumental contingencies, both shifted to the pre-reward delay period, and the timing of lOFC-PN activity became progressively coupled to anticipatory licking as learning advanced. A cue-free lick test and linear mixed-effects modeling confirmed that these contingency-related differences reflected reward contingency rather than licking per se. These findings indicate that reward contingency dynamically reorganizes the temporal alignment of lOFC-PN activity and its coupling with behavior, shifting from reward-aligned under Pavlovian learning to action-aligned under instrumental learning. This contingency-dependent temporal reorganization may support flexible adaptation of neural processing to changing reward contingencies during associative learning.
Keywords
1. Introduction
Survival in complex environments requires animals to associate sensory cues with rewards and to flexibly adjust behavioral strategies according to the causal relationship between actions and outcomes (Balleine and O'Doherty, 2010; Sutton and Barto, 1998). Beyond learning which cues predict reward, animals must also learn when to act to obtain it. Two fundamental forms of associative learning support this capacity. In Pavlovian conditioning, reward is delivered independently of behavior, whereas in instrumental conditioning, reward delivery depends on the animal’s actions (Rescorla and Solomon, 1967; Balleine and Dickinson, 1998; Balleine, 2011). These two forms differ in their underlying action-outcome contingencies and may impose distinct temporal and computational demands on neural circuits organizing reward-related behavior (Lee and Keramati, 2017; Simmler and Ozawa, 2019; Jenni et al., 2023; Piccin et al., 2024; Chandrasekaran et al., 2024).
The lateral orbitofrontal cortex (lOFC) has been identified as a central node in reward-based associative learning (Schoenbaum et al., 2009; Wallis, 2007; Ogg et al., 2025), with prior work emphasizing its role in encoding expected outcomes, reward value, and task states (Rudebeck and Rich, 2018; Liu et al., 2025; Howard et al., 2020). lOFC pyramidal neurons (lOFC-PNs) exhibit prominent activity around reward delivery (Stalnaker et al., 2015; Namboodiri et al., 2019; Riceberg and Shapiro, 2017; Izquierdo, 2017; van Wingerden et al., 2010; Romero-Sosa et al., 2025), and disruption of lOFC function impairs the ability to update learned associations when contingencies change, as evidenced by reversal learning deficits across species (Hamilton and Brigman, 2015; Rudebeck and Murray, 2014; Yang et al., 2021). Notably, this lOFC-dependent flexibility is selectively impaired in Sapap3 knockout (KO) mice, a well-established model of obsessive-compulsive-related circuit dysfunction (Yang et al., 2021), although their performance under simpler associative learning paradigms remains less well characterized. However, whether this temporal organization of lOFC-PN activity is stable across different reward contingencies, or reorganizes systematically when the action-outcome relationship changes, remains unknown.
Prior studies that examined lOFC function across Pavlovian and instrumental tasks employed paradigms involving multiple sensory cues, distinct reward types, or graded outcome values, allowing them to address rich questions about outcome value, stimulus specificity, and behavioral flexibility (Ostlund and Balleine, 2007; Cazares et al., 2022; Li et al., 2026). However, whether reward contingency alone, independent of stimulus identity or reward value, is sufficient to reorganize the temporal dynamics of lOFC-PN activity therefore remains an open question.
Here, we investigated how Pavlovian and instrumental reward contingencies shape the temporal organization of lOFC-PN activity during associative learning. We (i) developed a single-odor reward association task to compare licking behavior under two reward contingencies, while recording lOFC-PN activity using fiber photometry; (ii) compared licking behavior and lOFC-PN activity between WT and Sapap3 KO mice to test whether lOFC-PN function during this single-odor associative learning paradigm is preserved in this model; (iii) used a cue-free lick test and linear mixed-effects modeling to dissociate the contribution of reward contingency from that of licking per se; (iv) examined whether the timing of lOFC-PN activity became coupled to anticipatory licking with learning under each contingency; and (v) identified in which task epochs performance-related lOFC-PN activity was concentrated under Pavlovian and instrumental contingencies. Together, this study addresses the behavioral and neural dynamics underlying distinct reward contingencies, and the contingency-dependent coupling between behavior and neural activity, advancing our understanding of how the lOFC dynamically supports reward-guided learning.
2. Materials and methods
Animals
Mice were housed under SPF conditions at 24 ± 2 °C with 45–65% humidity. Age- and sex-matched mice aged 3–6 months were used for all experiments. Prior to behavioral testing, mice were maintained on a 12 h reversed light/dark cycle for at least 4 weeks. Sapap3 knockout (KO) mice were obtained from the laboratory of Guoping Feng (MIT). All behavioral testing was conducted during the mice’s active (dark) phase.
Stereotaxic surgery
Virus injection
Surgical procedures followed established stereotaxic methods described in our previous work (Yang et al., 2021). In brief, mice were anesthetized with tribromoethanol (0.25–0.3 mg/g, i.p.) and head-fixed in a stereotaxic frame (Siskiyou). Body temperature was maintained at 37 °C throughout the procedure using a heating pad (ThinkerTech) and ophthalmic ointment was applied to protect the corneas. A small craniotomy was made over the lOFC using a dental drill (Foredom) at the following coordinates relative to bregma: AP + 2.65 mm, ML ± 1.45 mm, DV -1.50 mm. AAV2/9-CaMKIIα-GCaMP6m (2–5 × 10 12 viral genomes/ml; Shanghai Taitool Bioscience) was injected at a volume of 250 nL and a rate of 2 nL/s using a Nanoliter 2010 injector (WPI). The injection needle was left in place for 10 min after delivery.
Optic fiber implantation
An optical fiber (200 μm OD, NA 0.37) was lowered to 100 μm above the injection site and secured to the skull with dental adhesive (C&B Metabond, Parkell). A custom-made stainless steel head plate was additionally affixed to the skull with Metabond to allow subsequent head fixation during behavioral testing. Carprofen (5 mg/kg, s.c.) was administered immediately after surgery for postoperative analgesia. Mice were singly housed for a minimum of 3 weeks to allow for full surgical recovery and viral expression before behavioral training commenced.
Behavioral test
The experimental timeline is illustrated in Figure 1A. Following surgical recovery, mice were habituated to head fixation on a running wheel for 1–2 h per day over 3 consecutive days. Water restriction began 24–36 h before behavioral training and was maintained throughout the experiment to keep body weight at 85–90% of pre-restriction levels. Odors (clove) were delivered through computer-controlled valves. The licking spout was placed 1 mm below the lower lip and 3 mm caudal to the nasal tip to ensure reliable spout contact while minimizing non-task-related licking.
The odor-reward association task consisted of four sequential stages (Figure 1A). Each block comprised 10 trials, and the inter-trial interval was 15 s. Each trial began with a 1 s odor cue (0–1 s), followed by a 2 s delay period (1–3 s) and a 2 s response window (3–5 s). A trial was scored as a hit if the mouse licked the spout within the response window (3–5 s), or as a miss otherwise (Figure 1B). The hit rate per block was calculated as the percentage of hit trials out of 10 trials. Criterion was defined as a hit rate of ≥80% in two consecutive blocks.
In the Pavlovian acquisition (Pavl-Acq) stage, sucrose reward (5 μL) was delivered automatically at 3–3.5 s after trial onset, independent of the animal’s behavior. Mice advanced to the Pavlovian stabilization (Pavl-Stab) stage upon reaching criterion, during which training continued under the same contingency. In the instrumental acquisition (Inst-Acq) stage, reward delivery was contingent on the mouse licking the spout within the response window; each trial allowed only one reward delivery. Mice then advanced to the instrumental stabilization (Inst-Stab) stage upon reaching criterion.
First lick latency was defined as the time from trial onset to the first lick within a given trial. Calcium peak latency was defined as the time from trial onset to the peak of the calcium signal within a trial. Behavioral training was controlled using LabVIEW software and data were analyzed using custom MATLAB scripts.1.
Cue-free lick test
A separate cohort of four adult wild-type C57BL/6 J mice underwent the same surgical procedures as the main cohort, receiving AAV-CaMKIIα-GCaMP6m injection into the lOFC and optical fiber implantation over the injection site. After 3 weeks of viral expression and recovery, mice underwent a two-stage cue-free lick test (Figure 5A). No odor cue was delivered in either stage. Each trial lasted 15 s.
In Stage 1, mice had ad libitum access to water in the home cage and were head-fixed on a running wheel for one 1-h session per day across three consecutive days. No sucrose reward was delivered. In Stage 2, mice were water-restricted for 36 h and then underwent a single 1-h session of head-fixed recording. At 3–3.5 s of each trial, 3 μL of 10% sucrose solution was automatically delivered through the lick spout, independent of the animal’s behavior.
Lick-free trials were defined as trials with no licking events across the 0–15 s window. Trials containing licking events were aligned to the first lick. In Stage 1, trials with the first lick occurring within 0–9 s were included; in Stage 2, trials with the first lick occurring within 3–5 s were included. The −2 to 0 s window was taken as baseline and the 0 to 6 s window as the response signal.
Fiber photometry
Calcium-dependent fluorescence signals from lOFC pyramidal neurons were recorded using a fiber photometry system (ThinkerTech Nanjing Bioscience) as previously described (Yang et al., 2021; Li et al., 2019). A 470 nm laser (20–30 μW at the fiber tip) was used to excite GCaMP6m fluorescence. Signals were acquired at 100 Hz. Fluorescence was normalized to baseline using the formula:
Where F is the fluorescence during the behavioral event, F 0 is the mean fluorescence during the 2 s preceding the event, and F offset is the baseline offset recorded when the optical fiber was disconnected.
Histology
Mice were anesthetized with a lethal dose of tribromoethanol (0.4 mg/kg, i.p.) and perfused transcardially with ice-cold PBS followed by 4% paraformaldehyde (PFA) in PBS. Brains were extracted and post-fixed in 4% PFA at 4 °C overnight, then transferred to 30% sucrose in PBS for cryoprotection until fully saturated. Coronal sections (30 μm thickness) through the virus injection site were cut on a cryostat (CM3050 S, Leica). For nuclear counterstaining, sections were incubated with Hoechst dye (1:5000, C1011, Beyotime) for 10 min at room temperature and imaged on a fluorescence microscope (ECLIPSE Ni-E, Nikon) using a 10 × objective (N. A. 0.3, W. D. 16.00 mm).
Linear mixed-effects modeling
Linear mixed-effects modeling (LMM) was performed on the calcium AUC of each task epoch (cue: 0–1 s; delay: 1–3 s; response: 3–5 s), separately for hit and miss trials.
For each mouse, AUC and licking rate within each epoch were averaged across all trials of a given trial type (hit or miss) within each phase (Pavlovian or instrumental), yielding one observation per mouse per phase. AUC was computed from ΔF/F signals as described above.
For each epoch and trial type, the AUC was modeled as a function of lick rate in that epoch, reward contingency (Pavlovian vs. instrumental), sex, genotype (WT vs. KO), and age (categorized as young vs. old) as fixed effects, with mouse identity as a random intercept: AUC_epoch ~ lick_epoch + Contingency + Sex + Genotype + Age + (1 | Mouse).
Six independent models were fitted in total (3 epochs × 2 trial types). For miss trials, licking events were absent during the response epoch by definition, and the lick rate predictor was omitted from the response-epoch miss-trial model. All categorical predictors were entered as binary factors, with the alphabetically first level treated as the reference (Sex: F as reference; Genotype: KO as reference; Age: old as reference; Contingency: instrumental as reference). Models were fitted in MATLAB using the fitlme function with default restricted maximum likelihood (REML) estimation. For each predictor, the regression coefficient (β), 95% confidence interval, and p -value were extracted; significance levels were defined as p < 0.001 (*), p < 0.01 (), p < 0.05 (*), and 0.05 ≤ p < 0.1 (#, trend-level).
Quantification and statistical analysis
Behavioral and fiber photometry data were analyzed using custom MATLAB scripts (Z. Y.). Statistical analyses were performed in GraphPad Prism 9. Normality was assessed using the Shapiro–Wilk test. For normally distributed data, two-tailed unpaired t-tests, repeated-measures one-way ANOVA with Dunnett’s post hoc test, and Pearson correlation were used. For non-normally distributed data, Mann–Whitney tests, Wilcoxon matched-pairs signed rank test, Friedman tests, and Spearman correlation were used. Because missing values were present in certain accuracy levels or trial types in two-factor comparisons, mixed-effects analysis with Bonferroni’s multiple comparisons test was applied. Values are expressed as mean ± SEM. Statistical significance was set at p < 0.05. Detailed statistics are provided in the Statistical Table.
3. Results
Result 1. Licking behavior and lOFC-PN activity are comparable between WT and Sapap3 KO mice in an odor-reward association task
To investigate how reward contingency reorganizes lOFC pyramidal neuron (hereafter lOFC-PN) activity during associative learning, we developed an odor-reward association task in which a single odor cue predicted reward delivery under either Pavlovian or instrumental contingencies (Figure 1A), thereby isolating reward contingency from stimulus identity and reward value as task variables.
To monitor lOFC-PN activity during behavior, we injected AAV-CaMKIIα-GCaMP6m into the lOFC and implanted an optical fiber over the injection site. After 3 weeks of viral expression and recovery, WT and Sapap3 KO mice underwent water restriction and habituation before behavioral training (Figure 1A).
The odor-reward association task comprised four sequential stages (Figure 1A): Pavlovian acquisition (Pavl-Acq) and stabilization (Pavl-Stab) stages, followed by instrumental acquisition (Inst-Acq) and stabilization (Inst-Stab) stages. In each trial, a 1 s odor cue (0–1 s) was followed by a 2 s delay (1–3 s) and a 2 s response (3–5 s) window (Figure 1B). A trial was scored as a hit if the mouse licked within the response window (3–5 s), and as a miss otherwise (Figure 1B). In the Pavl stages, sucrose reward was delivered automatically at 3–3.5 s independent of behavior, whereas in the Inst stages, reward delivery was contingent on a licking response within the response window. Mice were required to reach a behavioral criterion (≥80% hit rate in two consecutive blocks) in each acquisition stage before advancing to the corresponding stabilization stage.
The number of blocks required to reach criterion did not differ between WT and KO mice in either the Pavl-Acq or Inst-Acq stage (Figure 1C), indicating comparable task acquisition across genotypes. We then examined licking behavior and lOFC-PN activity cross all four stages between WT and Sapap3 KO mice (representative single-mouse traces shown in Figures 1D,E). Licking rate traces and lOFC-PN calcium signals were similar between WT and KO mice for both hit and miss trials (Figure 2). Quantification of average licking rate and area under the curve (AUC) of lOFC-PN signals within each task epoch (odor: 0–1 s; delay: 1–3 s; response window: 3–5 s) revealed no significant differences between genotypes in any stage or trial type (Figure 2). These results demonstrate that licking behavior and lOFC-PN activity were comparable between WT and Sapap3 KO mice, supporting the pooling of WT and KO animals for all subsequent analyses.
Result 2. Licking behavior and lOFC-PN activity differ between reward contingencies during hit trials
Having confirmed that WT and Sapap3 KO mice were comparable, we pooled all 25 mice and compared licking behavior and lOFC-PN activity across the four training stages, separately for hit and miss trials.
In hit trials, both licking rate and lOFC-PN activity traces were similar between the two Pavlovian stages (Pavl-Acq and Pavl-Stab) and between the two instrumental stages (Inst-Acq and Inst-Stab), but differed markedly between Pavlovian and instrumental stages, particularly during the delay period (Figures 3A,E). Quantification confirmed no significant differences in licking rate or lOFC-PN AUC between Pavl-Acq and Pavl-Stab or between Inst-Acq and Inst-Stab in any epoch (Figures 3B–D). In contrast, licking rates were significantly higher in the instrumental than the Pavlovian stages during both the odor (0–1 s) and delay (1–3 s) epochs (Figures 3B,C). lOFC-PN signal AUC followed a similar pattern: no significant differences within the same contingency, but significantly higher activity in instrumental than Pavlovian stages across multiple epochs (Figures 3F–H).
In miss trials, both licking and lOFC-PN signal traces were overlapping across all four stages (Figures 3I,L). Licking rates showed only a significant elevation in Inst-Stab during the odor epoch (0–1 s) compared with the Pavlovian stages, with no differences in other epochs (Figures 3J,K). Thus, despite a statistically significant difference in licking during the odor epoch, lOFC-PN activity remained unchanged across stages (Figures 3L–O).
Together, these results demonstrate that licking behavior and lOFC-PN activity were stable within each contingency across acquisition and stabilization stages. While differences in licking between contingencies were observed in both hit and miss trials, differences in lOFC-PN activity between contingencies emerged specifically during hit trials, suggesting that the contingency-related differences in lOFC-PN activity were associated with successful reward acquisition rather than licking per se.
Result 3. Differences in lOFC-PN activity between Pavlovian and instrumental phases during hit trials but not miss trials
Given that licking behavior and lOFC-PN activity were stable across acquisition and stabilization within each contingency (Figure 3), we merged stages sharing the same reward contingency into a Pavlovian phase (Pavl-Acq & Pavl-Stab) and an instrumental phase (Inst-Acq & Inst-Stab) for subsequent analyses.
In hit trials (Figures 4A–H), both licking rate and lOFC-PN signal AUC over the 0–5 s window were significantly higher in the instrumental than the Pavlovian phase (Figures 4D,H). In miss trials (Figures 4I–P), although licking rate was also significantly higher in the instrumental than the Pavlovian phase (Figure 4L), lOFC-PN signal AUC showed no significant difference between phases (Figure 4P).
The phase-level analysis thus confirms and extends the stage-level findings: contingency-related differences in lOFC-PN activity were observed in hit trials but not miss trials, despite contingency-related differences in licking being present in both. This dissociation suggests that the contingency-related differences in lOFC-PN activity were associated with successful reward acquisition rather than with licking per se.
Result 4. A cue-free lick test reveals that lOFC-PN activity is driven by reward-paired licking rather than licking per se
Although the hit and miss dissociation suggested that licking per se could not fully explain the contingency-related differences in lOFC-PN activity (Figures 3,4), licking might still contribute to these differences within hit trials, where licking rates also differed between contingencies. To directly test whether licking per se is sufficient to drive lOFC-PN activity, we performed a cue-free lick test in a separate cohort of WT mice across two consecutive stages in which licking occurred either without or with reward: in Stage 1, licking occurred without reward (spontaneous licking under ad libitum water); in Stage 2, licking occurred with reward (cue-free automatic reward delivery under water restriction) (Figure 5A).
We first compared lOFC-PN activity during lick-free trials between the two stages. lOFC-PN signals remained near baseline in both stages, with no significant difference in AUC (Figures 5B–E), indicating that the difference in motivational state between stages did not alter lOFC-PN activity.
We next examined trials containing licking events, aligned to the first lick. Licking rates following the first lick were comparable between the two stages (Figures 5F–I). Despite this similarity in licking behavior, lOFC-PN activity diverged sharply between stages. In Stage 1, where licking was unpaired with reward, calcium signals remained near baseline following the first lick (Figures 5J,L). In Stage 2, where licking was followed by reward, robust calcium transients emerged (Figures 5K,L), with significantly higher AUC in Stage 2 (Figure 5M).
Together, these results demonstrate that licking per se is not sufficient to drive lOFC-PN activity. Instead, lOFC-PN activity is selectively engaged when licking is paired with reward, supporting the interpretation that the contingency-related differences in lOFC-PN activity observed in our main task (Figures 3, 4) reflect reward-related processing rather than licking motor activity.
Result 5. Linear mixed-effects modeling identifies reward contingency as an independent contributor to lOFC-PN activity beyond licking
To further dissociate the contribution of licking from that of reward contingency in driving lOFC-PN activity, while controlling for sex, genotype, age, and between-subject variability, we performed linear mixed-effects modeling (LMM) on the calcium AUC of each task epoch (odor: 0–1 s; delay: 1–3 s; response window: 3–5 s; Figure 6).
In hit trials, lick rate significantly contributed to lOFC-PN AUC only during the delay epoch (β = 13.46, p = 0.0012), but not during the cue (β = 1.83, p = 0.74) or response (β = 0.78, p = 0.82) epochs (Figures 6A,D–F). In contrast, reward contingency significantly contributed to lOFC-PN AUC during the cue and response epochs, with a trend-level contribution during the delay epoch (cue: β = −0.59, p = 0.028; delay: β = −1.03, p = 0.057; response: β = −2.42, p = 0.0014; Figures 6B,D–F). Notably, in both the cue and response epochs, contingency was a significant predictor of lOFC-PN activity while lick rate was not, demonstrating that the contingency-related differences in lOFC-PN activity cannot be explained by licking behavior alone. Sex, genotype, and age showed no significant contribution in any epoch (Figure 6C).
In miss trials, no variable significantly contributed to lOFC-PN AUC in any epoch (Figures 6G–L), consistent with the absence of contingency-related modulation of lOFC-PN activity during unsuccessful trials observed in Figures 3, 4.
Together, these LMM results demonstrate that reward contingency contributes to lOFC-PN activity independently of licking, sex, genotype, and age, confirming that the contingency-specific differences in lOFC-PN activity reflect reward-related processing rather than licking motor activity per se.
Result 6. lOFC-PN activity timing becomes coupled to anticipatory licking only under instrumental contingency
While the LMM analysis identified the contributions of contingency and licking to overall lOFC-PN activity within each task epoch (Figure 6), it did not address how the timing of lOFC-PN activity relates to behavioral timing across learning. To examine this, we stratified behavioral blocks by hit rate (Low: ≤30%, Medium: 40–60%, High: ≥70%) (Figure 7A), and analyzed first lick latency and calcium peak latency from hit trials within each performance level in each phase.
First lick latency decreased progressively with performance in both Pavlovian and instrumental phases (Figures 7B–E), indicating that mice initiated anticipatory licking earlier as learning advanced. Calcium peak latency, however, showed contingency-dependent patterns within each phase (Figures 7F–I). In the Pavlovian phase, calcium peak latency remained stable around 4 s across all performance levels, coinciding with reward delivery (Figures 7F,H). In the instrumental phase, calcium peak latency progressively advanced with performance, reaching significantly earlier values at High than at Low or Medium performance (Figures 7G,I).
To directly test whether the timing of lOFC-PN activity was coupled to that of anticipatory licking, we correlated calcium peak latency with first lick latency across mice. In the Pavlovian phase, no significant correlation was detected, either overall (Figure 7J) or at any performance level (Figures 7L,N,P), indicating that lOFC-PN activity timing remained independent of licking timing throughout learning. In the instrumental phase, by contrast, the correlation emerged and strengthened progressively with learning: no correlation was detected at Low performance (Figure 7M), a significant correlation emerged at Medium performance (Figure 7O), and the correlation further strengthened at High performance (Figure 7Q). Pooling across performance levels confirmed an overall significant correlation in the instrumental phase (Figure 7K).
Together, these results reveal a contingency-dependent shift in the temporal coupling of lOFC-PN activity. Under Pavlovian contingencies, lOFC-PN activity timing remained aligned with reward delivery and independent of licking initiation. Under instrumental contingencies, lOFC-PN activity became progressively coupled to anticipatory licking, reflecting a shift from reward-aligned to action-aligned lOFC-PN activity.
Result 7. Performance-related lOFC-PN activity is concentrated in distinct task epochs under Pavlovian and instrumental reward contingencies
Having shown that the timing of lOFC-PN activity becomes contingency-dependent (Figure 7), we next asked in which task epoch lOFC-PN activity tracks behavioral performance under each contingency. To address this, we correlated hit rate with lOFC-PN activity in each task epoch (cue: 0–1 s; delay: 1–3 s; response: 3–5 s) separately for each phase (Figures 8A–F).
In the Pavlovian phase, lOFC-PN AUC correlated significantly with hit rate only during the response epoch (Figure 8C), with no significant correlation during the cue (Figure 8A) or delay (Figure 8B) epochs. In the instrumental phase, by contrast, lOFC-PN AUC correlated significantly with hit rate only during the delay epoch (Figure 8E), with no significant correlation during the cue (Figure 8D) or response (Figure 8F) epochs. Thus, the performance-related lOFC-PN activity was specific to the reward delivery period under Pavlovian contingencies, but shifted to the pre-reward delay period under instrumental contingencies.
Between-phase comparison further revealed that lOFC-PN AUC was significantly higher in the instrumental than the Pavlovian phase at Medium and High performance during the delay epoch (Figure 8H), and at all three performance levels during the response epoch (Figure 8I), with no significant differences during the cue epoch (Figure 8G).
Together, these results reveal contingency-specific task epochs in which performance-related lOFC-PN activity is concentrated. Under Pavlovian contingencies, this activity tracked performance during the reward delivery epoch. Under instrumental contingencies, it tracked performance during the anticipatory delay period. Combined with the temporal coupling shown in Figure 7, these findings collectively indicate a shift from reward-aligned to action-aligned lOFC-PN activity.
4. Discussion
Our results support a working model in which reward contingency is associated with distinct temporal patterns of both licking behavior and lOFC-PN activity during associative learning (Figure 9). Under Pavlovian contingencies, where reward delivery was independent of behavior, licking was concentrated around the time of reward delivery within the response window, and performance-related lOFC-PN activity was similarly concentrated around the response window; no significant temporal coupling between neural activity and anticipatory licking was detected (Figure 9A). In contrast, under instrumental contingencies, where reward was contingent on the animal’s action, anticipatory licking emerged progressively during the pre-reward delay period, and lOFC-PN activity also extended into the delay period in parallel with the licking pattern; its timing became progressively coupled to anticipatory licking with learning (Figure 9B). Together, these results identify two distinct temporal patterns of both licking behavior and lOFC-PN activity: reward-aligned mode under Pavlovian learning and action-aligned mode under instrumental learning.
A potential concern arising from our findings is whether the contingency-related differences in lOFC-PN activity simply reflect the differences in licking behavior between the two contingencies, rather than reward-related processing. This concern is reinforced by recent work showing that movement-related signals can pervade multiple brain regions (Musall et al., 2019; Stringer et al., 2019). Two complementary lines of evidence argue against a pure licking account. Experimentally, the cue-free lick test (Figure 5) showed that licking in the absence of motivational drive and reward did not elicit detectable lOFC-PN activity, whereas licking in the presence of motivational drive and reward was accompanied by robust lOFC-PN responses, despite comparable licking dynamics across the two conditions. Statistically, the linear mixed-effects model (Figure 6) revealed that reward contingency contributed to lOFC-PN activity independently of licking during the cue and response epochs, where contingency was a significant predictor while lick rate was not. In the delay epoch, by contrast, lick rate was the primary contributor; this pattern, however, does not undermine the broader interpretation, as the close coupling between delay-epoch activity and anticipatory licking is itself a defining feature of action-aligned activity under instrumental contingencies. Together, these experimental and statistical results indicate that licking per se was not sufficient to drive lOFC-PN activity. Rather, lOFC-PN activity emerged when licking occurred in the context of reward-related processing, encompassing motivational drive, reward expectation, and anticipatory action.
The contingency-dependent shift in the temporal alignment of lOFC-PN activity raises the question of how this pattern relates to existing accounts of lOFC function. Prior work has characterized the lOFC as a central node in reward-based learning by emphasizing its role in encoding expected outcomes, reward value, and task states (Schoenbaum et al., 2009; Wallis, 2007; Ogg et al., 2025; Maier, 2015; Walton et al., 2010). In these accounts, however, contingency structure typically co-varied with other task features, leaving its specific contribution to the temporal organization of lOFC activity unresolved. Our task design isolated this contribution and revealed that lOFC-PN activity can dynamically reorganize its temporal alignment with behavior depending on whether reward acquisition is passive or action-dependent.
Our cohort included both WT and Sapap3 KO mice, allowing us to assess whether this strain shows abnormalities in our simple odor-reward task. Licking behavior and lOFC-PN activity were comparable between genotypes across all stages and trial types (Figures 1, 2), consistent with prior reports of intact odor discrimination in Sapap3 KO mice (Yang et al., 2021). Previous work has reported impairments in Sapap3 KO mice during reversal learning (Yang et al., 2021; Manning et al., 2023; Benzina et al., 2021; van den Boom et al., 2019; Manning et al., 2019), a paradigm requiring reversal of an established stimulus-outcome association to assess cognitive flexibility. Our task differs from reversal learning in this regard. Although it involves a change from passive to action-dependent reward acquisition, the stimulus-outcome association itself remains intact, since the cue continues to predict reward across both contingencies. Our findings therefore indicate that this paradigm does not engage the cognitive processes selectively disrupted in Sapap3 KO mice, complementing prior literature focused on reversal learning.
One limitation of our study is that all animals were trained sequentially on the Pavlovian and instrumental phases, leaving contingency partially confounded with training history. Nevertheless, two features of our data argue against a pure training-history account. The contingency-related differences in lOFC-PN activity were detected during hit trials but not during miss trials (Figures 3, 4), whereas a generalized training-history effect would be expected to affect both trial types. In addition, the cue-free lick test (Figure 5) was conducted in a separate cohort and does not depend on the Pavlovian-to-instrumental order. Future studies using counterbalanced training designs or a naïve instrumental cohort will nonetheless be needed to fully dissociate contingency from training history.
A further consideration relates to the simplicity of our paradigm, which constrained how learning could be analyzed. Mice rapidly reached the behavioral criterion (≥80% hit rate in two consecutive blocks), precluding continuous temporal analysis of how behavior and lOFC-PN activity evolved across learning. We therefore used block-level hit rate as a performance metric and stratified blocks into Low/Medium/High bins, a tripartite scheme designed to capture how lOFC-PN activity varies across distinct levels of behavioral performance while maintaining sufficient blocks per bin. Future work incorporating greater task complexity, such as probabilistic reinforcement or graded reward magnitudes, would slow acquisition and enable continuous, trial-by-trial modeling of learning trajectories.
5. Conclusions
In summary, by isolating contingency structure from stimulus identity and reward value, our task design reveals that reward contingency is associated with parallel temporal reorganization of both anticipatory licking behavior and lOFC-PN activity, shifting from reward-aligned under Pavlovian learning to action-aligned under instrumental learning. As learning advanced, lOFC-PN activity timing became progressively coupled to anticipatory licking under instrumental but not Pavlovian contingencies, and this contingency-dependent reorganization could not be accounted for by licking per se, indicating that lOFC-PN activity reflects reward-related processing rather than motor output. Together, these findings identify reward contingency as a key determinant of how lOFC pyramidal neurons temporally align their activity with behavior during associative learning, with implications for understanding how the OFC supports flexible coordination between learning and goal-directed action.
Statements
- Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- Funding
The author(s) declared that financial support was received for this work and/or its publication. This work was supported by grants from the National Natural Science Foundation of China (82271550 and 31970949 to HL), R&D Program of Beijing Municipal Education Commission (KZ202210025029 to HL), Chinese Institutes for Medical Research, Beijing (CX24PY03 to HL).
- Data availability
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author/s.
- Ethics approval
The animal study was approved by the Animal Experimentation and Laboratory Animal Welfare Committee of Capital Medical University (approval number: AEEI-2023-164). The study was conducted in accordance with the local legislation and institutional requirements.
- Author contributions
ZY: Writing – review & editing, Investigation, Conceptualization, Writing – original draft, Supervision, Software, Project administration, Data curation, Validation, Methodology, Visualization, Formal analysis. XC: Formal analysis, Validation, Writing – review & editing. XS: Validation, Writing – review & editing. HL: Writing – review & editing, Supervision, Resources, Project administration.
- Acknowledgements
We thank Guoping Feng (MIT) for providing the Sapap3 knockout mice used in this study. We also thank the reviewers for their constructive comments, which significantly improved the manuscript.
References
- Balleine B. W. (2011). “ Frontiers in Neuroscience Sensation, Incentive Learning, and the Motivational Control of Goal-Directed Action,” in Neurobiology of Sensation and Reward, ed. Gottfried J. A. (Boca Raton, FL: CRC Press, Taylor and Francis).
- Balleine B. W., Dickinson A. (1998). Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407 – 419. doi:, doi:10.1016/S0028-3908(98)00033-1
- Balleine B. W., O'Doherty J. P. (2010). Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35, 48 – 69. doi:, doi:10.1038/npp.2009.131
- Benzina N., N'Diaye K., Pelissolo A., Mallet L., Burguière E. (2021). A cross-species assessment of behavioral flexibility in compulsive disorders. Commun. Biol. 4: 96.
- Cazares C., Schreiner D. C., Valencia M. L., Gremel C. M. (2022). Orbitofrontal cortex populations are differentially recruited to support actions. Curr. Biol. 32, 4675 – 4687.e5. doi:, doi:10.1016/j.cub.2022.09.022
- Chandrasekaran A. N., Vermani A., Gupta P., Steinmetz N., Moore T., Sridharan D. (2024). Dissociable components of attention exhibit distinct neuronal signatures in primate visual cortex. Sci. Adv. 10: eadi0645. doi:, doi:10.1126/sciadv.adi0645
- Hamilton D. A., Brigman J. L. (2015). Behavioral flexibility in rats and mice: contributions of distinct frontocortical regions. Genes Brain Behav. 14, 4 – 21. doi:, doi:10.1111/gbb.12191
- Howard J. D., Reynolds R., Smith D. E., Voss J. L., Schoenbaum G., Kahnt T. (2020). Targeted stimulation of human orbitofrontal networks disrupts outcome-guided behavior. Curr. Biol. 30, 490 – 498.e4. doi:, doi:10.1016/j.cub.2019.12.007
- Izquierdo A. (2017). Functional heterogeneity within rat orbitofrontal cortex in reward learning and decision making. J. Neurosci. 37, 10529 – 10540. doi:, doi:10.1523/JNEUROSCI.1678-17.2017
- Jenni N. L., Symonds N., Floresco S. B. (2023). Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking. Psychopharmacology 240, 441 – 459. doi:, doi:10.1007/s00213-022-06265-8
- Lee J. J., Keramati M. (2017). Flexibility to contingency changes distinguishes habitual and goal-directed strategies in humans. PLoS Comput. Biol. 13: e1005753. doi:, doi:10.1371/journal.pcbi.1005753
- Li Y., Liu Z., Guo Q., Luo M. (2019). Long-term Fiber photometry for neuroscience studies. Neurosci. Bull. 35, 425 – 433. doi:, doi:10.1007/s12264-019-00379-4
- Li P., Zhang H., Wang J., Su Y., Tao L., Wen Q. (2026). Multi-timescale motor circuit dynamics underlie adaptive and efficient exploratory behavior. Curr. Biol. 36, 2990 – 3004.e8. doi:, doi:10.1016/j.cub.2026.05.004
- Liu Q., Porter D., Damra H., Zhao Y., Voss J. L., Schoenbaum G.. (2025). Distinct contributions of anterior and posterior orbitofrontal cortex to outcome-guided behavior. Curr. Biol. 35, 5549 – 5559.e7. doi:, doi:10.1016/j.cub.2025.10.007
- Maier S. F. (2015). Behavioral control blunts reactions to contemporaneous and future adverse events: medial prefrontal cortex plasticity and a corticostriatal network. Neurobiol. Stress 1, 12 – 22. doi:, doi:10.1016/j.ynstr.2014.09.003
- Manning E. E., Dombrovski A. Y., Torregrossa M. M., Ahmari S. E. (2019). Impaired instrumental reversal learning is associated with increased medial prefrontal cortex activity in Sapap3 knockout mouse model of compulsive behavior. Neuropsychopharmacology 44, 1494 – 1504. doi:, doi:10.1038/s41386-018-0307-2
- Manning E. E., Geramita M. A., Piantadosi S. C., Pierson J. L., Ahmari S. E. (2023). Distinct patterns of abnormal lateral orbitofrontal cortex activity during compulsive grooming and reversal learning normalize after fluoxetine. Biol. Psychiatry 93, 989 – 999. doi:, doi:10.1016/j.biopsych.2021.11.018
- Musall S., Kaufman M. T., Juavinett A. L., Gluf S., Churchland A. K. (2019). Single-trial neural dynamics are dominated by richly varied movements. Nat. Neurosci. 22, 1677 – 1686. doi:, doi:10.1038/s41593-019-0502-4
- Namboodiri V. M. K., Otis J. M., van Heeswijk K., Voets E. S., Alghorazi R. A., Rodriguez-Romaguera J.. (2019). Single-cell activity tracking reveals that orbitofrontal neurons acquire and maintain a long-term memory to guide behavioral adaptation. Nat. Neurosci. 22, 1110 – 1121. doi:, doi:10.1038/s41593-019-0408-1
- Ogg M. C., Lansdell B. J., Franks H. T., Hughes A. C., Lee J., Nolen H. G.. (2025). Locus coeruleus norepinephrine neurons facilitate orbitofrontal cortex remapping and behavioral flexibility. Cell Rep. 44: 116687. doi:, doi:10.1016/j.celrep.2025.116687
- Ostlund S. B., Balleine B. W. (2007). Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J. Neurosci. 27, 4819 – 4825. doi:, doi:10.1523/JNEUROSCI.5443-06.2007
- Piccin A., Plat H., Wolff M., Coutureau E. (2024). Adaptive responding to stimulus-outcome associations requires noradrenergic transmission in the medial prefrontal cortex. J. Neurosci. 44: e0078242024. doi:, doi:10.1523/JNEUROSCI.0078-24.2024
- Rescorla R. A., Solomon R. L. (1967). Two-process learning theory: relationships between Pavlovian conditioning and instrumental learning. Psychol. Rev. 74, 151 – 182. doi:, doi:10.1037/h0024475
- Riceberg J. S., Shapiro M. L. (2017). Orbitofrontal cortex signals expected outcomes with predictive codes when stable contingencies promote the integration of reward history. J. Neurosci. 37, 2010 – 2021. doi:, doi:10.1523/JNEUROSCI.2951-16.2016
- Romero-Sosa J. L., Yeghikian A., Wikenheiser A. M., Blair H. T., Izquierdo A. (2025). Neural coding of choice and outcome are modulated by uncertainty in orbitofrontal but not secondary motor cortex. Nat. Commun. 16: 8931. doi:, doi:10.1038/s41467-025-63866-5
- Rudebeck P. H., Murray E. A. (2014). The orbitofrontal oracle: cortical mechanisms for the prediction and evaluation of specific behavioral outcomes. Neuron 84, 1143 – 1156. doi:, doi:10.1016/j.neuron.2014.10.049
- Rudebeck P. H., Rich E. L. (2018). Orbitofrontal cortex. Curr. Biol. 28, R1083 – r1088. doi:, doi:10.1016/j.cub.2018.07.018
- Schoenbaum G., Roesch M. R., Stalnaker T. A., Takahashi Y. K. (2009). A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 10, 885 – 892. doi:, doi:10.1038/nrn2753
- Simmler L. D., Ozawa T. (2019). Neural circuits in goal-directed and habitual behavior: implications for circuit dysfunction in obsessive-compulsive disorder. Neurochem. Int. 129: 104464. doi:, doi:10.1016/j.neuint.2019.104464
- Stalnaker T. A., Cooch N. K., Schoenbaum G. (2015). What the orbitofrontal cortex does not do. Nat. Neurosci. 18, 620 – 627. doi:, doi:10.1038/nn.3982
- Stringer C., Pachitariu M., Steinmetz N., Reddy C. B., Carandini M., Harris K. D. (2019). Spontaneous behaviors drive multidimensional, brainwide activity. Science 364: 255. doi:, doi:10.1126/science.aav7893
- Sutton R. S., Barto A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
- Van den Boom B. J. G., Mooij A. H., Misevičiūtė I., Denys D., Willuhn I. (2019). Behavioral flexibility in a mouse model for obsessive-compulsive disorder: impaired Pavlovian reversal learning in SAPAP3 mutants. Genes Brain Behav. 18: e12557. doi:, doi:10.1111/gbb.12557
- Van Wingerden M., Vinck M., Lankelma J., Pennartz C. M. (2010). Theta-band phase locking of orbitofrontal neurons during reward expectancy. J. Neurosci. 30, 7078 – 7087. doi:, doi:10.1523/JNEUROSCI.3860-09.2010
- Wallis J. D. (2007). Orbitofrontal cortex and its contribution to decision-making. Annu. Rev. Neurosci. 30, 31 – 56. doi:, doi:10.1146/annurev.neuro.30.051606.094334
- Walton M. E., Behrens T. E., Buckley M. J., Rudebeck P. H., Rushworth M. F. (2010). Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927 – 939. doi:, doi:10.1016/j.neuron.2010.02.027
- Yang Z., Wu G., Liu M., Sun X., Xu Q., Zhang C.. (2021). Dysfunction of orbitofrontal GABAergic interneurons leads to impaired reversal learning in a mouse model of obsessive-compulsive disorder. Curr. Biol. 31, 381 – 393.e4. doi:, doi:10.1016/j.cub.2020.10.045
Citation
Yang, Z., et al. (2026). Reward contingency reorganizes lateral orbitofrontal cortex pyramidal neuron activity from reward-aligned to action-aligned during associative learning. Frontiers in Cellular Neuroscience, Volume 20. https://doi.org/
- Received
- Accepted
- Published
- Volume
- 20 - 2026
Copyright
Copyright © 2026 Yang, Chen, Sun and Lei.
License: https://creativecommons.org/licenses/by/4.0/
*Correspondence: Zicheng Yang; Huimeng Lei
Article metrics
- Views
- 0
- Downloads
- 0
- Citations
- 0
- Shares
- 0
