Skip to content

Original Research

Frontiers in Neuroimaging ·

Volume 5 - 2026 | https://doi.org/10.3389/fnimg.2026.1800369

Pulvinar pathways as skip connections in deep neural networks for vision

  • Narmin Zarinabadi1
  • Christian Casanova1
  • Nelson Cortes1*corresponding author
  1. Visual Neuroscience Laboratory, School of Optometry, Université de Montréal, Montreal, QC, Canada
Article metrics0 viewsView details

Abstract

The pulvinar is thought to regulate cortico-cortical communication through transthalamic pathways, yet the computational consequences of such modulation remain unclear. A minimal pulvinar-inspired long-range skip pathway in a hierarchical convolutional vision model was tested, implemented as a learned projection from early to late feature maps coupled with a gain-controlled gating mechanism. The architecture was evaluated in two complementary experiments: CIFAR-10 categorization and a near-threshold contrast-detection task with noisy backgrounds. In CIFAR-10 categorization, the pulvinar-augmented model did not primarily act as a uniform accuracy booster; instead, it reshaped contrast-dependent response scaling and stabilized internal representations, consistent with gain control. These effects persisted under matched representational regimes, indicating that performance differences cannot be explained by changes in representational geometry alone. In the near-threshold detection task, pulvinar-like modulation systematically redistributed detection outcomes, consistent with shifts in decision criterion under uncertainty, and in specific regimes supported improved discriminability. Together, these findings indicate that pulvinar-inspired connectivity contributes primarily to gain and decision-criterion control. We propose that the pulvinar regulates how sensory evidence is weighted and converted into decisions, rather than directly enhancing task accuracy.

Keywords

1. Introduction

The pulvinar has become increasingly central to contemporary theories of thalamocortical computation. Rather than serving as a passive relay of sensory information, as classical models proposed, the pulvinar is now understood as an active regulatory hub that shapes cortical communication, attention, and hierarchical integration (Cortes et al., 2024, 2026). Extensive anatomical studies demonstrate that the pulvinar receives dense, reciprocal projections from nearly all levels of the visual cortical hierarchy as well as convergent input from the superior colliculus, placing it at a critical intersection of subcortical and cortical pathways (Casanova and Chalupa, 2023). Physiological evidence further reveals that pulvinar neurons exhibit receptive-field properties comparable to cortical neurons, including selectivity for orientation, direction of motion, disparity, and global motion patterns (Casanova et al., 2001). These properties are strongly dependent on cortical inputs: inactivation of V1 sharply reduces responses in pulvinar subdivisions such as the striate-recipient zone, demonstrating that cortical feedback is essential for shaping pulvinar activity (Casanova and Darveau, 1997).

Beyond relaying visual signals, the pulvinar exerts widespread influences on cortical processing. Pulvinar projections can alter firing rates, shift response gain, and reshape spatial and temporal response profiles in multiple cortical regions including V1, V2, V4, and high-level temporal cortex (Casanova and Chalupa, 2023; Casanova, 2020; Sherman, 2017). A key mechanism underlying this influence is the pulvinar's ability to regulate effective connectivity between cortical areas (Cortes et al., 2024), dynamically modulating the strength of cortico-cortical interactions, effectively determining how strongly one cortical population drives another (Shipp, 2003; Saalmann et al., 2012). This modulation is highly context dependent: pulvinar activity selectively enhances task-relevant visual information and attentional priority (Robinson and Petersen, 1992; Zhou et al., 2016), consistent with theories that the pulvinar implements precision or gain control within a predictive coding (Kanai et al., 2015; Olsen et al., 2012; Cortes et al., 2024, 2026).

The pulvinar also plays a critical role in coordinating the timing of communication across the cortical hierarchy. The pulvinar organizes interareal synchrony, influencing gamma- and theta-band coupling that regulates when different cortical populations communicate (Saalmann et al., 2012; Wróbel, 2000; Cortes et al., 2026, 2020). This ability to selectively synchronize distributed cortical regions implies that the pulvinar not only routes information but also structures the temporal windows in which communication can occur. Such temporal modulation is essential for functions such as attention, object segmentation, and visuomotor coordination (Miura and Scanziani, 2022).

These findings have led to the modern view of the pulvinar as a transthalamic communication hub. In this framework, the pulvinar belongs to a class of higher-order thalamic (HO) nuclei, defined as thalamic structures that receive strong driving input from cortex and participate in cortico-thalmo-cortical loops rather than simply relaying peripheral sensory signals (Sherman and Guillery, 2011). Through these transthalamic pathways, HO nuclei can mediate indirect corticocortical interactions, effectively linking distant cortical regions while bypassing long chains of intermediate cortical processing (Sherman and Guillery, 2011; Cortes and Vreeswijk, 2015). This architecture has a natural computational analog in deep learning, where skip connections allow early feature representations to directly influence deeper processing stages, improving signal propagation and stabilizing hierarchical computations (Figure 1) (He et al., 2015). The analogy is especially compelling when the skip pathway is not merely additive, but modulatory: in biology, pulvinar-mediated influence is often described as gain control or context-dependent gating of cortical interactions; in machine learning, gated residual pathways similarly regulate the strength and content of long-range interactions.

Recent work on other HO nuclei further reinforces this view of the thalamus as a regulator of cortical dynamics. In particular, studies of the mediodorsal (MD) thalamus have shown that thalamocortical circuits can regulate cortical gain, stabilize task-relevant ensembles, and enable flexible switching between cortical representations during cognitive tasks (Schmitt et al., 2017; Rikhye et al., 2018; Mukherjee et al., 2021). Although these studies primarily concern prefrontal circuits, they support a broader view in which HO act as modulators of cortical dynamics rather than passive relays.

Despite extensive anatomical, physiological, and theoretical work describing pulvinar-mediated gating, precision control, and transthalamic routing (Shipp, 2003; Kanai et al., 2015; Sherman and Guillery, 2011; Cortes et al., 2026), the computational implications of these mechanisms remain largely unexplored in modern deep convolutional architectures. Most deep networks incorporate skip connections primarily to improve optimization and training stability (He et al., 2015; Veit et al., 2016), without explicit grounding in thalamocortical principles. Conversely, neurobiological accounts emphasize pulvinar-dependent routing, gain control, and interareal coordination, but the computational consequences of these mechanisms remain difficult to isolate experimentally (Zhou et al., 2016). A productive approach is therefore to formalize a minimal pulvinar-inspired pathway in a controlled deep learning framework and evaluate not only task performance but also mechanistic signatures such as representational stability and gain regulation (Cortes and Vreeswijk, 2012). This raises a fundamental question: does the pulvinar provide a biological blueprint for effective skip connections, and can integrating pulvinar-like pathways into artificial networks yield measurable computational advantages (Cortes et al., 2024, 2026; Sherman and Guillery, 2011; Saalmann and Kastner, 2011)?

Here we study a hierarchical vision model that includes a pulvinar-inspired pathway linking early and later stages of processing. This pathway allows information from early visual representations to influence later stages in a controlled manner, mimicking the modulatory role of the pulvinar in the brain. We evaluate this model in two complementary settings. First, in an image categorization task (CIFAR-10) (Krizhevsky, 2009), we compare a standard cortical network to a version that includes the pulvinar-like pathway. In this setting, we assess not only classification accuracy, but also how stable and well-scaled the internal representations remain when image contrast is varied. These measures allow us to determine whether pulvinar-like modulation primarily improves robustness and gain regulation, rather than simply boosting task performance. Second, we test the same models in a contrast-detection task designed to mimic near-threshold perceptual conditions (van Vugt et al., 2018), in which a faint target must be detected in a noisy background. By systematically varying target contrast, size, and background noise, this task probes how pulvinar-like modulation influences sensitivity when visual evidence is weak and uncertain. Together, these experiments provide a principled way to dissociate effects on representational stability and gain control from effects on perceptual sensitivity under noise.

2. Materials and methods

Computational model

We modeled visual detection performance with a deep convolutional neural network (CNN) that approximates a cortical feedforward hierarchy, and an extended variant including a pulvino–cortical pathway. Let x ∈ ℜ H × W × 3 represents a real-valued RGB image, with spatial dimensions H × W, and three-color channels. For CNN input, grayscale stimuli were replicated across three channels to match the RGB input format. The baseline “cortical” network is a standard convolutional network with L layers. Denoting by h (0) = x the input and by h (l) the activity at layer l, the feedforward dynamics are:

where * denotes convolution, σ l is a pointwise non-linearity (ReLU), and θ l = { W l, b l } are the trainable parameters. Here, L =3. The final read-out is computed from the last layer activity h L as:

Where, y ^ ∈ [ 0, 1 ] K is the predicted probability over classes (e.g., target present vs. absent).

Training is performed by minimizing the cross-entropy loss with L 2 regularization,

where Θ collects all trainable parameters in the network, y ik is the one-hot encoded label for sample i, and λ is the weight-decay coefficient.

Pulvino–cortical extension

To model the influence of the pulvinar on cortical processing, we introduced a parallel pulvino–cortical pathway that receives a copy of cortical activity from a mid-level “V1-like” layer and feeds back to a higher “decision-related” cortical layer. Concretely, we select two cortical layers m and n (1 ≤ m < n ≤ L). The pulvinar module receives as input a pooled representation of the cortical activity at layer m,

Where, GAP (·) denotes global average pooling over spatial dimensions. The pulvinar state p is then computed as

with ϕ p (·) a non-linear activation (ReLU) and parameters{ W pc, b p }. This state is projected back to cortex through a pulvino–cortical projection,

where ϕ r (·) is again a non-linearity and { W cp, b r } parameterize the projection, where W pc implements a cortico-pulvinar transformation, capturing the convergence of early cortical activity onto the pulvinar, and W cp models the reciprocal pulvino-cortical projection that modulates downstream cortical processing.

The resulting pulvino–cortical signal r has the same dimensionality as the target cortical layer activity h (n) (up to reshaping), so that the combined activity at layer nnn is given by a convex combination

Where, α ∈ [0, 1] is a gating parameter that controls the relative contribution of the pulvino–cortical input. For α = 0, the model reduces to the purely cortical baseline. For α > 0, the pulvinar pathway can amplify or reshape cortical representations at layer n.

In some simulations we additionally allowed for a learned gain on the pulvino–cortical feedback. In that case, the feedback is modulated by a gain vector g obtained from the pulvinar state,

where σ g is a sigmoid non-linearity and ⊙ denotes elementwise multiplication. This formulation interprets the pulvinar as dynamically modulating the precision of cortical signals by scaling the effective contribution of the feedback term.

All other layers l ≠ n are updated as in the cortical-only model. The pulvino–cortical model is trained end-to-end with the same loss function L (Θ); the additional parameters { W pc, b p, W cp, b r, W g, b g } are simply included in Θ. In the experiments reported here we compared a cortical baseline (α = 0)with pulvino–cortical models using different values of α and gain configurations.

Squeeze-and-excitation control model (implementation baseline)

To test whether the observed effects are specific to the proposed pulvino-cortical mechanism or arise from generic channel-wise attention, we implemented a control model based on squeeze-and-excitation (SE) mechanisms.

In this model, modulation is applied locally within a single layer h as:

and

where GAP is the global average pooling, δ is the ReLU non-linearity, σ is a sigmoid function producing channel-wise gains. SE is applied to the intermediate feature maps (block 2) and modulates activity multiplicatively before further processing.

Projection-only skip control (non-modulatory control)

To isolate the computational contribution of long-range routing independently of modulation, we implemeted a control architecture consisting of a direct early-to-late projection without gating or adaptative fusion. This model preserves the same structural skip pathway used in the pulvino-cortical model but removes all modulatory components, including the gain gate g and the learned fusion parameter α.

So that, a projection is computed from an early cortical layer h (m) to a deeper layer h (n), using the same projection operator defined for the pulvino-cortical pathway:

where Π(·) is implemented as a lightweight transformation (convulation followed by spatial resampling) to match the dimensionality of h (n), as described in Section 2.1.2.

In contrast to the pulvino-cortical model, the projected signal is combined with cortical activity throgh a fixed additive interaction:

where β is a constant scaling factor controlling the strength of the skip pathway. Importantly, β is not learned and remains fixed throughout training.

This formulation removes any stimulus-dependent modulation or adaptative weighting, ensuring that the skip pathway acts purely as feedforward projection. All other layers are uptdated as in the cortical baseline model. This control allows us to dissociate the effects of: i) long-range information routing, and ii) dynamic gain modulation introduced by the pulvino-coritcal mechanism.

By comparing this projection-only model with both the cortical baseline and the pulvino-cortical model, we can determine whether the observed effects arise from the presence of a skip pathway itself or from its modulatory properties.

Architectural implementation (summary of Equations 5–10)

To implement the pulvino–cortical computations defined above, we added a long-range skip connection propagating activity from early to late stages of the CNN. Feature maps from the first convolutional block (64 channels at 16 × 16 resolution) were projected to match the input dimensionality of the third block (128 channels at 8 × 8 resolution) using a lightweight PulvinarProjector composed of a 1 × 1 convolution followed by bilinear interpolation.

To capture the modulatory nature of pulvinar feedback, the projected signal passed through a PulvinarGate inspired by squeeze-and-excitation mechanisms, which computes a gating vector g that dynamically controls feedback strength.The gating vector g was computed using a squeeze-and-excitation–like mechanism: spatial global average pooling was applied to the projected feature maps to obtain a channel-wise descriptor, which was then passed through a two-layer fully connected network with a ReLU non-linearity, followed by a sigmoid activation to produce channel-wise gain values between 0 and 1. The gated pulvinar signal was combined with cortical activity additively, as formalized in Equations (9, 10). When gating was disabled, the gain was fixed to unity (g = 1), yielding a non-modulatory skip connection. Apart from this long-range pathway, all other architectural components were identical to those of the cortical baseline model (Figure 2).

Task-specific model variants. While Equations (5–10) define the full pulvino-cortical architecture; the effective instantiation of this mechanism differs across experimental paradigms due to task-dependent training constraints.

1) CIFAR-10 categorization (Experiment 1): the full model was used, including the pulvino–cortical projection, the gating mechanism (g), the fusion parameter (α), and the additional regularization terms λG, λα, and the target gain value G *, which constrained the statistics of the gating and fusion variables during training. These constraints were introduced to stabilize optimization and promote interpretable gain dynamics in a complex categorization setting.

2) Near-threshold contrast detection (Experiment 2): the same architectural core was retained, including gating mechanism (g), and fusion parameter (α). However, the regularization terms λG, λα, and the target gain G * were removed to avoid imposing task-specific constraints on the gating dynamics, allowing the intrinsic behavior of the transthalamic pathway to emerge under controlled sensory uncertainty.

Thus, differences between Experiments 1 and 2 reflect differences in training regime rather than changes in architectural structure.

This distinction between architectural mechanism and training constraints is central to our approach. The pulvinar-inspired pathway defines a fixed computational structure (long-range routing with gain modulation), while the training regime determines how this mechanism is expressed in practice.

In this framework, the regularization terms used in Experiment 1 can be interpreted as shaping the operating regime of the network, rather than defining the mechanism itself. This separation allows us to distinguish between effects arising from representational constraints and those arising from the intrinsic properties of the architecture.

Accordingly, Experiment 1 includes two complementary analyses: a standard evaluation under the full training regime, and a control analysis in which models are compared within matched representational regimes.

This perspective motivates the control analyses introduced below, in which models are compared within matched representational regimes to isolate the contribution of the pulvino–cortical architecture independently of training-induced constraints.

Training procedure

Both the cortical baseline and the pulvinar-augmented models were trained from scratch using identical optimization settings to ensure comparability. Training used the AdamW optimizer (learning rate ≈ 3 × 10 −4, weight decay ≈ 1 × 10 −4) with mini-batches of 128 images. Networks were trained for 20–50 epochs depending on configuration. A fixed random seed was used for all experiments. During training, loss and accuracy were recorded for both training and test sets, and TensorBoard was used for monitoring when available. All models were trained on GPU hardware when accessible; otherwise, computation defaulted to CPU. All simulations, training pipelines, and analyses were implemented in Python using PyTorch.

Loss functions and training regimes

Across experiments, different training regimes were used to probe the interaction between architectural mechanisms and representational constraints.

The baseline cortical model was trained using standard cross-entropy loss:

In control analyses, we additionally introduced a contrast-based regularization term based on the S and HL metrics:

For the pulvino–cortical model in Experiment 1, additional regularization terms were included to constrain the statistics of the gating and fusion mechanisms:

Where, Reg G enforces a target gain level and Reg α penalizes deviations from high fusion weighting.

In contrast, in Experiment 2 and in the architectural control analysis described above, these additional regularization terms (λG, λα, G *) were omitted to isolate the intrinsic contribution of the pulvino–cortical architecture.

Experiment 1: Image categorization (CIFAR-10)

All categorization experiments were conducted using the CIFAR-10 dataset (60,000 images; 10 classes). Images were normalized using standard channel statistics. Training images were augmented with horizontal flips and cropping; test images were normalized.

Both cortical baseline and pulvino–cortical models were trained from scratch using AdamW (learning rate ≈ 3 × 10 −4, weight decay ≈ 1 × 10 −4, batch size 128) for 20-30 epochs. Accuracy, loss, contrast sensitivity, and invariance metrics were computed on the test set.

Hyperparameters were optimized using classification accuracy on the validation set as the objective function. Importantly, the gain-linearity (HL) and directional invariance (S) metrics were not part of the optimization objective. Instead, they were computed post hoc on the trained networks corresponding to the accuracy-optimal parameter configuration.

Contrast-perturbation set

During training of the pulvinar-augmented network, we introduced a contrast-based regularization computed from internal feature vectors. Given a mini-batch x and a set of contrast scaling factors { σ 1,…,σ K } in our experiments {0.2,0.6,1.0}, we formed contrast-scaled inputs

Let f θ (·) denote the feature-extracting network parameterized by learnable weights θ. For each image i and contrast scaling σ k, we define

Where u i (k) ∈ ℜ 256 denotes the pooled feature vector.

S: direction invariance across contrast

We measured direction invariance as the mean cosine similarity between normalized feature vectors across all contrast pairs:

Where, P = {(a, b) | 1 ≤ a < b ≤ K } indexes all contrast pairs. Larger S indicates that representations preserve their direction in feature space under contrast changes.

HL: signed gain linearity index

To quantify how feature magnitude changes with contrast, we computed the average feature norm per contrast level,

then estimated a finite-difference slope between adjacent contrast levels and took its log:

with ε a small constant to avoid log(0). Larger HL indicates a stronger (and more consistently positive) change in feature amplitude with contrast. Negative HL values indicate weak or sublinear scaling of feature magnitude with contrast, whereas positive HL values reflect robust gain modulation.

Architectural control analysis within matched representational regimes

To dissociate the contribution of architectural mechanisms from training constraints, we performed an additional control analysis within the CIFAR-10 categorization task.

In this analysis, we compared multiple architectures under strictly matched optimization settings, including: (i) the cortical baseline model, (ii) a squeeze-and-excitation (SE) control model, (iii) a projection-only skip model, and (iv) the pulvino–cortical model. All models were trained using identical hyperparameters (learning rate = 3 × 10 −4, weight decay = 1 × 10 −4, label smoothing = 0.1, batch size = 128, and 100 training epochs), as well as identical data augmentation procedures. This procedure ensured that any observed differences arise from architectural mechanisms rather than optimization or regularization confounds.

To further isolate these effects, we evaluated performance within matched representational regimes defined by directional invariance (S) and gain linearity (HL). Specifically, we identified overlapping regions in the (S, HL) space across models and restricted comparisons to runs within this shared region [S ε (0.97, 0.99), HL ε (4.5, 5.5)].

Within this regime, accuracy differences reflect intrinsic architectural properties rather than differences in representational geometry.

Experiment 2: Near-threshold contrast detection paradigm

In this experiment, the pulvino-cortical model was evaluated without the λG, λα, and G regularization terms described in Table 1, allowing us to isolate the effect of the transthalamic architecture itself on near-threshold visual detection (while keeping the α fusion and gain gate parameters learned end-to-end). In contrast to Experiment 1, where these regularization terms were introduced to stabilize training and shape the statistics of the gating and fusion variables during a complex categorization task, the present experiment aims to directly assess how the architecture influences decision variables under controlled sensory uncertainty. Removing these constraints ensures that any observed effects on sensitivity (d′) or decision criterion arise from the intrinsic properties of the transthalamic pathway, rather than from task-specific training objectives.

Stimulus generation

Synthetic grayscale stimuli consisted of a noisy background (mean luminance 0.5) and, on target-present trials, a faint circular target (van Vugt et al., 2018). Background noise was generated and filtered with a 1/ f spectrum. Target circles of radius R were placed at random spatial locations and incremented by contrast c relative to background.

Contrast values ranged from 0.005 to 4%: 0.005%, 0.01%, 0.025%, 0.05%, 0.08%, 0.11%, 0.15%, 0.20%, 0.25%, 0.30%, 0.35%, 0.40%, 0.45%, 0.65%, 1.0%, 2.0%, 4.0%.

For each contrast level and parameter configuration, N = 1,000 stimuli were generated, with balanced target-present and target-absent trials.

Experimental design

Background noise amplitude and target radius were systematically varied to probe different signal-to-noise regimes. For each configuration, the same cortical and pulvino–cortical models were trained on identical near-threshold stimuli to mimic a naïve observer and to ensure that behavioral and internal differences reflect architectural effects rather than training history. This design allows changes in false alarm rate and decision criterion to be interpreted as emergent properties of the transthalamic architecture, rather than as consequences of differential learning or stimulus familiarity.

Each network's binary output (target present / absent) was compared to ground truth to construct full confusion matrices, yielding the four canonical outcome categories: Hits (H), Misses / False Negatives (FN), False Alarms (FA), and True Negatives (TN). False positives (FP) were additionally analyzed as absolute counts to provide a more precise characterization of outcome redistribution beyond normalized false alarm rates.

Each network's binary output (target present/absent) was compared to ground truth to construct full confusion matrices, yielding Hits (H), Misses/False Negatives (FN), False Positives (FP), and True Negatives (TN). We report both FP counts and the corresponding false alarm rate (FA=FP/(FP+TN)), where FA provides a normalized SDT measure of decision bias and FP provides a count-level description of outcome redistribution across conditions. From these quantities, we computed: (i) accuracy; (ii) sensitivity (d′); (iii) decision criterion (c); and (iv) false alarm rate (FA). Psychometric detection curves were obtained by plotting hit rate (HR=H/(H+FN)) as a function of contrast for each (R, BG) configuration.

Internal network responses and layer-wise analysis

To relate behavioral outcomes to internal network dynamics, we analyzed stimulus-evoked activity across corresponding layers of the two architectures. Three layers were selected as functional analogs of a hierarchical visual-decision pathway: an early layer (V1), an intermediate layer (V4), and a late decision-related layer (PFC). Decision-related modulation was quantified as:

Positive Δactivation indicates stronger activity on Hits than Misses, whereas negative values indicate inverted or suppressive decision-related responses.

Global analysis across stimulus space

All behavioral and internal measures were evaluated across the full grid of (R, BG). While overall accuracy was reported for completeness, primary analyses focused on FA and d′, which dissociate criterion shifts from genuine sensitivity changes within the SDT framework. Complete confusion-matrix statistics (H, FN, FP, TN, accuracy, d′, and criterion c) for all stimulus conditions are provided in the Supplementary material.

Summary of evaluated models and metrics

In Experiment 1, two model variants were compared: (i) a cortical baseline, and (ii) a jointly optimized cortical–pulvinar model. Performance was evaluated using classification accuracy, contrast sensitivity, and representational invariance. Table 1 summarizes the global and pulvinar-specific hyperparameters used during training, specifying the model components they affect, their location within the architecture, and their functional role. Global hyperparameters (e.g., learning rate, weight decay, and label smoothing) applied to all trainable weights, whereas pulvinar-specific parameters (λG, λα, and G) selectively regulated the strength, stability, and target level of modulatory feedback in the pulvinar skip-connection pathway. Hyperparameters in Experiment 1 were optimized using the Powell method (derivative-free optimization), implemented in Python.

In Experiment 2, the cortical baseline and the jointly optimized cortical–pulvinar model were evaluated in a near-threshold contrast detection paradigm. Background noise amplitude (BG) and target radius (R) were systematically varied to probe different signal-to-noise regimes. For each (BG, R) combination, the full range of contrast levels was generated, producing a dense set of near-threshold detection conditions. Both models were trained and evaluated under identical optimization settings, allowing a direct comparison of their sensitivity to weak visual signals.

Statistical analysis

Statistical analyses were performed using both parametric and non-parametric tests, selected according to data structure and sample size.

For Experiment 1A, differences between cortical-only and pulvino–cortical models were assessed using Welch's two-sample t -test, which does not assume equal variances. Effect sizes were quantified using Cohen's d to characterize the magnitude of model differences independently of sample size.

For Experiment 1B, which involved comparisons across multiple architectural conditions, we used the Kruskal–Wallis test to assess overall group differences without assuming normality or homogeneity of variance. When significant effects were detected, pairwise comparisons were performed using Dunn's post hoc test with multiple-comparison correction.

For analyses involving grid-based performance measures (e.g., performance across combinations of stimulus size and background noise), comparisons between models were performed using the Wilcoxon signed-rank test. This non-parametric paired test was chosen because the number of grid points was limited, and normality assumptions could not be reliably satisfied.

To quantify condition-dependent enrichments, we additionally performed an abundance-style analysis in which “high” cases were defined using a one-sided z-threshold computed across the pooled stimulus grid (z > 1). This thresholding procedure was used to summarize the proportion of high-value cells by quadrant and was not treated as an inferential hypothesis test.

For grid-level comparisons across matched stimulus conditions (BG, R), we computed paired differences Δ=pulvinar–cortex (Pulvinar-cortical and cortical-only models) and tested whether the median shift differed from zero using the Wilcoxon signed-rank test. For metrics indexing decision bias (false alarms, false positives, and false negatives), we used one-sided Wilcoxon signed-rank tests reflecting the a priori hypothesis that pulvinar-like connectivity would increase liberal responding under near-threshold uncertainty. All other comparisons were assessed using two-sided tests.

3. Results

Experiment 1A: Image categorization (CIFAR-10). Model accuracy, invariance of tuning, contrast sensitivity and gain control, and hyperparameter optimization

We compared a cortical baseline with a jointly optimized cortical–pulvinar model using independent hyperparameter searches (Figure 3; Tables 2, 3). In this experiment, the cortical baseline was trained using cross-entropy loss (Equation 15), whereas the pulvino–cortical model was trained using the full loss including S, HL, and gating/fusion regularization terms (Equation 17). Hyperparameters were optimized using classification accuracy on the validation set as the objective function. HL and S were subsequently evaluated on the model instance that achieved the highest validation accuracy, ensuring that these metrics reflect emergent properties of the architecture rather than optimization targets. The cortical baseline provided a reference level of categorization performance, whereas joint optimization of cortical and pulvinar parameters produced a small but reliable improvement in accuracy (Figure 3A, Table 4). Statistical analyses confirmed that this difference was significant but moderate in effect size (Cohen's d < 1), indicating that pulvinar-like modulation does not primarily act as a strong accuracy enhancer.

In contrast, the impact of pulvinar-inspired connectivity was much larger for gain-related and representational measures. As summarized in Table 2, the cortical–pulvinar model exhibited pronounced changes in contrast gain linearity (HL) and representational invariance (S), both associated with very large effect sizes (Cohen's d >> 1) (Table 4). This dissociation indicates that the principal computational contribution of the pulvinar pathway lies in restructuring how sensory signals are scaled and stabilized within the network, rather than in uniformly improving classification performance.

Invariance of tuning. Representational invariance was markedly enhanced in the cortical-pulvinar model relative to the cortical baseline (Figure 3B; Tables 3, 4), indicating more stable internal feature representations under contrast perturbations. This effect was robust and greatly exceeded the magnitude of the accuracy difference, supporting a role for pulvinar-like modulation in stabilizing cortical representations rather than directly optimizing categorization accuracy.

Contrast sensitivity and gain control. The cortical-pulvinar model also showed substantially improved contrast-dependent response scaling compared with the cortical baseline (Figure 3C; Tables 3, 4). The enhancement in gain linearity was highly reliable and associated with a very large effect size, consistent with a gain-control function of the pulvinar-inspired pathway that regulates how stimulus contrast is reflected in internal representations.

Together, these results reveal a clear dissociation between accuracy and gain-related effects. While pulvinar-like modulation yields only modest improvements in classification accuracy, it produces strong and systematic changes in contrast gain and representational stability. This pattern indicates that the primary computational impact of the pulvinar pathway lies in regulating gain and stabilizing internal representations, rather than acting as a direct accuracy booster.

Experiment 1B: Controlled architectural comparison and representational regime

To determine whether the computational effects attributed to the pulvinar pathway arise from its specific architecture rather than optimization constraints or generic mechanisms, we compared four model configurations: a cortical-only baseline, a pulvinar-cortical model, a squeeze-and-excitation (SE) model, and a simple skip connection without modulation. The SE model was included to test whether the observed effects could be explained by a standard attention-like mechanism, while the simple skip connection tested whether they could arise from the addition of a parallel pathway alone. All models were trained using identical optimization parameters (learning rate, weight decay, and label smoothing), ensuring a fair comparison of architectural contributions. Unlike Experiment 1A, pulvinar-specific regularization terms (Equation 17) were removed. Models were trained either with standard cross-entropy loss (Equation 15) or with additional S and HL regularization (Equation 16), allowing us to compare architectures both in unconstrained and regime-controlled settings.

Across configurations, the regularization terms consistently shape the representational metrics S and HL (Figure 4A). Models trained with the extended loss converge to similar ranges of S and HL, indicating that these quantities are primarily controlled by the optimization constraints rather than the architecture itself. However, despite this convergence in representational space, only the pulvino–cortical model translates this regime into a systematic improvement in accuracy. The baseline, simple skip, and SE models reach comparable S–HL values but do not achieve the same performance. This dissociation indicates that regularization alone is not sufficient: the advantage arises from how the pulvinar architecture operates within this controlled regime.

To directly test whether performance differences could be explained by the representational regime, we first restricted the analysis to runs falling within specific S and HL ranges, thereby defining a controlled region of the S–HL space (Figure 4B). This ensures that all models are evaluated under comparable representational conditions. Within this restricted subset, the pulvinar model with regularization consistently outperforms the baseline, simple skip, and SE models that also included regularizations.

We next examined the S–HL space defined by this restriction to verify whether models operate within a shared regime. As shown in Figure 4C, this procedure defines regions of overlap between models. In particular, the cortical-alone and pulvinar models, as well as the simple skip and pulvinar models, exhibit clear overlap within the restricted S–HL space, confirming that these comparisons are performed under matched conditions. In contrast, the pulvinar and SE models occupy largely distinct regions, indicating that they operate under different effective regimes.

This dissociation shows that performance differences cannot be explained by representational geometry alone but instead reflect how each architecture operates within (or across) these regimes. Together, these results indicate that the pulvinar-inspired pathway implements a specific computational mechanism that cannot be reduced to optimization, generic attention, or the addition of a parallel pathway, but instead reflects a distinct form of long-range routing and gain modulation.

Contrast detection near-threshold paradigm

Although CIFAR-10 categorization revealed only modest accuracy differences between cortical and cortical–pulvinar models, pulvinar-like modulation produced strong effects on gain control and representational stability (Figure 3, Table 4). To probe the functional consequences of these effects under sensory uncertainty, we evaluated the same pulvino-cortical architecture in a near-threshold contrast-detection paradigm. Importantly, this experiment follows the controlled regime introduced in Experiment 1B: models were trained under identical optimization conditions and without pulvinar-specific regularization terms (λG, λα, G *), isolating the intrinsic contribution of the transthalamic pathway (Table 1). This ensures that any observed effects cannot be attributed to training constraints but reflect architectural properties. The task required detecting a faint circular target embedded in a noisy background, while target contrast, target size, and background noise amplitude were systematically varied. This paradigm enabled us to assess how pulvinar-inspired modulation influences sensitivity to weak visual signals and the balance between signal and noise—effects that cannot be inferred from standard categorization accuracy alone.

Response to contrast and perceptual detection

Perceptual detection performance was evaluated in two network architectures: a cortical model consisting of a convolutional neural network (CNN) alone, and a pulvinar-cortical model incorporating skip connections to emulate thalamocortical interactions. Model responses were analyzed under four representative stimulus conditions defined by stimulus size (radius, R) and background noise level (BG): low noise (BG = 0.25) with small (R = 3) or large (R = 13) stimuli, and high noise (BG = 2.5) with small or large stimuli. For each condition, psychometric detection curves, distributions of sensitivity (d ′), and full confusion matrices are shown to preserve the structure of perceptual decision outcomes.

Under low background noise (BG = 0.25), both small and large stimuli yielded near-chance performance (Figures 5A, 5B). Psychometric curves were shallow and largely flat across contrast levels for both architectures, with overall accuracies close to 55-59%. Although the pulvinar-cortical model showed a slight upward shift in the psychometric curves relative to the cortical model, d ′ values were highly variable and largely overlapping between networks. Confusion matrices revealed small redistributions of outcomes, typically a mild increase in hits accompanied by a corresponding increase in false alarms, without a consistent gain in discriminability.

In contrast, under high background noise (BG = 2.5), detection performance improved markedly for both architectures (Figures 5C, D). For the small-radius stimulus (R = 3), psychometric curves were high and nearly saturated, and both models achieved similar accuracies (~87-88%). Sensitivity (d ′) distributions largely overlapped, and confusion matrices showed balanced increases in true positives and true negatives, indicating robust detection without a clear architectural advantage.

A distinct pattern emerged in the high-noise, large-radius condition (BG = 2.5, R = 13). Here, the pulvinar–cortical model exhibited a significant increase in sensitivity (d ′) relative to the cortical-only model (Figure 5D, middle panel), despite only a modest difference in overall accuracy (87.4% vs. 86.0%). Importantly, confusion matrices revealed that this increase in d ′ was accompanied by a systematic redistribution of decision outcomes: the pulvinar-cortical network showed both increased hit rates and reduced false alarms, together with fewer false negatives. This pattern indicates an improvement in discriminability that cannot be attributed solely to a liberal shift in decision criterion.

Taken together, these results show that pulvinar-like interactions do not uniformly enhance perceptual sensitivity across stimulus regimes. In most conditions, the pulvinar–cortical model primarily induces noise-dependent changes in the distribution of detection outcomes, consistent with a modulation of decision criterion. However, under conditions of high sensory uncertainty combined with strong spatial integration demands (large R, high BG), pulvinar-like connectivity can also support a genuine increase in perceptual sensitivity, as reflected by elevated d ′. This suggests that the pulvinar contribution is conditional and emerges most clearly when global stimulus integration is required to stabilize perceptual decisions under noise.

Response of networks as a function of layers

We examined stimulus-evoked activity across network layers under the same stimulus size (R) and background noise (BG) conditions used for behavioral analyses, to identify the internal activity patterns associated with detection outcomes. Activations were compared between the cortical-only and pulvinar–cortical models across three corresponding layers (V1, V4, and PFC), used here as analogs of a hierarchical processing stream.

Layer-specific activity was analyzed as a function of behavioral outcome by computing the difference in unit activation between Hit and Miss trials (Δactivation = Hit – Miss). Positive Δactivation indicates stronger activity on Hit than Miss trials, whereas negative Δactivation indicates the opposite.

Low background noise (BG = 0.25). For both stimulus sizes (R = 3 and R = 13), V1 and V4 showed positive Hit-Miss separation in both models, with Δactivation being small in V1 and larger in V4 (Figures 6A, B). The major divergence between the two architectures emerged at the PFC level. In the cortical-only model, PFC activations were strongly negative, and importantly, more negative for Hits than for Misses, producing a large negative Δactivation (Figures 6A, B, cortex PFC). In contrast, in the pulvinar-cortical model, PFC activity was positive for Hits and near-baseline for Misses, yielding a large positive Δactivation (Figures 6A, B, pulvinar PFC). Thus, under low-noise conditions, the pulvinar-like skip connections induce a qualitative inversion of PFC decision-related activity, switching from a strong negative Hit-associated signal in the cortical model to a strong positive Hit-associated signal in the pulvinar-cortical model.

High background noise (BG = 2.5). Under high noise, V1 and V4 Hit and Miss activations were nearly overlapping in both architectures, resulting in Δactivation values close to zero in these layers (Figures 6C, D). Again, the main model-dependent effect was observed in PFC. In the cortical-only model, PFC activity remained negative for both Hits and Misses, and Δactivation was small (near zero, slightly positive for R = 3 and slightly negative for R = 13; Figures 6C, D, cortex PFC). In contrast, the pulvinar–cortical model showed positive PFC activation for Hits and a much lower (near-baseline) activation for Misses, producing a substantially larger positive Δactivation in both stimulus sizes (Figures 6C, D, pulvinar PFC).

In summary, across conditions, V1 and V4 showed modest or minimal Hit–Miss separation and were similar across architectures, whereas PFC exhibited the strongest divergence. The pulvinar-cortical model produced positive, Hit-selective PFC activity, while the cortical-only model showed predominantly negative or weakly differentiated responses. Together, these results suggest that pulvinar-like input primarily reshapes late-stage decision-related representations, biasing PFC toward stable, decision-consistent activity states and modulating the decision criterion rather than sensory sensitivity.

Global response of networks to contrast and perceptual detection

To characterize how the observed behavioral differences depend on stimulus conditions, we examined network responses across the full space of stimulus size (R) and background noise (BG). For each parameter combination, we computed matrices summarizing confusion-matrix variables as well as signal detection measures. Although overall accuracy was largely comparable between cortical-only and pulvinar-cortical networks across conditions, accuracy alone is insensitive to redistributions of decision outcomes that reflect changes in decision criterion. We therefore focused our analysis on false alarm rate (FA) and sensitivity (d′), which respectively index decision bias and signal–noise separability within the signal detection framework. To streamline the presentation and highlight the most informative effects, we report here only the matrices for FA and d′. Complete results for all confusion-matrix components, including accuracy, true positives, false negatives, and true negatives, are provided in the Supplementary material.

To facilitate interpretation, stimulus conditions were grouped into four representative quadrants defined by BG and R: Q1, low background noise with small stimuli; Q2, high background noise with small stimuli; Q3, low background noise with large stimuli; and Q4, high background noise with large stimuli. Throughout this section, Δ denotes the paired difference between architectures (pulvinar–cortical minus cortical-only), computed for each stimulus condition before statistical testing.

Across stimulus conditions, pulvinar-augmented networks did not exhibit a uniform improvement in perceptual sensitivity or overall accuracy, as indexed by d′ (Figure 7A). Instead, their most prominent effect was a systematic increase in false alarm rate under low-signal conditions (Figure 7B). This effect was most pronounced in Q1, corresponding to small stimuli under low background noise, a near-threshold regime in which object detection is intrinsically difficult, and sensory evidence is weak.

To quantitatively compare networks across conditions, we identified stimulus configurations in which FA values exceeded the global mean by more than one standard deviation (z-score > 1), computed across the full stimulus grid. Under this criterion, the pulvinar-cortical model exhibited a larger proportion of high-FA cases than the cortical-only network at the global level (cortical-only: 16.7%; pulvinar-cortical: 21.1%; Figure 7C). This difference was substantially amplified in Q1, where high-FA cases were markedly more frequent in the pulvinar-cortical network (cortical-only: 45.8%; pulvinar-cortical: 62.5%; Figure 7C).

Consistent with this pattern, pooling responses across all stimulus conditions revealed a modest but significant redistribution of decision outcomes in the pulvinar–cortical model. This global effect was characterized by a reduction in hit rate and perceptual sensitivity together with an increase in false negatives (TP: Δ = −59.6, p < 0.001; H/d′: Δ = −0.024, p < 0.001; FN: Δ = + 59.6, p < 0.001; Figure 7D, Supplementary Table 1), while false alarm and false positive rates did not increase at the global level. Thus, when averaged across stimulus conditions, pulvinar-like connectivity shifts the overall balance of responses without inducing indiscriminate or stimulus-independent detections.

Crucially, this global averaging masked strong condition-dependent effects. In Q1, the pulvinar–cortical network exhibited a selective increase in false alarms and false positives (FA: Δ = + 0.094, p = 0.026; FP: Δ = + 235, p = 0.026; Figure 7C), without a corresponding increase in hit rate or sensitivity. This pattern is consistent with a localized liberal shift in decision criterion under weak sensory evidence, rather than an improvement in perceptual discriminability. Importantly, this increase in false alarms was accompanied by an increase in false negatives (cortical-only: 8.9% vs. pulvinar–cortical: 12.2%; Δ = +78.7, p = 0.05; Figure 7D, Supplementary Table 1), while true positive counts did not increase disproportionately and were in some conditions even higher in the cortical-only model.

By contrast, in Q3 (large stimuli under low background noise), the dominant effect was a marked increase in false negatives together with reduced hit rate and sensitivity (FN: Δ = +169, p < 0.001; Supplementary Table 1), indicating impaired discriminability when large-scale spatial integration was required. Differences between architectures were minimal under higher background noise regimes (Q2 and Q4), with Q4 showing an increase in true negatives (Δ = +73, p < 0.001; Supplementary Table 1), consistent with more conservative responding under high noise.

Taken together, these results indicate that pulvinar-like connectivity does not induce stimulus-independent false percepts. Rather, it modulates the balance between signal and noise by shifting the decision criterion in a stimulus-dependent manner, producing localized increases in false alarms under near-threshold conditions while reshaping the hit–miss balance in regimes that place high demands on perceptual integration.

Global response of networks as a function of layers

We examined how activity propagates across network layers by analyzing layer-specific responses to identical visual inputs while varying target R and BG. As in Section 3.2.2, for each layer, stimulus-evoked responses were quantified using Δactivation in early (V1), intermediate (V4), and late (PFC) layers for both cortical-only and cortical–pulvinar architectures.

Across conditions, Δactivation in V1 and V4 was similar between architectures, with only modest modulation by stimulus size or noise and no consistent sign differences (Supplementary Figure 1). In contrast, strong differences emerged in PFC (Figure 8). In the cortical-only network, PFC activity was predominantly negative across conditions, yielding weak or inverted Hit–Miss separation that was largely invariant to R and BG. By comparison, the cortical–pulvinar network consistently produced positive PFC responses, resulting in positive Δactivation values that were strongest for larger targets and low background noise, and gradually decreased with increasing stimulus uncertainty.

Together, these results indicate that pulvinar-like input biases PFC activity toward decision-consistent states, consistent with a modulation of decision criteria rather than early sensory encoding.

4. Discussion

The present study examined the computational consequences of embedding a minimal, biologically inspired pulvinar-like pathway into a hierarchical convolutional vision model. We introduced a long-range transthalamic skip connection that projects early visual feature maps to later, decision-related layers through a lightweight projection module whose influence is dynamically regulated by a gain-controlled gating mechanism. This design dissociates long-range information routing from local feedforward processing, capturing a core functional motif attributed to the pulvinar in thalamocortical circuits: modulation of cortical interactions without direct encoding of sensory content (Sherman and Guillery, 2011; Saalmann et al., 2012; Cortes et al., 2021).

Using this architecture, we evaluated two complementary computational regimes. In a standard object categorization task (CIFAR-10), we assessed how pulvinar-like modulation reshapes internal representations under contrast perturbations beyond its effect on classification accuracy. In a near-threshold contrast-detection paradigm under controlled noise, we examined how the same transthalamic pathway influences perceptual decisions when sensory evidence is weak and uncertain. Across both tasks, a consistent pattern emerged: pulvinar-inspired connectivity exerted its strongest effects on gain regulation and decision criterion rather than on raw sensitivity or accuracy. These effects arose downstream of sensory encoding, at the level of evidence weighting and decision formation (Summerfield and Tsetsos, 2015; Heekeren et al., 2008).

Although the pulvinar-augmented network produced only modest improvements in categorization performance, it induced large and systematic changes in contrast-dependent response scaling and representational stability. In the near-threshold detection task, pulvinar-like modulation primarily redistributed decision outcomes in a stimulus-dependent manner, consistent with shifts in decision criterion, while genuine increases in sensitivity (d′) emerged only under restricted conditions combining high uncertainty and strong spatial integration demands. Together, these findings support a view of the pulvinar as a regulator of how sensory evidence is weighted and converted into decisions, rather than as a direct enhancer of sensory encoding or perceptual sensitivity (Feldman and Friston, 2010; Heekeren et al., 2008).

While the proposed pulvinar-like pathway shares superficial similarities with attention mechanisms such as squeeze-and-excitation (Hu et al., 2018), its computational role is fundamentally distinct. Standard attention modules typically reweight feature channels within a given layer to enhance task-relevant representations (Vaswani et al., 2017). In contrast, the present architecture modulates the effective strength of a fixed, long-range communication pathway between early and late processing stages, based on a compressed summary of early activity. Rather than performing feature selection, this mechanism regulates gain, stability, and the influence of early sensory representations on downstream decision processes. This distinction highlights the role of the pulvinar-inspired pathway as a biologically grounded routing-and-gain control mechanism, rather than a conventional attention module.

In the following sections, we first relate the network architecture to known anatomical and functional properties of cortico–pulvinar circuits and then examine the task-specific computational effects that emerge from this design.

Anatomical and functional considerations in network architecture

The pulvinar-inspired architecture incorporates a long-range skip connection in which higher cortical layers provide a dynamic gating signal that modulates pulvinar feedback to cortex. Although uncommon in standard artificial networks, this bidirectional and asymmetric interaction is well grounded in thalamocortical anatomy (de Souza et al., 2021; Abbas Farishta and Casanova, 2020; Cortes et al., 2021; Miller-Hansen and Sherman, 2022). Cortico–pulvinar projections vary systematically along the cortical hierarchy: lower visual areas predominantly provide driver-like inputs, whereas higher-order cortical areas send more modulatory projections. This organization supports a functional distinction in which the pulvinar integrates feedforward sensory signals while receiving contextual and regulatory input from higher cortical regions.

The present model captures this principle at an abstract level by allowing higher-layer activity to regulate transthalamic feedback strength, without explicitly modeling the full diversity of driver and modulator synapses. While simplified, this framework isolates the computational consequences of hierarchical cortico–pulvinar interactions. Future extensions could incorporate multiple projection classes and layer-specific dynamics to more closely reflect known anatomical and physiological properties of the pulvinar (Saalmann et al., 2012; de Souza et al., 2021).

Effects of pulvinar-like modulation on visual discrimination

Across evaluation metrics, the jointly optimized cortical–pulvinar model exhibited a more balanced representational profile than the cortical-only baseline. While accuracy gains were modest and stimulus-size dependent, the strongest effects emerged at the level of internal representational geometry.

Pulvinar-inspired connectivity increased contrast invariance, indicating that feature-vector direction was preserved across changes in stimulus intensity (Figure 3B). This reflects stabilization of representational geometry, whereby contrast modulates activation magnitude without disrupting the structure used for downstream readout (DiCarlo et al., 2012). Complementing this effect, pulvinar-like modulation induced a qualitative shift in contrast-dependent gain, captured by the contrast–linearity metric (HL) (Figure 3C). Whereas, the cortical-only network exhibited a compressive regime that limited dynamic range, the pulvinar-augmented model restored a more linear relationship between contrast and feature norm. This controlled rescaling parallels physiological evidence that pulvinar input regulates contrast gain in visual cortex (de Souza et al., 2020).

Together, these results indicate that pulvinar-like modulation reshapes cortical representations by stabilizing geometry while regulating gain. Rather than enhancing discrimination through sharper selectivity, the pulvinar-inspired pathway preserves scalable and interpretable representations, consistent with theoretical accounts of transthalamic gain control and controlled signal propagation in hierarchical systems (Cortes and Vreeswijk, 2012, 2015).

Control analysis and regime interpretation

To ensure that these effects cannot be attributed to generic architectural features or optimization constraints, we compared the pulvinar model to control architectures including a squeeze-and-excitation (SE) module and a simple skip connection (Figure 4). Although all models were trained under identical conditions and converged to similar S and HL values, only the pulvino–cortical architecture translated this regime into improved performance.

Restricting the analysis to matched regions of the S–HL space confirmed that this advantage persists under comparable representational conditions. The baseline and simple skip models overlap with the pulvinar model within this space but fail to achieve similar accuracy, whereas the SE model occupies a distinct region.

These results indicate that the observed effects cannot be explained by attention-like mechanisms, the addition of a parallel pathway, or optimization alone, but instead reflect a specific interaction between long-range routing and gain modulation. In this framework, the pulvinar does not primarily determine what is represented, but how representations are used to guide downstream processing.

This interpretation generates testable predictions: pulvinar perturbations should primarily affect gain regulation and decision criteria, with minimal impact on early sensory encoding, and effects that are strongest under uncertainty or when spatial integration is required. These effects should emerge preferentially at late, decision-related stages.

This perspective is consistent with recent evidence showing that neural signatures associated with conscious perception are more strongly related to late-stage, task-dependent activity than to early sensory encoding (Ferrante et al., 2025), suggesting that pulvinar-like modulation contributes to the conditions under which sensory representations become behaviorally effective.

Effects of pulvinar-like modulation on contrast detection near-threshold paradigm

The near-threshold contrast-detection task probed the effects of pulvinar-like modulation under high sensory uncertainty while minimizing demands on complex feature extraction. Consistent with this aim, pulvinar-inspired connectivity did not produce uniform improvements in accuracy or sensitivity. Instead, its effects emerged most clearly at the level of decision statistics.

This simplified stimulus regime was deliberately chosen to isolate the computational role of the transthalamic pathway under controlled conditions. By minimizing high-level feature complexity, the paradigm allows changes in gain regulation, representational stability, and decision criterion to be interpreted without confounds introduced by complex object structure or task-dependent strategies. Future work will be required to determine whether similar pulvinar-inspired control mechanisms operate in more naturalistic visual environments or in tasks requiring flexible switching between representations. Notably, a similar strategy has been used in studies of the mediodorsal (MD) thalamus, where simplified task structures have been employed to reveal how thalamocortical interactions support flexible routhing and reuse of cortical representation (Rikhye et al., 2018).

Across most stimulus configurations, pulvinar-like modulation redistributed detection outcomes rather than increasing sensitivity (d′) (Figures 5, 6). Under low-signal conditions, the pulvinar–cortical model showed increased false alarms and false negatives without proportional gains in hit rate, consistent with a liberal shift in decision criterion (Figures 6B, C). Such redistributions of detection outcomes without uniform gains in sensitivity are a hallmark of near-threshold perceptual decisions, in which internal decision criteria and evidence accumulation dynamics dominate performance (van Vugt et al., 2018). These effects were stimulus-dependent and confined to intrinsically difficult regimes, ruling out indiscriminate false detections (Summerfield and Tsetsos, 2015).

A distinct regime emerged when high background noise was combined with large stimulus size, where pulvinar-like connectivity supported genuine increases in sensitivity (Supplementary Figure 1 and Supplementary Table 2). These conditions place strong demands on spatial integration, suggesting that pulvinar modulation can enhance discriminability when global evidence accumulation is required (Gold, 2007). Outside this regime, pulvinar contributions were expressed primarily as criterion shifts.

This stimulus-dependent pattern suggests that pulvinar-like modulation does not exert a uniform influence on perceptual decisions but instead engages distinct computational regimes depending on the structure of sensory uncertainty. When background noise is high and target size is large, the observed improvement in sensitivity (d′) may reflect an increased ability to integrate information across spatially distributed inputs. In biological systems, the pulvinar has been proposed to facilitate coordination across cortical regions through synchronized activity, thereby enhancing the integration of distributed evidence (Saalmann et al., 2012; Cortes et al., 2020; Fiebelkorn et al., 2019). In this context, the gain in d′ may correspond to a network-level mechanism that promotes coherent integration of weak but spatially extended signals.

By contrast, under low-signal conditions with small targets, pulvinar-like modulation primarily induces shifts in decision criterion without substantial changes in sensitivity. This pattern is consistent with a more global regulation of decision thresholds under uncertainty, in which the system adjusts how evidence is weighted rather than improving the fidelity of sensory representations (Summerfield and Tsetsos, 2015; Feldman and Friston, 2010). Such behavior aligns with theoretical accounts of the pulvinar as a precision-control structure, modulating the effective impact of sensory inputs on downstream decision processes (Kanai et al., 2015; Cortes et al., 2024, 2026).

At the network level, these behavioral effects were mirrored by selective changes in late-stage activity. While early and intermediate layers showed comparable Hit–Miss separation across architectures, the most consistent differences arose in the PFC-like layer. Pulvinar-like modulation biased late-stage activity toward positive, decision-consistent states, consistent with the role of the prefrontal cortex in encoding decision variables rather than sensory representations (Heekeren et al., 2008).

Pulvinar-like modulation regulates precision and ignition thresholds

Contemporary theories propose that the pulvinar plays a key role in regulating cortical ignition—the transition from localized sensory processing to distributed, decision-relevant cortical states (Dehaene and Changeux, 2011; Cortes et al., 2024, 2026). Here, ignition is used in a functional sense, referring to the stabilization and large-scale recruitment of decision-relevant cortical states rather than subjective awareness. In these frameworks, ignition depends not only on evidence strength but on whether that evidence is assigned sufficient precision to engage large-scale cortical coordination, consistent with predictive processing accounts (Feldman and Friston, 2010; Kanai et al., 2015; Casanova and Chalupa, 2023). Importantly, recent large-scale adversarial tests of consciousness theories indicate that prefrontal signatures associated with conscious access predominantly reflect late, task-dependent decision states rather than enhanced sensory encoding per se (Ferrante et al., 2025).

In line with this view, pulvinar-like connectivity selectively reshaped late-stage cortical representations, biasing PFC activity toward decision-consistent states and shifting the internal decision criterion under uncertainty. These effects were most pronounced near the perceptual threshold, where inference is dominated by precision estimation rather than stimulus magnitude. From a mechanistic standpoint, this pattern supports an interpretation of the pulvinar as a precision-gating structure that modulates effective connectivity across cortical levels, facilitating ignition indirectly by shaping when weak or ambiguous evidence engages late-stage cortical dynamics (Cortes et al., 2024, 2026).

Importantly, this dual role—precision regulation and ignition facilitation—does not require the pulvinar to encode stimulus content explicitly. Rather, it positions the pulvinar as a control structure that stabilizes cortical dynamics by shaping when and how distributed cortical assemblies are recruited. Translating these principles into computational architectures suggests that pulvinar-inspired pathways should gate, stabilize, and contextually modulate interactions across levels, rather than merely shortcut hierarchical processing (Cortes and Vreeswijk, 2012, 2015). The present study provides an explicit test of this idea.

Recent experimental and computational studies of HO nuclei, particularly the MD thalamus, have shown that thalamocortical circuits regulate cortical gain, ensemble dynamics, and flexible routing of representations during cognitive tasks (Schmitt et al., 2017; Rikhye et al., 2018; Mukherjee et al., 2021; Wang B. A. et al., 2025; Zheng et al., 2024). Although these studies focus primarily on MD–prefrontal circuits, they support a broader view in which higher-order thalamic pathways modulate effective connectivity and the stability of cortical representations. Within the visual system, the pulvinar occupies an analogous anatomical position, forming extensive transthalamic loops with visual cortical areas. The computational effects observed in the present model (i.e., contrast-dependent gain regulation, stabilization of representational geometry, and modulation of decision criteria under uncertainty), may therefore represent a visual-system instantiation of similar thalamocortical control principles.

Beyond these specific effects, the present results can be situated within a broader theoretical framework in which HO nuclei act as control structures over cortical computation. Recent work has emphasized that thalamocortical circuits contribute not only to routing of information, but also to its compression, regularization, and uncertainty-dependent modulation (Scott et al., 2024; Wang M. B. et al., 2025). Within this perspective, the pulvinar-like pathway implemented here can be interpreted as a concrete architectural instantiation of these principles: it regulates the influence of early sensory representations on downstream processing through a compressed summary of activity and a dynamic modulation of inter-layer interactions. This positions the pulvinar not as a feedforward relay or feature selector, but as a regulator of effective connectivity, shaping how information is integrated, stabilized, and deployed for decision-making under uncertainty. Consistent with work showing that HO circuits may act as integrative hubs coordinating cortical activity across perceptual and cognitive domains (e.g., Halassa and Kastner, 2017; Shine, 2020), the results raise the possibility that similar computational motifs may generalize across sensory and cognitive domains.

5. Conclusions

Together, these results support a view of the pulvinar as a regulator of decision criteria and precision under uncertainty, rather than a direct amplifier of sensory signals. Pulvinar-like modulation shapes how evidence is accumulated and interpreted downstream, biasing late-stage representations toward stable decision states and selectively enhancing sensitivity only when global integration is required.

Importantly, our results further suggest that such effects arise from a core transthalamic mechanism of long-range routing and gain modulation, whose functional expression depends on the operating regime in which the network is embedded. This regime may be shaped by task demands and training constraints. This distinction parallel biological systems, where neuromodulatory constraints shape circuit dynamics without altering underlying connectivity.

This perspective provides a principled explanation for the context-dependent nature of pulvinar effects observed in both computational and neurophysiological studies.

Statements

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Funding

The author(s) declared that financial support was received for this work and/or its publication. This study was supported by grants from the Natural Sciences and Engineering Research Council of Canada (NSERC; RGPIN-04982-2019) and the Canadian Institutes of Health Research (CIHR; PJT-186120) to CC, NZ was supported by student fellowships from the Réseau de recherche en sciences de la vision (RRSV) and the Bourses conjointes ESP-ÉOUM (2025-2026, Excellence).

Data availability

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author contributions

NZ: Formal analysis, Writing – original draft, Data curation, Writing – review & editing, Investigation. CC: Resources, Conceptualization, Funding acquisition, Supervision, Project administration, Writing – review & editing. NC: Supervision, Writing – review & editing, Formal analysis, Data curation, Software, Investigation, Validation, Visualization, Project administration, Conceptualization, Methodology.

Acknowledgements

The authors thank Rafael Doti, Amirah Boulianne, Capucine Mandel, David Vasii, Eliza Siurek, and Maya Chagnon for helpful discussions, and Geneviève Cyr for her essential technical assistance. The authors thank Calcul Québec and the Digital Research Alliance of Canada for providing the computational resources used in this work.

References

  1. Abbas Farishta Boire, D. R., Casanova C. (2020). Hierarchical organization of corticothalamic projections to the pulvinar. Cerebr. Cortex Commun. 1: tgaa030. doi: doi:10.1093/texcom/tgaa030
  2. Casanova C, L., Desautels M. A., Minville K. (2001). Higher-Order Motion Processing in the Pulvinar. Prog. Brain Res. 134, 71 -82. doi: doi:10.1016/S0079-6123(01)34006-2
  3. Casanova C, Savard T., Darveau S. (1997). Contribution of area 17 to cell responses in the striate-recipient zone of the cat's lateral posterior-pulvinar complex. Eur. J. Neurosci. 9, 1026 – 36. doi: doi:10.1111/j.1460-9568.1997.tb01453.x
  4. Casanova C. (2020). “Pulvinar and transthalamic cortical visual pathways,” in Reference Module in Neuroscience and Biobehavioral Psychology (Amsterdam: Elsevier; Academic Press). doi: doi:10.1016/B978-0-12-809324-5.23899-6
  5. Casanova C., Chalupa L. M. (2023). The dorsal lateral geniculate nucleus and the pulvinar as essential partners for visual cortical functions. Front. Neurosci. 17: 1258393. doi: doi:10.3389/fnins.2023.1258393
  6. Cortes N., de Souza B. o. F., Casanova C. (2020). Pulvinar modulates synchrony across visual cortical areas. Vision 4: 4020022. doi: doi:10.3390/vision4020022
  7. Cortes N., Farishta R. A., Ladret H., Casanova C. (2021). Corticothalamic Projections Gate Alpha Rhythms in the Pulvinar.PsyAxiv preprint. doi: doi:10.1101/2021.09.10.459796
  8. Cortes N., Ladret H. J., Abbas-Farishta R., Casanova C. (2024). The pulvinar as a hub of visual processing and cortical integration. Trends Neurosci. 47, 120 – 34. doi: doi:10.1016/j.tins.2023.11.008
  9. Cortes N., Mandel C., Ikan L., Casanova C. (2026). The pulvinar nucleus and its role in cognitive functions. Brain Res. Bull. 234: 111672. doi: doi:10.1016/j.brainresbull.2025.111672
  10. Cortes N., Vreeswijk C. (2012). The role of pulvinar in the transmission of information in the visual hierarchy. Front. Comput. Neurosci. 6: 29. doi: doi:10.3389/fncom.2012.00029
  11. Cortes N., Vreeswijk C. (2015). Pulvinar thalamic nucleus allows for asynchronous spike propagation through the cortex. Front. Comput. Neurosci. 9: 00060. doi: doi:10.3389/fncom.2015.00060
  12. de Souza B. O. F., Cortes N., Casanova C. (2020). Pulvinar modulates contrast responses in the visual cortex as a function of cortical hierarchy. Cerebral Cortex 30, 1068 – 1086. doi: doi:10.1093/cercor/bhz149
  13. de Souza B. O. F., Frigon É.-M., Tremblay-Laliberté R., Casanova C., Boire D. (2021). Laminar distribution of cortical projection neurons to the pulvinar: a comparative study in cats and mice. J. Comp. Neurol. 529, 2055 – 2069. doi: doi:10.1002/cne.25072
  14. Dehaene S., Changeux J-P. (2011). Experimental and theoretical approaches to conscious processing. Neuron 70, 200 – 227. doi: doi:10.1016/j.neuron.2011.03.018
  15. DiCarlo J. J., Zoccolan D., Rust N. C. (2012). How does the brain solve visual object recognition? Neuron 73, 415 – 34. doi: doi:10.1016/j.neuron.2012.01.010
  16. Feldman H., Friston K. J. (2010). Attention, Uncertainty, and Free-Energy. Front. Hum. Neurosci. 4: 215. doi: doi:10.3389/fnhum.2010.00215
  17. Ferrante O., Gorska-Klimowska U., Henin S., Hirschhorn R., Khalaf A., Lepauvre A.. (2025). Adversarial testing of global neuronal workspace and integrated information theories of consciousness. Nature 642, 133 – 42. doi: doi:10.1038/s41586-025-08888-1
  18. Fiebelkorn I. C., Pinsk M. A., Kastner S. (2019). The mediodorsal pulvinar coordinates the macaque fronto-parietal network during rhythmic spatial attention. Nat. Commun. 10: 215. doi: doi:10.1038/s41467-018-08151-4
  19. Gold J. I., Shadlen M. N. (2007). The Neural Basis of Decision Making. Annu. Rev. Neurosci. 30, 535 – 74. doi: doi:10.1146/annurev.neuro.29.051605.113038
  20. Halassa M. M., Kastner S. (2017). Thalamic functions in distributed cognitive control. Nat. Neurosci. 20, 1669 – 1679. doi: doi:10.1038/s41593-017-0020-1
  21. He K., Zhang X., Ren S., Sun J. (2015). “Deep residual learning for image recognition.” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–78. doi: doi:10.1109/CVPR.2016.90
  22. Heekeren H. R., Marrett S., Ungerleider L. G. (2008). The neural systems that mediate human perceptual decision making. Nat. Rev. Neurosci. 9, 467 – 79. doi: doi:10.1038/nrn2374
  23. Hu J., Shen L., Sun G. (2018). “Squeeze-and-Excitation Networks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7132 – 41. doi: doi:10.1109/CVPR.2018.00745
  24. Kanai R., Komura Y., Shipp S., Friston K. (2015). Cerebral hierarchies: predictive processing, precision and the pulvinar. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 370: 0169. doi: doi:10.1098/rstb.2014.0169
  25. Krizhevsky A. (2009). Learning multiple layers of features from tiny images. Int. J. Intell. Sci. 13: 2023. Available online at: (Accessed January 30, 2026).
  26. Miller-Hansen A. J., Sherman M. S. (2022). “Conserved patterns of functional organization between cortex and thalamus in mice,” in Proceedings of the National Academy of Sciences of the United States of America, 119: e2201481119. doi: doi:10.1073/pnas.2201481119
  27. Miura S. K., Scanziani M. (2022). Distinguishing externally from saccade-induced motion in visual cortex. Nature 610, 135 – 42. doi: doi:10.1038/s41586-022-05196-w
  28. Mukherjee A., Lam N. H., Wimmer R. D., Halassa M. M. (2021). Thalamic Circuits for Independent Control of Prefrontal Signal and Noise. Nature 600, 100 – 104. doi: doi:10.1038/s41586-021-04056-3
  29. Olsen S. R., Bortone D. S., Adesnik H., Scanziani M. (2012). Gain control by layer six in cortical circuits of vision. Nature 483, 47 – 52. doi: doi:10.1038/nature10835
  30. Rikhye R. V., Gilra A., Halassa M. M. (2018). Thalamic regulation of switching between cortical representations enables cognitive flexibility. Nat. Neurosci. 21, 1753 – 63. doi: doi:10.1038/s41593-018-0269-z
  31. Robinson D. L., Petersen M. (1992). The pulvinar and visual salience. Trends Neurosci. 15, 127 – 32. doi: doi:10.1016/0166-2236(92)90354-B
  32. Saalmann Y. B., Kastner S. (2011). Cognitive and perceptual functions of the visual thalamus. Neuron 71, 209 – 23. doi: doi:10.1016/j.neuron.2011.06.027
  33. Saalmann Y. B., Pinsk M. A., Wang L., Li X., Kastner S. (2012). The pulvinar regulates information transmission between cortical areas based on attention demands. Science 337, 753 – 56. doi: doi:10.1126/science.1223082
  34. Schmitt L. I., Wimmer R. D., Nakajima M., Happ M., Mofakham S., Halassa M. M. (2017). Thalamic amplification of cortical connectivity sustains attentional control. Nature 545, 219 – 23. doi: doi:10.1038/nature22073
  35. Scott D. N., Mukherjee A., Nassar M. R., Halassa M. M. (2024). Thalamocortical architectures for flexible cognition and efficient learning. Trends Cogn. Sci. 28, 739 – 756. doi: doi:10.1016/j.tics.2024.05.006
  36. Sherman S. M. (2017). Functioning of circuits connecting thalamus and cortex. Compr. Physiol. 7, 713 – 39. doi: doi:10.1002/j.2040-4603.2017.tb00758.x
  37. Sherman S. M., Guillery R. W. (2011). Distinct functions for direct and transthalamic corticocortical connections. J. Neurophysiol. 106, 1068 – 77. doi: doi:10.1152/jn.00429.2011
  38. Shine J. (2020). The thalamus integrates the macrosystems of the brain to facilitate complex, adaptive brain network dynamics. Prog. Neurobiol. 199: 101951. doi: doi:10.1016/j.pneurobio.2020.101951
  39. Shipp S. (2003). The functional logic of cortico–pulvinar connections. Philos. Transact. Royal Soc. London. B Biol. Sci. 358, 1605 – 24. doi: doi:10.1098/rstb.2002.1213
  40. Summerfield C., Tsetsos K. (2015). Do humans make good decisions? Trends Cogn. Sci. 19, 27 – 34. doi: doi:10.1016/j.tics.2014.11.005
  41. van Vugt B., Dagnino B., Vartak D., Safaai H., Panzeri S., Dehaene S.. (2018). The Threshold for conscious report: signal loss and response bias in visual and frontal cortex. Science 360, 537 – 42. doi: doi:10.1126/science.aar7186
  42. Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A. N.. (2017). “Attention is all you need,” in Advances in Neural Information Processing Systems, Vol. 30. eds. Guyon I, Von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R. (Red Hook, NY: Curran Associates, Inc).
  43. Veit A., Wilber M. J., Belongie S. (2016). “Residual Networks Behave Like Ensembles of Relatively Shallow Networks,” in Advances in Neural Information Processing Systems, Vol. 29. eds. Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R (Red Hook, NY: Curran Associates, Inc). Available online at:
  44. Wang B. A., Wang M. B., Lam N. H., Mengxing L., Li S., Wimmer R. D., Paz-Alonso P. M.. (2025). Thalamic regulation of reinforcement learning strategies across prefrontal-striatal networks. Nat. Commun. 16: 9095. doi: doi:10.1038/s41467-025-63995-x
  45. Wang M. B., Lynch N., Halassa M. M. (2025). The neural basis for uncertainty processing in hierarchical decision making. Nat. Commun. 16: 9096. doi: doi:10.1038/s41467-025-63994-y
  46. Wróbel A. (2000). “Beta activity: a carrier for visual attention. Acta Neurobiol. Exp. 60, 247 – 60. doi: doi:10.55782/ane-2000-1344
  47. Zheng H., Zheng Z., Hu R., Xiao B., Wu Y., Yu F.. (2024). Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics. Nat. Commun. 15: 277. doi: doi:10.1038/s41467-023-44614-z
  48. Zhou H., Schafer R. J., Desimone R. (2016). Pulvinar-cortex interactions in vision and attention. Neuron 89, 209 – 20. doi: doi:10.1016/j.neuron.2015.11.034

Citation

Zarinabadi, N., et al. (2026). Pulvinar pathways as skip connections in deep neural networks for vision. Frontiers in Neuroimaging, Volume 5. https://doi.org/
Received
Accepted
Published
Volume
5 - 2026

Copyright

Copyright © 2026 Zarinabadi, Casanova and Cortes.

License: https://creativecommons.org/licenses/by/4.0/

*Correspondence: Nelson Cortes

Article metrics

Views
0
Downloads
0
Citations
0
Shares
0