Original Research
Frontiers in Neurorobotics ·
Volume 20 - 2026 | https://doi.org/10.3389/fnbot.2026.1753927
Interpretable vision mamba for SAR images classification
- Kaiming Zou1
- Ningbo He1,2*corresponding author
- Leijun Yao2
- Jialin Li3
- Yongfeng Wang3
- 1School of Geophysics, Chengdu University of Technology, Chengdu, China
- 2China Aneng Group Third Engineering Bureau Co., Ltd., Chengdu, China
- 3Xi'an Jiuzhi-Tech. Co., Ltd., China
Abstract
Deep learning techniques have been successfully applied to object classification in Synthetic Aperture Radar (SAR) images, achieving remarkable performance. However, the current Transformer architecture still faces two limitations in SAR object classification: (1) Transformers occupies substantial GPU memory during training, which hinders large-scale model deployment and hyperparameter optimization. (2) the vectorization of image patches destroys spatial information among pixels, thus the represented features are semantic-agnostic. In this paper, we propose a lightweight and interpretable vision mamba (IVim) whose feature maps from deep Mamba blocks are visually understandable. IVim consists of two modules: Token Semantic Re-allocation (TSR) and Token Attention Selection (TSA). TSR re-allocates the semantics to feature maps by optimizing a novel loss function for an extra convolutional layer. TAS selects the most discriminative attention map by evaluating the quantity of semantics in attention matrices of different Mamba layer. Finally, we provide a coupling strategy to form a saliency heatmap to visually show the interpretability of IVim by merging feature map and attention map. Experimental results demonstrate that IVim can re-allocate semantics to deep features and achieve better classification performance compared to its counterparts by reducing 67.8% parameters.
Keywords
1 Introduction
With the all-day and all-weather perception capability (Zhang et al., 2024), Synthetic Aperture Radar (SAR) is widely applied in various remote sensing tasks, like topographic survey (Wang M. et al., 2022), disaster rescue (Yang et al., 2025), electronic reconnaissance (Jinke et al., 2023; Sun et al., 2022), etc. Meanwhile, numerous deep-learning models have demonstrated remarkable success in general computer vision tasks (e.g., classification, detection, segmentation), which naturally inspires transferring them from optical image to SAR image. One of the most important vision task in SAR image processing is target classification because other tasks [e.g.,fine-grained classification (Xiong et al., 2024; Zheng et al., 2024; Xu and Lang, 2020), small-target detection (Feng et al., 2022; Liu P. et al., 2024; Chang et al., 2025), change detection (Costa et al., 2024; Zhang et al., 2022), despeckling (Hu et al., 2024; Lin et al., 2022)] usually adopt classification models as the backbones.
Convolutional Neural Network (CNN) is the first successfully-applied deep-learning architecture in SAR target classification. (Wang et al. 2018) firstly utilized CNN to implement SAR target recognition and obtained better accuracy than SVM. (Min et al. 2019) proposed a gradually distilled CNN with a small structure and high calculation efficiency for SAR target recognition. (Li et al. 2022) propose a mutiscale CNN for SAR automatic target recognition (ATR) by fusing multiscale feature maps obtained from different layers to enhance the feature description ability. However, CNN can only capture small-range feature dependency but almost unable to capture long-range feature dependency due to its convolution kernel's limited perception field, so CNN suffers from “feature bottleneck”. To better capture long-range feature dependency, (Vaswani et al. 2017) proposed a multi-head self-attention architecture, termed Transformer. Owing to multi-head self-attention mechanism, Transformer is able to capture long-range feature effectively, and numerous Transformer-based SAR target classification modes are proposed, like (Xiong et al. 2025); (Dai et al. 2025); (Wang C. et al. 2022); (Shang et al. 2024). However, multi-head self-attention mechanism make Transformer-based models commonly face two challenges:(1) It is low-efficient to train Transformer-based because of slow speed of inference. (2) A large amount of GPU memory is occupied during Transformer-based models training process, which is a challenge for hardwares. In view of CNN and Transformer's above limitations, it is imperative to have a novel deep-learning architecture with ability to capture long-range feature dependency like Transformer but with much faster inference speed and less GPU memory occupation.
To compensate for the above limitations, Recently, Gu et al. proposed a Linear-Time Sequence Modeling with Selective State Spaces (Mamba), a lightweight deep neural network based on state space model (SSM). Mamba is originally proposed for NLP tasks and demonstrates comparative performance to Transformers. Subsequently, Zhu et al. firstly transfer Mamba to vision tasks, termed as Visual Mamba (Vim). Compared with ViT, Vim is a lightweight model with linear computational complexity to input image dimension, saving 86.8.2% of GPU memory in comparsion to counterpart Transformer models. (Xu et al. 2025) proposed MambaShadowDet for moving target shadow detection. (Tu et al. 2025) proposed a Mamba unsupervised domain adaptation model for SAR ship detection. (Pan et al. 2025) proposed a multiscale and multibrmanch Mamba for SAR-assisted optical image thick cloud removal. (Li et al. 2025) proposed a Mamba-based joint semantic segmentation network for optical and SAR images. However, Mamba-based models lack interpretability in comparison to CNN since the feature maps represented by Vim are usually semantic-agnostic. It is because the vectorization of 2-D patches destroys the spatial information between image pixels. In this case, the feature maps exhibit no semantics. It is worth noting that existing interpretability methods for deep learning models typically provide an intuitive understanding of model mechanisms by visualizing the associations between deep feature representations and model predictions, basically including perturbation-based explanations and activation-based explanations. Perturbation-based methods (Kumar Singh and Jae Lee, 2017) generally design a mask to occlude or blur some pixels of the input image, and reveal the model's prediction mechanism by comparing the differences of predictions before and after the perturbation. However, perturbation-based explanations usually require multiple Monte Carlo trials to offset the bias induced by perturbation randomness, significantly decreasing efficiency when applied to large-scale models. Consequently, activation-based explanations ave become the dominant approach that produce saliency heatmaps by aggregatiing deep activation maps weightedly. Activation-based explanations mainly consist of class activation mapping (CAM) (Zhou et al., 2016) as well as its variants (Selvaraju et al., 2017; Ramaswamy et al., 2020; Wang et al., 2020; Feng et al., 2024, 2023). Nevertheless, they are still unable to directly visualize deep features representation mechanism of Vim, as shown in Figure 1. This lack of interpretability severely restricts the development of Mamba-based models in some sensitive and risky task, like disaster rescue, electronic reconnaissance, as mentioned in Section 1.

In this paper, we propose an interpretable Vision Mamba (IVim) architecture especially for SAR image classification. IVim involves two intertwined network branches: Token Semantic Reassignment (TSR) and Token Attention Selection (TAS). TSR re-allocates semantics for the patch tokens to generate a semantic-aware feature map by cascading an modified MLP classifier after the last Vim block and retrain the model with a new loss function. TAS selects the most discriminative attention map by referring to the confidence drop of the filter image masked by each attention map. Finally, attention map and feature map are merged as an interpretation heatmap revealing the most discriminative regions for IVim's classification.
The remainder of this paper is organized as follows. Section 2 introduces the basic theory of Mamba and reviews several Mamba models in SAR target classification. Section 3 elaborates the methodology of IVim. Section 4 provides experimental results from various perspectives to demonstrate the superiority of IVim compared to other models. Section 5 discusses the experimental results and clarifies the confusion.
2 Related work
In addition to object-level classification in single SAR images, broader remote sensing tasks such as scene classification and multitemporal analysis have also seen significant advancements, which further contextualize the motivation for interpretable and efficient architectures like IVim. Scene classification aims to assign a semantic label (e.g., residential, agricultural, industrial) to an entire image patch, requiring the model to capture global contextual relationships and spatial layouts. In contrast, multitemporal classification focuses on analyzing changes or consistent patterns across images acquired at different times, demanding robust temporal feature integration and sensitivity to subtle variations over time.
Recent studies have introduced sophisticated architectures to address these challenges. For instance, (Zhao et al. 2024) proposed a Gradient-guided Multi-scale Focal Attention Network for remote sensing scene classification, which leverages gradient information to adaptively focus on discriminative regions across multiple scales, enhancing model interpretability and accuracy in complex scenes. Similarly, (Wang et al. 2023a) developed a Multistage Self-Guided Separation Network that progressively disentangles semantic features from cluttered backgrounds, improving scene classification performance by emphasizing task-relevant visual cues. In the realm of multitemporal analysis, (Zhao et al. 2025) incorporated difference information into a curriculum learning framework, enabling more effective feature learning for classifying land cover changes over time.
While these methods have advanced scene understanding and temporal analysis, they predominantly rely on attention-based or CNN-based backbones, which inherit limitations such as high computational cost and limited interpretability of deep feature representations—issues similarly faced in SAR object classification. The proposed IVim architecture, with its efficient long-range dependency modeling and built-in interpretability modules (TSR and TAS), offers a promising alternative not only for SAR target classification but also for broader remote sensing tasks that require both efficiency and transparency. By reallocating semantics to feature maps and selecting semantically meaningful attention regions, IVim aligns with the growing need for models that are not only accurate but also explainable, particularly in critical applications like disaster monitoring, land use analysis, and environmental change detection where understanding model decisions is as important as performance.
2.1 State space model mechanism
State space models for long sequence modeling (Gu et al. 2021) propose a Structured State-Space Sequence (S4) model, a novel alternative to CNNs or Transformers, to model the long-range dependency. The advantageous property of linearly scaling in sequence length stimulates significant research interests. (Wang J. et al. 2022) introduce a Bidirectional Gated SSM architecture that replicates BERT's performance without attention mechanisms. Tan et al. (2019) present the S5 layer, incorporating MIMO SSM formulations and efficient parallel scan operations into the S4 framework. (Fu et al. 2022) design the H3 SSM layer, substantially narrowing the performance gap between SSMs and Transformer attention in language modeling tasks. (Mehta et al. 2022) develop the Gated State Space layer to enhance the expressivity of S4 through additional gating units. Recently, (Gu and Dao 2023) propose a data-dependent SSM layer and establish Mamba, i.e., a generic language model backbone that surpasses Transformers across scales on large real-world datasets while preserving linear sequence-length scaling.
The underlying architecture of Structured State Space (S4) and Mamba models is derived from a continuous framework. The core of this framework is a state-space system that transforms an input function x(t) ∈ ℝ into an output y(t) ∈ ℝ by a hidden state h(t) ∈ ℝ*N*. This system contains A ∈ ℝ*N*×*N* as the evolution matrix and B ∈ ℝ*N*×1, C ∈ ℝ1 × *N* as the projection parameters. Next, we will elaborate the mechanism of Mamba.
h′(t)=Ah(t)+Bx(t),y′(t)=Ch(t).(1)
The S4 and Mamba are the discrete versions of above continuous system, so they further have a scaling parameter Δ to transform the continuous A, B to discrete A¯, B¯. by zero-order hold (ZOH), which is formulated as Equation 2
A¯=exp(ΔA),B¯=(ΔA)-1(exp(ΔA)-I)ΔB.(2)
After the discretization of A¯, B¯, the discretized version of Equation 1 using a step size Δ can be rewritten as Equation 3:
ht=A¯ht-1+B¯xt,yt=Cht.(3)
Finally, the output is given by a global convolution as
k¯=(CB¯,CA¯B¯,…,CA¯(M-1)B¯),y=x*k¯(4)
where M is the length of the input sequence x, and k¯∈ℝM is a structured convolutional kernel. Leveraging Mamba's long-sequence modeling capabilities, subsequent research actively explores transferring the success of Mamba to vision, i.e., building a generic vision backbone purely upon SSM without attention.
2.2 State space model for vision tasks
In computer vision tasks, (Islam and Bertasius 2022) employ the 1D S4 model to address long-range temporal dependencies for video classification. (Nguyen et al. 2022) extend the 1D S4 framework to process multi-dimensional data, encompassing both 2D images and 3D videos. (Islam et al. 2023) integrate S4 with self-attention to construct the TranS4mer model, achieving state-of-the-art performance in movie scene detection. (Wang et al. 2023b) introduce a novel selectivity mechanism into S4, significantly enhancing performance on long-form video understanding while substantially reducing memory requirements. Jing Nathan Yan (2016) supplant attention mechanisms with a scalable SSM-based backbone capable of generating high-resolution images and processing fine-grained representations under computationally efficient constraints. (Ma et al. 2024) proposed U-Mamba, a hybrid CNN-SSM architecture designed to manage long-range dependencies in biomedical image segmentation. The aforementioned works either adapt SSMs for specialized visual applications or develop hybrid architectures combining SSMs with convolution or attention mechanisms. (Liu Y. et al. 2024) propose VMamba, which demonstrates compelling performance in visual recognition through multi-directional scanning integration and hierarchical network design. (Zhu et al. 2024) present Vision Mamba (Vim), focusing on visual sequence learning while establishing a unified representation for multimodal data. In this work, we deploy Vision Mamba as the backbone architecture for weakly supervised object localization.
3 Methodology
The target of IVim is to re-allocate the semantics to feature maps represented by Vim. This section begins with a description of the preliminaries of Vim, including SSM module, the mechanism of Vision Mamba and proceed to illustrate the architecture details of IVim. Then we analyze the reason why the feature maps of vanilla Vim are semantic-agnostic and subsequently introduce two modules of Ivim, i.e., TSR and TAS as shown in Figure 2.

3.1 Vision mamba
The vanilla Mamba model operates on one-dimensional sequences. To enable its application to visual tasks involving two-dimensional images x ∈ ℝ*H*×*W*×*C*, the image is reformatted into a sequence of flattened patches. This process yields a representation xp∈ℝJ×(P2×C), where J denotes the total number of patches and P2 is the number of pixels per patch, calculated as (H×W)/J.
Then, the x*p* is linearly projected to a sequence with D dimension. Similar to Vision Transformer, a position embeddings Epos∈ℝ(J+1)×D is directly added to x*p* to compensate spatial information of patches as Equation 5
T0=[tcls;tp1W;tp2W;⋯,tpJW]+Epos,(5)
where tpj is the j-th patch of x*p*, W ∈ ℝ(*P*2C) × D is the learnable projection matrix. Inspired by ViT and BERT, we also use class token to represent the whole patch sequence, which is denoted as tcls. We then send the token sequence (T*l*−1) to the l-th layer of the Vim encoder, and get the output T*l*. Finally, we normalize the output class token TL0 and feed it to the multi-layer perceptron (MLP) head to get the final prediction p^, as Equation 6
Tl=Vim(Tl-1)+Tl-1,f=Norm(TL0),p^=MLP(f),(6)
where Vim is the proposed vision mamba block, L is the number of layers, and Norm is the normalization layer.
3.2 Interpretable vision mamba
(1) Token semantic re-allocation (TSR): This mechanism transfers semantic information from the class token (t0L) to the patch tokens. The final patch token embeddings t1L,t2L,…,tNL are restructured into 2D feature maps t*L* ∈ ℝ*D*×*w*×*h*. A convolutional layer then processes these maps to generate a set of class-specific semantic activation maps S*c* as Equation 7
Sc=∑dtdL*kc,d(7)
where k*c, d* is a 3 × 3 convolutional kernel for class c and feature channel d. * denotes the convolution operation. Afterwards, IVim is trained using a novel loss function L that calculates the probability of the target class y based on the average activation of these maps, thereby effectively re-allocating semantic awareness to the patch tokens, which is formulated as
ℒ=−logP'y =−logexp(∑nSn,y/N)∑cexp(∑nSn,c/N))(8)
where S*n, c* denotes the semantics of nth patch token with respect to class c. By optimizing Equation 8, the semantics are reallocated to patch tokens {t1L,t2L,…,tNL} and produce semantic-aware activation maps. After fine-tuning these convolutional kernels, they can produce feature maps that correspond with the neurons in the classification head, i.e., intuitively, each feature map matches the semantic information of its corresponding class associated, rather than vanilla Vim's feature maps that are semantic-agnostic to classes. This semantic re-allocation can provide more intuitively understanding feature maps corresponding to classes, and it is the reason why our proposed method is termed Interpretable Vision Mamba.
(2) Token attention selection (TAS): It is difficult to generate attention map by aggregating attention matrix in TS-CAM because there is no self-attention mechanism in Vim. Specifically, Equation 4 can be extended as Equation 9
(y(0)y(1)y(2)⋮y(N-1))=(CBx(0)CABx(0)+CBx(1)CA2Bx(0)+CABx(1)+CBx(2)⋮CA(N-1)Bx(0)+⋯+CBx(N-1))(9)
The parameters C, B¯, and A¯ act as forgetting factors for temporal data to reduce the influence of earlier input (x(0), x(1), ⋯ , x(k−1)) on the current output, x(k). However, this mechanism is semantic-agnostic for image patches, disrupting spatial information and creating noisy activation maps, i.e., CA¯(k-1)B¯ is semantic-agnostic. Therefore, unlike methods like TS-CAM, simply summing these maps is ineffective. To address this, we propose weighting maps by their semantic relevance. We use each layer's activation map as a mask to isolate the most salient image regions. The semantic importance of a map is then quantified by the drop in model confidence when those regions are occluded. It is necessary to assign weights to attention maps according to their semantics, so attention maps of different layers can be utilized as mask to filter the input image, i.e., only passing the most highlighted pixels while setting the rest pixels to the average value of the input image. The above procedure retains only the attention map with the highest semantic relevance to the current target class, thereby filtering out information in the attention maps that is unrelated to the target semantics and making the final heatmap more consistent with human visual intuition. This is another aspect of "interpretable" in our proposed method. Here confidence drop is adopted to measure the semantic information of the current attention map, defined as:
Cl=Pc(x)-Pc(ΓW×H(Al)⊗x)Pc(x), l=1,2,…,L(10)
where Γ*W*×*H* denotes resizing the shape of A*l* to W×H, and ⊗ denotes Hadamard product. Equation 10 reveals that a greater C*l* means the attention map of l-th layer includes more semantic information. Now, the weights of A*l* can be defined as Equation 11
αl=exp(Cl)∑lLexpCl(11)
The attention map of IVim, A*, can be expressed by aggregating weighted A*l*, as Equation 12
A=∑lLαlA(12)
It should be clarified that there is indeed no standard self-attention matrices in Mamaba. The matrices CB, CAB,..., CA*k*−1B in vanilla Mamba are actually regarded as “forgetting factors” to assign smaller weights to former inputs and bigger weights to later inputs for one dimensional temporal sequences. However, image input does not have temporal correlations among pixels, thus there we just use attention matrix to denote CB, CAB,..., CA*k*−1B. It is not dervied from the convolutional kernel, becuase only TSR utilizes the convolutional kernel to re-allocate the smantics to feature maps. CB, CAB,..., CA*k*−1B are directed extracted from the Mamba while forward inference.
(3) Saliency map aggregation: Finally, a saliency heatmap for interpretation can be aggregated by calculating the Hadamard product of A* and S*c*, as shown in Figure 3, which can be expressed as Equation 13
Hc=ΓW×H(A*)⊗Sc(13)

H*c* is the saliency map where most highlighted regions reflect the most discriminative pixels for classification. It is worth noting that this step is unnecessary to forge IVim, while it is only used to provide a saliency map to visualize the interpretabilty of IVim in SAR image classification.
4 Results
4.1 Experiment settings
We adopt a widely-used benchmark SAR dataset, MSTAR, to demonstrate the validity of our proposed IVim. MSTAR includes 2536 SAR images of 10 classes of vehicles for training and 2, 636 for validation. It is worth noting that the original SAR images are gray-scale; however, to avoid modification of the parameters of Vim, all the SAR images are transformed into pseudo-RGB images (reduplicate the monochromatic image in three channels). The MSTAR images are uniformally resized to 224 × 224. The backbone Vim is trained by AdamW with a momentum of 0.9, a total batch size of 1024, and a weight decay of 0.05 to optimize models. The Vim is pretrained on ImageNet-1k for 300 epochs using a cosine schedule, 10−3 initial learning rate. We use a convolutional layer with 3 × 3 kernel followed by the classifying head to re-allocate semantics to feature maps. The learnable parameters of above convolutional layer are fine-tuned on MSTAR by 50 epochs. Additionally, we assert the rationale for the choice of above experimental parameters settings. The optimizer, batch size, weight decay of the backbone are identical to the parameter setting in (Zhu et al. 2024). The kernerl size is set to 3 × 3 to ensure a balance between global feature representation and detailed contextual perception. It is worthnoting that all layers are frozen except these convoutional kernerls when optimizing Equation 4. Experiments are performed on a NVIDIA RTX 4090 GPU.
4.2 Results analysis
Classification: Table 1 presents the comparison of classification accuracy of different deep neural networks. It is evident that the proposed IVim obtains the superior classification accuracy to other models. Although IVim is not designed solely to improve classification performance, Table 1 demonstrate sthat reassigning semantics to the deeper features of Mamba can provide more information for the classification layer, ultimately enhancing the classification accuracy. It should be clarified that classic models are usually regarded as capable enough for MSTAR classification becuase the number of samples are small and the images are cropped in center with pure background. However, it is still necessary to compare most state-of-the-art model to demonstrate the superiority of the baseline Mamba and our proposed Ivim. Hence, we particularly compared a recent a SOTA architecture i.e., DisCo DETR) for object classification proposed in Table 1.
Table 1. Comparison of classification accuracy of our proposed IVim and other models in SAR images.
| Model | Ratio of training samples | ||||
|---|---|---|---|---|---|
| 10% | 30% | 50% | 70% | 100% | |
| MobileNetV2 | 71.84 ± 0.979 | 96.05 ± 0.355 | 97.68 ± 0.330 | 98.94 ± 0.155 | 99.11 ± 0.199 |
| ASIR-Ne | 58.23 ± 3.737 | 88.26 ± 3.101 | 95.11 ± 0.994 | 97.59 ± 0.363 | 99.15 ± 0.033 |
| ResNet18 | 86.21 ± 0.543 | 97.01 ± 0.284 | 98.47 ± 0.286 | 99.11 ± 0.056 | 99.43 ± 0.066 |
| ResNet34 | 87.32 ± 0.703 | 97.49 ± 0.259 | 98.57 ± 0.100 | 99.12 ± 0.139 | 99.42 ± 0.086 |
| RepVGG | 71.24 ± 1.554 | 93.13 ± 1.344 | 97.78 ± 0.467 | 98.53 ± 0.433 | 99.39 ± 0.238 |
| SFAS | 79.77 ± 2.136 | 95.27 ± 3.515 | 98.38 ± 0.181 | 98.99 ± 0.092 | 99.45 ± 0.037 |
| MobileViT | 72.03 ± 0.398 | 95.88 ± 0.622 | 98.66 ± 0.317 | 99.13 ± 0.181 | 99.46 ± 0.159 |
| DenseNet | 88.61 ± 0.837 | 97.98 ± 0.182 | 98.90 ± 0.280 | 99.54 ± 0.075 | 99.65 ± 0.118 |
| DisCo DETR | 89.21 ± 0.125 | 97.45 ± 0.042 | 98.25 ± 0.140 | 99.21 ± 0.161 | 99.45 ± 0.124 |
| Ivim | 89.94 ± 0.274 | 97.33 ± 0.092 | 99.07 ± 0.141 | 99.57 ± 0.045 | 99.62 ± 0.018 |
Bold values indicate the method with best performance.
Interpretability: To analyze the interpretability of IVim quantitatively, we implemented a perturbation strategy which occludes most highlighted or weakest pixels in the input SAR image to check the change of model's prediction. Specifically, perturbation can be categorized into an “occlusion game” and a “conservation game”. The occlusion game measures the importance of those highlighted pixels for classification when they are occluded. In the occlusion game, the input image I is masked by the heatmap, as Equation 14
Ǐ=I⊗MOcclusion(14)
where Ǐ denotes perturbed image and M*CAM* denotes a binary-value mask defined as Equation 15
{MijOcclusion=0, HijCAM≥0.8,MijOcclusion=1, otherwise,(15)
Here HijOcclusion has been normalized to [0, 1]. This means that in mask M*Occlusion*, the elements corresponding to the top 20% value of the heatmap are set to 0, while the rest are equal to the heatmap. Then, we compute the divergence of the class confidence (the output of the softmax layer) between the original image and the perturbed image, as Equation 16
confidence_drop(I,Ǐ)=Sc(I)-Sc(Ǐ)Sc(I)(16)
In the occlusion game, a low value of confidence_drop means that more discriminative pixels of the object are covered by heatmaps. Nevertheless, the salient regions sometimes almost cover the entire image, which can also lead to a high value of class_score in the occlusion test in Table 2. In this case, it is necessary to introduce "conservation game". The only difference between the conservation game and the occlusion game is the mask M*Conservation* formulation, defined as Equation 17
MConservation=U-MOcclusion(17)
where U is a matrix ∀i, j, U*ij* = 1. The results of both occlusion and conservation game are presented in Table 2. Table 2 reveals that IVim can produce the most discriminative heatmaps for interpreting Mamba's feature representation mechanism. It should be noted that gradient-based methods are better than gradient-free methods in occlusion game but worse than those in conservation methods. It is because gradient-based methods tend to cover the background region out of the object's profile.
Table 2. Comparison of interpretability of our proposed IVim and other interpretation methods.
| Method | Interpretation capability | |
|---|---|---|
| Occlusion | Conservation | |
| Grad | 0.85 | 0.25 |
| Grad++ | 0.88 | 0.21 |
| XGrad | 0.79 | 0.28 |
| Ablation | 0.82 | 0.24 |
| Score | 0.90 | 0.24 |
| IVim | 0.94 | 0.18 |
Efficiency Analysis: Table 3 compares the parameter complexity of our proposed IVim and other models. Obviously, IVim achieves the best classification performance with the smallest scale of paremeters (67.8% lower than that of ResNet-34). We also found that IVim occupies 4.6GB CUDA memory with 224 × 224 and only 11.2GB CUDA memory with 1200 × 1200 while DeiT-Ti occupies more than 70GB CUDA memory.
Table 3. Comparison of efficiency of different WSOL backbones.
| Backbones | Image size | Params (M) | Top-1 Cls. Acc (%) |
|---|---|---|---|
| VGG16 | 2242 | 138.3 | 94.40 |
| ResNet34 | 2242 | 21.8 | 99.42 |
| Deit-S | 2242 | 25.1 | 99.53 |
| IVim (Vim-T) | 2242 | 7 | 99.62 |
4.3 Ablation study
Mechanism of TSR: Figure 4 shows the mechanism of semantics re-allocation, i.e., S*c* for different classes. The first column shows input images of 10 classes, and the second to the eleventh column presents semantic-aware feature maps corresponding to different classes, S*c*, where the Sc corresponding to the current class is marked by a red square. Figure 4 vividly shows that the semantic information is allocated to the feature map corresponding to the class of input image, while other feature maps are completely semantic-agnostic. It demonstrates TSR module effectively introduce the semantics by optimizing the proposed loss function, i.e., S*c*. Table 4 further presents quantitative ablation study results. It is clear from Table that TSR and TSA collaboratively work to increase the attention concentration solely on regions relevant to the obejct semantics. When TSR module is removed, TSA even produce slight lower classification performance (99.48%) than vanilla baseline (99.53%) because TSA can only select semantic-agnostic feature maps without smantic re-allocation by TSR.

Table 4. Ablation of Semantic-aware actiavtion and semantic-agnostic actiavtion.
| TSR | TSA | Top-1 Loc. Acc |
|---|---|---|
| 99.53 | ||
| ✓ | 99.75 | |
| ✓ | 99.48 | |
| ✓ | ✓ | 99.62 |
Mechanism of TAS: Figure 5 shows the mechanism of TAS module. The first column shows the input images of 10 classes, the second column presents the attention maps producde by TAS, the third column presents the feature maps produced by TSR, and the last columns shows the aggregated saliency heatmaps. It is clear from Figure 5 that attention maps can locate the object profile well, but some scatters are randomly distributed around the most highlighted region. In this scenario, the element-wise multiplication of a and S*c* effectively counteracts their respective limitations and synergizes their strengths, forming a heatmap that interprets the feature representation mechanism of Mamba model.

5 Conclusion
We proposed an interpretable vision Mamba (IVim) for SAR image classification. IVim fully takes the advantages of the long-range feature dependency and low occupancy on GPU memory of Vim. To solve the the semantic agnostic issue of the feature maps, we proposed TSR module to re-allocate semantic information for feature maps, enabling each of them to be aware of object class. Furthermore, we proposed the TSA module, which employs a dynamic weighting strategy to selectively combine attention matrices from different layers of the Mamba, thereby generating semantically interpretable attention maps. Experiments on the MSTAR datasets demonstrate that IVim conspicuously improved the interpretability of feature maps in Mamba block, in striking contrast with its other counterparts.
Generative AI statement
The author(s) declared that generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
Edited by: Cláudia Maria Almeida, National Institute of Space Research (INPE), Brazil
Reviewed by: Yue Zhao, Xidian University, China
Zheng Fang, Yangzhou Polytechnic Institute, China
Statements
- Conflict of interest
NH and LY were employed by China Aneng Group Third Engineering Bureau Co., Ltd. JL and YW were employed by Xi'an Jiuzhi-Tech. Co., Ltd.
The remaining author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- Funding
The author(s) declared that financial support was received for this work and/or its publication. This research is funded by Research and Development of Key Technologies and Equipment for Avalanche Hazard Mitigation with Demonstration Applications OF Key Research and Development Program issued by Ministry of Emergency Management of the people's Republic of China, grant number: 2024EMST030303.
- Data availability
Publicly available datasets were analyzed in this study. This data can be found here: https://www.sdms.afrl.af.mil/index.php?collection=mstar.
- Author contributions
KZ: Writing – original draft, Methodology, Software, Conceptualization. NH: Conceptualization, Methodology, Funding acquisition, Writing – original draft. LY: Software, Writing – original draft, Validation. JL: Writing – original draft, Data curation, Visualization. YW: Writing – original draft, Investigation, Supervision.
- Acknowledgements
The authors are thankful to editors and reviewers of Frontiers in Neurorobotics for improving the quality of this paper.
References
- Chang H., Lang P., Fu X., Guo K., Sheng X., Guan J.. (2025). Rsciwanet: Regional spatial-channel information weighted attention network for video sar and large-scale sar image targets detection. IEEE J. Select. Topics Appl. Earth Observat. Remote Sens. 18, 17654 – 17670. doi: doi:10.1109/JSTARS.2025.3587701
- Costa G., Virgilio Monti-Guarnieri A., Manzoni M., Rucci A. (2024). A nonparametric estimator for coherent change detection: The permutational change detection. IEEE Trans. Geosci. Remote Sens. 62, 1 – 14. doi: doi:10.1109/TGRS.2024.3407574
- Dai Q., Zhang G., Xue B., Zhu D., Wang L., Leung H. (2025). Multi-view visual and topological features coordination aggregation framework for sar target recognition. IEEE Trans. Aerospace Electronic Syst. 61, 10065 – 10081. doi: doi:10.1109/TAES.2025.3560256
- Feng X., Yao X., Cheng G., Han J., Han J. (2022). Saenet: Self-supervised adversarial and equivariant network for weakly supervised object detection in remote sensing images. IEEE Trans. Geosci. Remote Sens. 60, 1 – 11. doi: doi:10.1109/TGRS.2021.3105575
- Feng Z., Cui X., Ji H., Zhu M., Stanković L. (2023). Vs-cam: Vertex semantic class activation mapping to interpret vision graph neural network. Neurocomputing 533, 104 – 115. doi: doi:10.1016/j.neucom.2023.02.057
- Feng Z., Ji H., Daković M., Cui X., Zhu M., Stanković L. (2024). Cluster-cam: Cluster-weighted visual interpretation of cnns decision in image classification. Neural Networks 178: 106473. doi: doi:10.1016/j.neunet.2024.106473
- Fu D. Y., Dao T., Saab K. K., Thomas A. W., Rudra A., Ré C. (2022). Hungry hungry hippos: towards language modeling with state space models. arXiv [preprint] arXiv:2212.14052. doi: doi:10.48550/arXiv.2212.14052
- Gu A., Dao T. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv [preprint] arXiv:2312.00752. doi: doi:10.48550/arXiv.2312.00752
- Gu A., Goel K., Ré C. (2021). Efficiently modeling long sequences with structured state spaces. arXiv [preprint] arXiv:2111.00396. doi: doi:10.48550/arXiv.2111.00396
- Hu X., Xu Z., Chen Z., Feng Z., Zhu M., Stankovi L. (2024). “Sar despeckling via regional denoising diffusion probabilistic model,” in IGARSS 2024 - 2024 IEEE International Geoscience and Remote Sensing Symposium (Athens: IEEE), 7226 – 7230.
- Islam M. M., Bertasius G. (2022). “Long movie clip classification with state-space video models,” in European Conference on Computer Vision (Cham: Springer), 87 – 104.
- Islam M. M., Hasan M., Athrey K. S., Braskich T., Bertasius G. (2023). “Efficient movie scene detection using state-space transformers,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (Vancouver, BC: IEEE), 18749 – 18758.
- Jing Nathan Y., Jiatao Gu A. M. R. (2016). “Deep residual learning for image recognition,” in 2023 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Las Vegas, NV: IEEE), 770 – 778. doi: doi:10.1109/CVPR.2016.90
- Jinke H., Xiaolin Z., Tiancai Y. (2023). “Effectiveness evaluation of cooperative reconnaissance between electronic signal reconnaissance equipment and sar,” in 2023 IEEE International Conference on Control, Electronics and Computer Technology (ICCECT) (Jilin: IEEE), 473 – 477.
- Kumar Singh K., Jae Lee Y. (2017). “Hide-and-seek: Forcing a network to be meticulous for weakly-supervised object and action localization,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV) (Venice: IEEE), 3524 – 3533.
- Li J., Liu Z., Liu S., Wang H. (2025). MBSSNet: A mamba-based joint semantic segmentation network for optical and sar images. IEEE Geosci. Remote Sens. Letters 22, 1 – 5. doi: doi:10.1109/LGRS.2025.3541895
- Li Y., Du L., Wei D. (2022). Multiscale CNN based on component analysis for sar atr. IEEE Trans. Geosci. Remote Sens. 60, 1 – 12. doi: doi:10.1109/TGRS.2021.3100137
- Lin H., Zhuang Y., Huang Y., Ding X. (2022). Self-supervised sar despeckling powered by implicit deep denoiser prior. IEEE Geosci. Remote Sens. Letters 19, 1 – 5. doi: doi:10.1109/LGRS.2022.3212078
- Liu P., Pan Z., Lei B., Hu Y. (2024). Itnet: Low-shot instance transformation network for weakly supervised object detection in remote sensing images. IEEE Trans. Geosci. Remote Sens. 62, 1 – 13. doi: doi:10.1109/TGRS.2024.3354999
- Liu Y., Tian Y., Zhao Y., Yu H., Xie L., Wang Y.. (2024). VMamba: Visual state space model. Adv. Neural Inf. Process. Syst. 37, 103031 – 103063. doi: doi:10.52202/079017-3273
- Ma J., Li F., Wang B. (2024). U-Mamba: Enhancing long-range dependency for biomedical image segmentation. arXiv [preprint] arXiv:2401.04722. doi: doi:10.48550/arXiv.2401.04722
- Mehta H., Gupta A., Cutkosky A., Neyshabur B. (2022). Long range language modeling via gated state spaces. arXiv [preprint] arXiv:2206.13947. doi: doi:10.48550/arXiv.2206.13947
- Min R., Lan H., Cao Z., Cui Z. (2019). A gradually distilled CNN for sar target recognition. IEEE Access 7, 42190 – 42200. doi: doi:10.1109/ACCESS.2019.2906564
- Nguyen E., Goel K., Gu A., Downs G., Shah P., Dao T.. (2022). S4nd: Modeling images and videos as multidimensional signals with state spaces. Adv. Neural Inf. Process. Syst. 35, 2846 – 2861. doi: doi:10.52202/068431-0206
- Pan L., Song X., Xie F., Zhang X., Ji H., Shi Z. (2025). M3-cr: Multiscale multibranch mamba for sar-assisted optical image thick cloud removal. IEEE Trans. Geosci. Remote Sens. 63, 1 – 12. doi: doi:10.1109/TGRS.2025.3566088
- Ramaswamy H. G., Desai S. (2020). “Ablation-CAM: Visual explanations for deep convolutional network via gradient-free localization,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) (Snowmass, CO: IEEE), 983 – 991.
- Selvaraju R. R., Cogswell M., Das A., Vedantam R., Parikh D., Batra D. (2017). “Grad-CAM: Visual explanations from deep networks via gradient-based localization,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV) (Venice: IEEE), 618 – 626.
- Shang Y., Pu W., Huang Y., Wu J., Zhang Y., Yang J. (2024). “Ship ATR in high resolution SAR images via convolutional transformer,” in IGARSS 2024 - 2024 IEEE International Geoscience and Remote Sensing Symposium (Athens: IEEE), 9640 – 9643.
- Sun X., Fu Y., Zhang W., Yang W., Yu R., Zhang F. (2022). “Multi-channel sar moving target detection by integrating stap and faster R-CNN,” in 2022 7th International Conference on Signal and Image Processing (ICSIP) (Suzhou: IEEE), 327 – 332.
- Tan M., Le Q. E. (2019). “Rethinking model scaling for convolutional neural networks,” in Proceedings of the International Conference on Machine Learning (Long Beach, CA).
- Tu H., Wang W., Guo Y., Chen S. (2025). Mamba-UDA: Mamba unsupervised domain adaptation for SAR ship detection. IEEE Geosci. Remote Sens. Letters 22: 1. doi: doi:10.1109/LGRS.2025.3595843
- Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A. N.. (2017). “Attention is all you need,”9D in Advances in Neural Information Processing Systems, volume 30 (Red Hook, NY: Curran Associates, Inc.).
- Wang C., Huang Y., Liu X., Pei J., Zhang Y., Yang J. (2022). Global in local: A convolutional transformer for sar atr fsl. IEEE Geosci. Remote Sens. Letters 19, 1 – 5. doi: doi:10.1109/LGRS.2022.3183467
- Wang H., Wang Z., Du M., Yang F., Zhang Z., Ding S.. (2020). “Score-CAM: Score-weighted visual explanations for convolutional neural networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPR) (Seattle, WA: IEEE), 24 – 25.
- Wang J., Li W., Zhang M., Tao R., Chanussot J. (2023a). Remote-sensing scene classification via multistage self-guided separation network. IEEE Trans. Geosci. Remote Sens. 61, 1 – 12. doi: doi:10.1109/TGRS.2023.3295797
- Wang J., Yan J. N., Gu A., Rush A. M. (2022). Pretraining without attention. arXiv [preprint] arXiv:2212.10544. doi: doi:10.18653/v1/2023.findings-emnlp.5
- Wang J., Zhu W., Wang P., Yu X., Liu L., Omar M.. (2023b). “Selective structured state-spaces for long-form video understanding,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (Las Vegas, NV: IEEE), 6387 – 6397.
- Wang M., Zhang J., Deng K., Hua F. (2022). Combining optimized sar-sift features and rd model for multisource sar image registration. IEEE Trans. Geosci. Remote Sens. 60, 1 – 16. doi: doi:10.1109/TGRS.2021.3074630
- Wang Y., Zhang Y., Qu H., Tian Q. (2018). “Target detection and recognition based on convolutional neural network for sar image,” in 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), 1 – 5.
- Xiong W., Xiong Z., Yao L., Cui Y. (2024). Cog-net: A cognitive network for fine-grained ship classification and retrieval in remote sensing images. IEEE Trans. Geosci. Remote Sens. 62, 1 – 17. doi: doi:10.1109/TGRS.2024.3360976
- Xiong X., Zhang X., Jiang W., Liu L., Liu Y., Liu T. (2025). SAR-GTR: Attributed scattering information guided sar graph transformer recognition algorithm for consumer-grade low-altitude economy. IEEE Trans. Consumer Elect. 71, 8674 – 8686. doi: doi:10.1109/TCE.2025.3586944
- Xu X., Zhang T., Zhang X., Zhang W., Ke X., Zeng T. (2025). Mambashadowdet: A high-speed and high-accuracy moving target shadow detection network for video sar. Remote Sens. 17: 214. doi: doi:10.3390/rs17020214
- Xu Y., Lang H. (2020). Distribution shift metric learning for fine-grained ship classification in sar images. IEEE J. Select. Topics Appl. Earth Observat. Remote Sens. 13, 2276 – 2285. doi: doi:10.1109/JSTARS.2020.2991784
- Yang Y., Zou J., Huang Y., Wu Z., Fang T., Xue J.. (2025). Investigating the earliest identifiable timing of sugarcane at early season based on optical and sar time-series data. Remote Sens. 17: 2773. doi: doi:10.3390/rs17162773
- Zhang K., Lv X., Chai H., Yao J. (2022). Unsupervised sar image change detection for few changed area based on histogram fitting error minimization. IEEE Trans. Geosci. Remote Sens. 60, 1 – 19. doi: doi:10.1109/TGRS.2022.3190977
- Zhang Z., Zhang L., Wu J., Guo W. (2024). Optical and synthetic aperture radar image fusion for ship detection and recognition: Current state, challenges, and future prospects. IEEE Geosci. Remote Sens. Magazine 12, 132 – 168. doi: doi:10.1109/MGRS.2024.3404506
- Zhao Y., Gong M., Qin A. K., Zhang M., Hu Z., Gao T.. (2024). Gradient-guided multiscale focal attention network for remote sensing scene classification. IEEE Trans. Geosci. Remote Sens. 62, 1 – 18. doi: doi:10.1109/TGRS.2024.3424489
- Zhao Y., Li H., Gong M., Wang Y., Luo T. (2025). Incorporating difference information into curriculum learning for multitemporal image classification. Expert Syst. Appl. 276: 127070. doi: doi:10.1016/j.eswa.2025.127070
- Zheng J., Liang P., Zhao H., Deng W. (2024). A broad sparse fine-grained image classification model based on dictionary selection strategy. IEEE Trans. Reliabil. 73, 576 – 588. doi: doi:10.1109/TR.2023.3309278
- Zhou B., Khosla A., Lapedriza A., Oliva A., Torralba A. (2016). “Learning deep features for discriminative localization,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Las Vegas, NV: IEEE), 2921 – 2929.
- Zhu L., Liao B., Zhang Q., Wang X., Liu W., Wang X. (2024). Vision mamba: Efficient visual representation learning with bidirectional state space model. arXiv [preprint] arXiv:2401.09417. doi: doi:10.48550/arXiv.2401.09417
Citation
Zou, K., et al. (2026). Interpretable vision mamba for SAR images classification. Frontiers in Neurorobotics, Volume 20. https://doi.org/
- Received
- Accepted
- Published
- Volume
- 20 - 2026
Copyright
Copyright © 2026 Zou, He, Yao, Li and Wang.
License: https://creativecommons.org/licenses/by/4.0/
*Correspondence: Ningbo He
Article metrics
- Views
- 0
- Downloads
- 0
- Citations
- 0
- Shares
- 0
