← Search

Table · dataset · 2026

<p>Comparison of representative attention modules.</p>

Listed in figshare

<div><p>Attention mechanisms improve convolutional neural networks (CNNs) by emphasizing informative features, but many existing modules introduce additional parameters, convolutional or fully connected layers, and non-negligible computational overhead.

Description

These costs may limit their use in lightweight or plug-and-play CNN architectures. To address this issue, this paper proposes a parameter-free spatial attention fusion module (PSAFM).

Specifically, the pointwise average- and max-pooling branches are combined by deterministic weighted fusion, after which channel statistics and a Tanh activation are used to compute adaptive three-dimensional attention weights. This enables the module to strengthen feature responses without adding trainable parameters. We evaluate PSAFM on CIFAR-10 and CIFAR-100 using ResNet, Pre-ResNet, and MobileNetV2 backbones.

Read the rest (2 more)

On CIFAR-10, PSAFM achieves the best accuracy in 8 of 9 tested backbone settings and improves the original backbones by 0.32 to 1.81 percentage points. On CIFAR-100, PSAFM achieves the best accuracy in 6 of 9 settings and improves the original backbones by 0.05 to 1.68 percentage points. In these experiments, PSAFM is compared with representative attention modules.

The results show that its parameter count remains essentially unchanged and that only a small FLOPs overhead is introduced. In other words, when model compactness is important, PSAFM is a simple and efficient attention module that improves CNN feature representation.</p></div>

Links

Where it is published

Catalogue records · 1

Topics

Inferred from text
Machine learning 69%
Provenance · 1 source records, 18 field assertions
SourceKeyLast seenRaw
figshareoai:figshare.com:article/3381419411 d agoJSON v1
FieldAssertionExtractorEvidence
access_levelsource · figshare comconnector:figshare_com@1.0.0
concepts[field].anzsrc:group:4611enrichment · figshare comtaxonomy-embedding@1.0.0title+keywords+description (69%)
concepts[field].local:field:astronomymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:chemistrymapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:computer-science-aimapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:earth-environmentalmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:economics-financemapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:engineeringmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:humanitiesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:life-sciencesmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:mathematics-statisticsmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:medicine-healthmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:ocean-atmosphericmapping · figshare comconnector:figshare_com@1.0.0
concepts[field].local:field:social-sciencemapping · figshare comconnector:figshare_com@1.0.0
descriptionsource · figshare comconnector:figshare_com@1.0.0/metadata/dc/description
licensesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/rights
publication_datesource · figshare comconnector:figshare_com@1.0.0
titlesource · figshare comconnector:figshare_com@1.0.0/metadata/dc/title