
Fig. 4. Architecture of COP-Net (Cross-scale Overlapping Patch-based Network).
Fig. 4 illustrates the architecture of COP-Net, starting with
the model using ResNet [7] as the backbone to obtain features.
Then, through the SCA (Scale-aware Channel Attention)
module, the feature maps of different channels are weighted.
Next, using the PCA (Patch-based Cross-scale Attention)
Module, the feature maps are divided into different patches.
Through different scales of feature maps and self-attention,
these feature maps undergo Query, Key, Value weighting to
obtain more discriminative feature maps. Finally, AAC
detection is performed using a 1x1 convolution mechanism,
detecting the calcified pixel positions and generating a
heatmap of the abdominal aorta AAC. The classification of
abdominal aortic X-ray images and calculation of the
calcification score are done using a three-layer Fully-
Connected Network (or Multiple-Layer Perceptron), with the
images outputting three categories representing no
calcification, calcification on one side of the vessels, and
calcification on both sides of the vessels.
We adopted ResNet18 [7] as the feature extraction module
and experimented with various attention modules, including
CBAM [8], SimAM [9], and Shuffle Attention(SA) [10],
among others. These attention modules significantly enhance
the discriminative ability of the backbone network for AAC
classification. Fig. 5 shows our method for AAC classification,
dividing a segment of the patient's spine corresponding to
vascular X-ray images into three types of grading results. The
results are shown in Figure 6. Table I demonstrates the
performance of these three attention modules. Upon
examination, we found that although both SimAM [9] and
CBAM [8] aim to enhance the model's feature discriminative
power, their performance in this task was slightly inferior to
that of ResNet18 [7]. This result could be attributed to several
factors. First, the SimAM [9]and CBAM [8] attention module
may cause the model to overly focus on channel features while
neglecting spatial information, which is crucial for the
detection of vascular calcification. The introduction of the
Shuffle Attention (SA) [10] module, which combines spatial
and channel attention mechanisms, enhances feature
representation by rearranging feature channels and spatial
attention to facilitate cross-channel information exchange.
When calculating the calcification score for AAC, there
can be individual calcifications on the posterior wall (PW) and
anterior wall (AW). Without separating the inputs into PW
and AW, the classifier can become confused. To further
increase the accuracy of the previous classification model, we
divided the input into three parts: FS (Full-Size) for the entire
image, PW (Posterior Wall) portion, and AW (Anterior wall)
portion. The model outputs four categories: no calcification,
AW calcification, PW calcification, and calcification on both
sides of the vessels. This approach has two advantages: 1.
More discriminative features: Since the scoring items are
composed of AW and PW, inputting them separately provides
the model with additional information. 2. Finer classification:
The classification task becomes four categories, which allows
for the assessment of calcification in AW and PW individually
(secondary tasks), thereby enhancing the accuracy of the
model's classifications. Fig. 6 is the flowchart of this method,
and Table II shows the accuracy of calcification score
calculations for this method. Compared to Table I, there is a
significant improvement in accuracy, and the highest accuracy
is achieved when the SimAM [9] attention mechanism is
employed.
Fig. 5. Single abdominal aortic section images as input features.
Fig. 6. Classification results of AAC score for aortic area corresponding to
a single spinal segment.
Indeed, we can design a network architecture to detect the
situation of abdominal aortic calcification and then use this
calcification condition as a basis for feature weighting. We use
a COP-Net (Cross-scale Overlapping Patch-based Network),
which outputs the condition of aortic calcification into a
feature heatmap. The core of COP-Net lies in its two
4. Experiments and Results
International Journal of Applied Sciences & Development
DOI: 10.37394/232029.2024.3.17
Chung-Kuan Wu, Che-Yu Chiang, Jun-Wei Hsieh