0
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Ultrasound image denoising autoencoder model based on lightweight attention mechanism

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Background

          The presence of noise in medical ultrasound images significantly degrades image quality and affects the accuracy of disease diagnosis. The convolutional neural network–denoising autoencoder (CNN-DAE) model extracts feature information by stacking regularly sized kernels. This results in the loss of texture detail, the over-smoothing of the image, and a lack of generalizability for speckle noise.

          Methods

          A lightweight attention denoise-convolutional neural network (LAD-CNN) is proposed in the present study. Two different lightweight attention blocks (i.e., the lightweight channel attention (LCA) block and the lightweight large-kernel attention (LLA) block are concatenated into the downsampling stage and the upsampling stage, respectively. A skip connection is included before the upsampling layer to alleviate the problem of gradient vanishing during backpropagation. The effectiveness of our model was evaluated using both subjective visual effects and objective evaluation metrics.

          Results

          With the highest peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) values at all noise levels, the proposed model outperformed the other models. In the test of brachial plexus ultrasound images, the average PSNR of our model was 0.15 higher at low noise levels and 0.33 higher at high noise levels than the suboptimal model. In the test of fetal ultrasound images, the average PSNR of our model was 0.23 higher at low noise levels and 0.20 higher at high noise levels than the suboptimal model. The statistical analysis showed that the p values were less than 0.05, which indicated a statistically significant difference between our model and the other models.

          Conclusions

          The results of this study suggest that the proposed LAD-CNN model is more efficient in denoising and preserving image details than both conventional denoising algorithms and existing deep-learning algorithms.

          Related collections

          Most cited references23

          • Record: found
          • Abstract: not found
          • Article: not found

          Image Quality Assessment: From Error Visibility to Structural Similarity

            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Squeeze-and-Excitation Networks

            The central building block of convolutional neural networks (CNNs) is the convolution operator, which enables networks to construct informative features by fusing both spatial and channel-wise information within local receptive fields at each layer. A broad range of prior research has investigated the spatial component of this relationship, seeking to strengthen the representational power of a CNN by enhancing the quality of spatial encodings throughout its feature hierarchy. In this work, we focus instead on the channel relationship and propose a novel architectural unit, which we term the "Squeeze-and-Excitation" (SE) block, that adaptively recalibrates channel-wise feature responses by explicitly modelling interdependencies between channels. We show that these blocks can be stacked together to form SENet architectures that generalise extremely effectively across different datasets. We further demonstrate that SE blocks bring significant improvements in performance for existing state-of-the-art CNNs at minimal additional computational cost. Squeeze-and-Excitation Networks formed the foundation of our ILSVRC 2017 classification submission which won first place and reduced the top-5 error to 2.251%, surpassing the winning entry of 2016 by a relative improvement of ∼25%. Models and code are available at https://github.com/hujie-frank/SENet.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising.

              The discriminative model learning for image denoising has been recently attracting considerable attentions due to its favorable denoising performance. In this paper, we take one step forward by investigating the construction of feed-forward denoising convolutional neural networks (DnCNNs) to embrace the progress in very deep architecture, learning algorithm, and regularization method into image denoising. Specifically, residual learning and batch normalization are utilized to speed up the training process as well as boost the denoising performance. Different from the existing discriminative denoising models which usually train a specific model for additive white Gaussian noise at a certain noise level, our DnCNN model is able to handle Gaussian denoising with unknown noise level (i.e., blind Gaussian denoising). With the residual learning strategy, DnCNN implicitly removes the latent clean image in the hidden layers. This property motivates us to train a single DnCNN model to tackle with several general image denoising tasks, such as Gaussian denoising, single image super-resolution, and JPEG image deblocking. Our extensive experiments demonstrate that our DnCNN model can not only exhibit high effectiveness in several general image denoising tasks, but also be efficiently implemented by benefiting from GPU computing.
                Bookmark

                Author and article information

                Journal
                Quant Imaging Med Surg
                Quant Imaging Med Surg
                QIMS
                Quantitative Imaging in Medicine and Surgery
                AME Publishing Company
                2223-4292
                2223-4306
                10 April 2024
                01 May 2024
                : 14
                : 5
                : 3557-3571
                Affiliations
                [1 ]deptSchool of Energy and Power Engineering , University of Shanghai for Science and Technology , Shanghai, China;
                [2 ]deptKey Laboratory of Power Machinery and Engineering of Ministry of Education , Shanghai Jiao Tong University , Shanghai, China;
                [3 ]Shanghai Key Laboratory of Multiphase Flow and Heat Transfer in Power Engineering , Shanghai, China;
                [4 ]deptInstitute of Pediatric Translational Medicine, Shanghai Children’s Medical Center, School of Medicine , Shanghai Jiao Tong University , Shanghai, China;
                [5 ]deptShanghai Engineering Research Center of Virtual Reality of Structural Heart Disease, Shanghai Children’s Medical Center, School of Medicine , Shanghai Jiao Tong University , Shanghai, China;
                [6 ]deptShanghai Institute for Pediatric Congenital Heart Disease, Shanghai Children’s Medical Center, School of Medicine , Shanghai Jiao Tong University , Shanghai, China
                Author notes

                Contributions: (I) Conception and design: L Shi, W Di; (II) Administrative support: L Shi, J Liu; (III) Provision of study materials or patients: J Liu; (IV) Collection and assembly of data: W Di; (V) Data analysis and interpretation: L Shi, W Di; (VI) Manuscript writing: All authors; (VII) Final approval of manuscript: All authors.

                Correspondence to: Liuliu Shi, PhD. School of Energy and Power Engineering, University of Shanghai for Science and Technology, 516 Jungong Rd., Shanghai 200093, China; Key Laboratory of Power Machinery and Engineering of Ministry of Education, Shanghai Jiao Tong University, 800 Dongchuan Rd., Shanghai 200240, China; Shanghai Key Laboratory of Multiphase Flow and Heat Transfer in Power Engineering, 516 Jungong Rd., Shanghai 200093, China. Email: shiliuliu@ 123456usst.edu.cn .
                Article
                qims-14-05-3557
                10.21037/qims-23-1654
                11074761
                38720841
                bfed4cdb-dcaa-47df-b8bd-83a527858a75
                2024 Quantitative Imaging in Medicine and Surgery. All rights reserved.

                Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0.

                History
                : 21 November 2023
                : 08 March 2024
                Funding
                Funded by: the National Natural Science Foundation of China
                Award ID: No. 12172227
                Categories
                Original Article

                ultrasound image denoising,deep learning,speckle noise,attention mechanism

                Comments

                Comment on this article