{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,10]],"date-time":"2026-05-10T15:05:50Z","timestamp":1778425550542,"version":"3.51.4"},"reference-count":63,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T00:00:00Z","timestamp":1709856000000},"content-version":"vor","delay-in-days":7,"URL":"https:\/\/2.zoppoz.workers.dev:443\/http\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T00:00:00Z","timestamp":1709856000000},"content-version":"tdm","delay-in-days":7,"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["R21AG070331"],"award-info":[{"award-number":["R21AG070331"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Limited access to breast cancer diagnosis globally leads to delayed treatment. Ultrasound, an effective yet underutilized method, requires specialized training for sonographers, which hinders its widespread use. Volume sweep imaging (VSI) is an innovative approach that enables untrained operators to capture high-quality ultrasound images. Combined with deep learning, like convolutional neural networks, it can potentially transform breast cancer diagnosis, enhancing accuracy, saving time and costs, and improving patient outcomes. The widely used UNet architecture, known for medical image segmentation, has limitations, such as vanishing gradients and a lack of multi-scale feature extraction and selective region attention. In this study, we present a novel segmentation model known as Wavelet_Attention_UNet (WATUNet). In this model, we incorporate wavelet gates and attention gates between the encoder and decoder instead of a simple connection to overcome the limitations mentioned, thereby improving model performance. Two datasets are utilized for the analysis: the public \u2018Breast Ultrasound Images\u2019 dataset of 780 images and a private VSI dataset of 3818 images, captured at the University of Rochester by the authors. Both datasets contained segmented lesions categorized into three types: no mass, benign mass, and malignant mass. Our segmentation results show superior performance compared to other deep networks. The proposed algorithm attained a Dice coefficient of 0.94 and an F1 score of 0.94 on the VSI dataset and scored 0.93 and 0.94 on the public dataset, respectively. Moreover, our model significantly outperformed other models in McNemar\u2019s test with false discovery rate correction on a 381-image VSI set. The experimental findings demonstrate that the proposed WATUNet model achieves precise segmentation of breast lesions in both standard-of-care and VSI images, surpassing state-of-the-art models. Hence, the model holds considerable promise for assisting in lesion identification, an essential step in the clinical diagnosis of breast lesions.<\/jats:p>","DOI":"10.1088\/2632-2153\/ad2e15","type":"journal-article","created":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T22:21:51Z","timestamp":1709158911000},"page":"015042","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["WATUNet: a deep neural network for segmentation of volumetric sweep imaging ultrasound"],"prefix":"10.1088","volume":"5","author":[{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0009-0004-0430-8341","authenticated-orcid":true,"given":"Donya","family":"Khaledyan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas J","family":"Marini","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Avice","family":"O\u2019Connell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Steven","family":"Meng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonah","family":"Kan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Galen","family":"Brennan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy M","family":"Baran","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-6313-6605","authenticated-orcid":true,"given":"Kevin J","family":"Parker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2024,3,8]]},"reference":[{"key":"mlstad2e15bib1","doi-asserted-by":"publisher","first-page":"394","DOI":"10.3322\/caac.21492","article-title":"Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries","volume":"68","author":"Bray","year":"2018","journal-title":"CA Cancer J Clin."},{"key":"mlstad2e15bib2","first-page":"1","article-title":"Breast cancer facts & figures 2019\u20132020","author":"Society","year":"2019","journal-title":"Am. Cancer Soc."},{"key":"mlstad2e15bib3","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1097\/RUQ.0000000000000626","article-title":"Assessment of a brief standardized obstetric ultrasound training program for individuals without prior ultrasound experience","volume":"39","author":"Erlick","year":"2022","journal-title":"Ultrasound Q."},{"key":"mlstad2e15bib4","doi-asserted-by":"publisher","first-page":"817","DOI":"10.1002\/jum.16047","article-title":"Breast ultrasound volume sweep imaging: a new horizon in expanding imaging access for breast cancer detection","volume":"42","author":"Marini","year":"2023","journal-title":"J. Ultrasound Med."},{"key":"mlstad2e15bib5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000148","article-title":"No sonographer, no radiologist: assessing accuracy of artificial intelligence on breast ultrasound volume sweep imaging scans","volume":"1","author":"Marini","year":"2022","journal-title":"PLOS Digit. Health"},{"key":"mlstad2e15bib6","doi-asserted-by":"publisher","first-page":"2699","DOI":"10.1007\/s40618-021-01584-7","article-title":"Testing telediagnostic thyroid ultrasound in Peru: a new horizon in expanding access to imaging in rural and underserved areas","volume":"44","author":"Marini","year":"2021","journal-title":"J. Endocrinol. Invest."},{"key":"mlstad2e15bib7","doi-asserted-by":"publisher","first-page":"35","DOI":"10.25259\/JCIS_29_2019","article-title":"Lung ultrasound volume sweep imaging for pneumonia detection in rural areas: piloting training in rural Peru","volume":"9","author":"Marini","year":"2019","journal-title":"J. Clin. Imaging Sci."},{"key":"mlstad2e15bib8","first-page":"2622","article-title":"New tele-diagnostic model using volume sweep imaging for rural areas","author":"Ferrer","year":"2017"},{"key":"mlstad2e15bib9","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2022-061332","article-title":"Volume sweep imaging lung teleultrasound for detection of COVID-19 in Peru: a multicentre pilot study","volume":"12","author":"Marini","year":"2022","journal-title":"BMJ open"},{"key":"mlstad2e15bib10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0255919","article-title":"Testing telediagnostic right upper quadrant abdominal ultrasound in Peru: a new horizon in expanding access to imaging in rural and underserved areas","volume":"16","author":"Marini","year":"2021","journal-title":"PLoS One"},{"key":"mlstad2e15bib11","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41746-021-00438-z","article-title":"Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis","volume":"4","author":"Aggarwal","year":"2021","journal-title":"npj Digit. Med."},{"key":"mlstad2e15bib12","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2022.104855","article-title":"Artificial intelligence and its impact on the domains of universal health coverage, health emergencies and health promotion: an overview of systematic reviews","volume":"166","author":"Martinez-Millana","year":"2022","journal-title":"Int. J. Med. Inform."},{"key":"mlstad2e15bib13","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2020.104284","article-title":"Improving the performance of CNN to predict the likelihood of COVID-19 using chest x-ray images with preprocessing algorithms","volume":"144","author":"Heidari","year":"2020","journal-title":"Int. J. Med. Inform."},{"key":"mlstad2e15bib14","first-page":"1","article-title":"Deep learning denoising for EOG artifacts removal from EEG signals","author":"Mashhadi","year":"2020"},{"key":"mlstad2e15bib15","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1117\/12.2582753","article-title":"Applying a new feature fusion method to classify breast lesions","volume":"11597","author":"Mashhadi","year":"2021","journal-title":"Proc. SPIE"},{"key":"mlstad2e15bib16","article-title":"Confidence aware neural networks for skin cancer detection","author":"Khaledyan","year":"2021"},{"key":"mlstad2e15bib17","first-page":"1","article-title":"An approach to human iris recognition using quantitative analysis of image features and machine learning","author":"Khuzani","year":"2020"},{"key":"mlstad2e15bib18","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1007\/s13735-017-0141-z","article-title":"A review of semantic segmentation using deep neural networks","volume":"7","author":"Guo","year":"2018","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"mlstad2e15bib19","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s13735-020-00195-x","article-title":"A survey on instance segmentation: state of the art","volume":"9","author":"Hafiz","year":"2020","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"mlstad2e15bib20","first-page":"9404","article-title":"Panoptic segmentation","author":"Kirillov","year":"2019"},{"key":"mlstad2e15bib21","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0262107","article-title":"No sonographer, no radiologist: new system for automatic prenatal detection of fetal biometry, fetal presentation, and placental location","volume":"17","author":"Arroyo","year":"2022","journal-title":"PLoS One"},{"key":"mlstad2e15bib22","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"mlstad2e15bib23","first-page":"1","article-title":"A practical method for pupil segmentation in challenging conditions","author":"Khaledyan","year":"2020"},{"key":"mlstad2e15bib24","doi-asserted-by":"publisher","first-page":"1452","DOI":"10.1109\/TPAMI.2004.110","article-title":"Statistical region merging","volume":"26","author":"Nock","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"mlstad2e15bib25","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1016\/j.procs.2015.06.090","article-title":"Image segmentation using K-means clustering algorithm and subtractive clustering algorithm","volume":"54","author":"Dhanachandra","year":"2015","journal-title":"Proc. Comput. Sci."},{"key":"mlstad2e15bib26","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1007\/BF00133570","article-title":"Snakes: active contour models","volume":"1","author":"Kass","year":"1988","journal-title":"Int. J. Comput. Vis."},{"key":"mlstad2e15bib27","doi-asserted-by":"publisher","first-page":"1222","DOI":"10.1109\/34.969114","article-title":"Fast approximate energy minimization via graph cuts","volume":"23","author":"Boykov","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"mlstad2e15bib28","first-page":"817","article-title":"Multi-class image segmentation using conditional random fields and global classification","author":"Plath","year":"2009"},{"key":"mlstad2e15bib29","first-page":"580","article-title":"Rich feature hierarchies for accurate object detection and semantic segmentation","author":"Girshick","year":"2014"},{"key":"mlstad2e15bib30","first-page":"1520","article-title":"Learning deconvolution network for semantic segmentation","author":"Noh","year":"2015"},{"key":"mlstad2e15bib31","doi-asserted-by":"publisher","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: a deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"mlstad2e15bib32","doi-asserted-by":"publisher","first-page":"66","DOI":"10.2991\/ijcis.d.200120.002","article-title":"RunPool: a dynamic pooling layer for convolution neural network","volume":"13","author":"Jie","year":"2020","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"mlstad2e15bib33","first-page":"234","article-title":"U-Net: convolutional networks for biomedical image segmentation","author":"Ronneberger","year":"2015"},{"key":"mlstad2e15bib34","first-page":"3","article-title":"UNet++: a nested U-Net architecture for medical image segmentation","author":"Zhou","year":"2018"},{"key":"mlstad2e15bib35","doi-asserted-by":"publisher","first-page":"1856","DOI":"10.1109\/TMI.2019.2959609","article-title":"UNet++: redesigning skip connections to exploit multiscale features in image segmentation","volume":"39","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"mlstad2e15bib36","first-page":"1055","article-title":"UNet 3+: a full-scale connected UNet for medical image segmentation","author":"Huang","year":"2020"},{"key":"mlstad2e15bib37","first-page":"327","article-title":"Weighted Res-UNet for high-quality retina vessel segmentation","author":"Xiao","year":"2018"},{"key":"mlstad2e15bib38","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104699","article-title":"Sharp U-Net: depthwise convolutional network for biomedical image segmentation","volume":"136","author":"Zunair","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"mlstad2e15bib39","article-title":"Attention U-Net: learning where to look for the pancreas","author":"Oktay","year":"2018"},{"key":"mlstad2e15bib40","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0289195","article-title":"Enhancing breast ultrasound segmentation through fine-tuning and optimization techniques: sharp attention UNet","volume":"18","author":"Khaledyan","year":"2023","journal-title":"PLoS One"},{"key":"mlstad2e15bib41","doi-asserted-by":"publisher","DOI":"10.1016\/j.dib.2019.104863","article-title":"Dataset of breast ultrasound images","volume":"28","author":"Al-Dhabyani","year":"2020","journal-title":"Data Brief"},{"key":"mlstad2e15bib42","first-page":"1","article-title":"Image quality enhancement in wireless capsule endoscopy with adaptive fraction gamma transformation and unsharp masking filter","author":"Ezatian","year":"2020"},{"key":"mlstad2e15bib43","first-page":"1","article-title":"Low-cost implementation of bilinear and bicubic image interpolation for real-time image super-resolution","author":"Khaledyan","year":"2020"},{"key":"mlstad2e15bib44","doi-asserted-by":"publisher","DOI":"10.1101\/2023.07.14.549040","article-title":"Enhancing breast ultrasound segmentation through fine-tuning and optimization techniques: sharp attention UNet","author":"Khaledyan","year":"2023","journal-title":"bioRxiv Preprint"},{"key":"mlstad2e15bib45","first-page":"474","article-title":"Contrast limited adaptive histogram equalization","author":"Zuiderveld","year":"1994"},{"key":"mlstad2e15bib46","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1016\/S0734-189X(87)80186-X","article-title":"Adaptive histogram equalization and its variations","volume":"39","author":"Pizer","year":"1987","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"mlstad2e15bib47","first-page":"29","article-title":"Artifacts in diagnostic ultrasound","author":"Hindi","year":"2013","journal-title":"Rep. Med. Imaging"},{"key":"mlstad2e15bib48","first-page":"1050","article-title":"Dropout as a Bayesian approximation: representing model uncertainty in deep learning","author":"Gal","year":"2016"},{"key":"mlstad2e15bib49","doi-asserted-by":"publisher","first-page":"82031","DOI":"10.1109\/ACCESS.2021.3086020","article-title":"U-Net and its variants for medical image segmentation: a review of theory and applications","volume":"9","author":"Siddique","year":"2021","journal-title":"IEEE Access"},{"key":"mlstad2e15bib50","first-page":"65","article-title":"Theory of the backpropagation neural network","author":"Hecht-Nielsen","year":"1992"},{"key":"mlstad2e15bib51","first-page":"p 31","article-title":"Which neural net architectures give rise to exploding and vanishing gradients?","author":"Hanin","year":"2018"},{"key":"mlstad2e15bib52","article-title":"Overcoming the vanishing gradient problem in plain recurrent networks","author":"Hu","year":"2018"},{"key":"mlstad2e15bib53","first-page":"79","article-title":"The Haar-wavelet transform in digital image processing: its status and achievements","volume":"13","author":"Porwik","year":"2004","journal-title":"Mach. Graph. Vis."},{"key":"mlstad2e15bib54","doi-asserted-by":"publisher","first-page":"3279","DOI":"10.1109\/TKDE.2021.3126456","article-title":"A general survey on attention mechanisms in deep learning","volume":"35","author":"Brauwers","year":"2021","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"mlstad2e15bib55","doi-asserted-by":"crossref","DOI":"10.21203\/rs.3.rs-510910\/v1","article-title":"Attention mechanisms and deep learning for machine vision: a survey of the state of the art","author":"Hafiz","year":"2021"},{"key":"mlstad2e15bib56","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/D15-1166","article-title":"Effective approaches to attention-based neural machine translation","author":"Luong","year":"2015"},{"key":"mlstad2e15bib57","article-title":"Swish: a self-gated activation function","author":"Ramachandran","year":"2017"},{"key":"mlstad2e15bib58","article-title":"How do vision transformers work?","author":"Park","year":"2022"},{"key":"mlstad2e15bib59","author":"Daubechies","year":"1992"},{"key":"mlstad2e15bib60","first-page":"499","article-title":"Image processing by using different types of discrete wavelet transform","author":"Thakral","year":"2019"},{"key":"mlstad2e15bib61","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/99.388960","article-title":"An introduction to wavelets","volume":"2","author":"Graps","year":"1995","journal-title":"IEEE Comput. Sci. Eng."},{"key":"mlstad2e15bib62","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1080\/01621459.1961.10482090","article-title":"Multiple comparisons among means","volume":"56","author":"Dunn","year":"1961","journal-title":"J. Am. Stat. Assoc."},{"key":"mlstad2e15bib63","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. B"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,8]],"date-time":"2024-03-08T08:39:01Z","timestamp":1709887141000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2e15"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":63,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3,8]]},"published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.1088\/2632-2153\/ad2e15","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,1]]},"assertion":[{"value":"WATUNet: a deep neural network for segmentation of volumetric sweep imaging ultrasound","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-10-03","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-02-28","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-03-08","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}