*Result*: Inter- and Intra-Operator Variability of Regularized Backscatter Quantitative Ultrasound for the Characterization of Breast Masses.

Title:
Inter- and Intra-Operator Variability of Regularized Backscatter Quantitative Ultrasound for the Characterization of Breast Masses.
Authors:
Argueta-Lozano AK; Instituto de Física, Universidad Nacional Autónoma de México, Circuito de la Investigación Científica s/n, Ciudad Universitaria, Mexico City, Mexico., Castañeda-Martinez L; Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA., Bass V; Instituto de Ciencias Aplicadas y Tecnología, Universidad Nacional Autónoma de México, Circuito Exterior S/N, Ciudad Universitaria, Mexico City, Mexico., Mateos MJ; Graduate Program in Computer Science and Engineering, Universidad Nacional Autónoma de México, Ciudad Universitaria, Mexico City, Mexico., Castillo-López JP; Instituto Nacional de Cancerología, Mexico City, Mexico., Perez-Badillo MP; Instituto Nacional de Cancerología, Mexico City, Mexico., Aguilar-Cortazar LO; Instituto Nacional de Cancerología, Mexico City, Mexico., Porras-Reyes F; Instituto Nacional de Cancerología, Mexico City, Mexico., Sollozo-Dupont MI; Instituto Nacional de Cancerología, Mexico City, Mexico., Torres-Robles F; Instituto de Física, Universidad Nacional Autónoma de México, Circuito de la Investigación Científica s/n, Ciudad Universitaria, Mexico City, Mexico., Márquez-Flores J; Instituto de Ciencias Aplicadas y Tecnología, Universidad Nacional Autónoma de México, Circuito Exterior S/N, Ciudad Universitaria, Mexico City, Mexico., Villaseñor-Navarro Y; Instituto Nacional de Cancerología, Mexico City, Mexico., Esquivel-Sirvent R; Instituto de Física, Universidad Nacional Autónoma de México, Circuito de la Investigación Científica s/n, Ciudad Universitaria, Mexico City, Mexico., Rosado-Mendez IM; Department of Medical Physics, University of Wisconsin-Madison, Madison, WI, USA.; Department of Radiology, University of Wisconsin-Madison, Madison, WI, USA.
Source:
Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine [J Ultrasound Med] 2023 Nov; Vol. 42 (11), pp. 2567-2582. Date of Electronic Publication: 2023 Jul 25.
Publication Type:
Journal Article
Language:
English
Journal Info:
Publisher: John Wiley and Sons Country of Publication: England NLM ID: 8211547 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1550-9613 (Electronic) Linking ISSN: 02784297 NLM ISO Abbreviation: J Ultrasound Med Subsets: MEDLINE
Imprint Name(s):
Publication: 2017- : Oxford, UK : John Wiley and Sons
Original Publication: [Philadelphia, Pa.] : W.B. Saunders, c1982-
References:
Fetzer DT, Rosado-Mendez IM, Wang M, et al. Pulse-echo quantitative US biomarkers for liver steatosis: toward technical standardization. Radiology 2022; 305:265-276.
Insana MF, Hall TJ, Fishback JL. Identifying acoustic scattering sources in normal renal parenchyma from the anisotropy in acoustic properties. Ultrasound Med Biol 1991; 17:613-626.
Hoerig C, Wallace K, Wu M, Mamou J. Classification of metastatic lymph nodes in vivo using quantitative ultrasound at clinical frequencies. Ultrasound Med Biol 2023; 49:787-801.
Guerrero QW, Feltovich H, Rosado-Mendez IM, Carlson LC, Hallcor TJ. Quantitative ultrasound biomarkers based on backscattered acoustic power: potential for quantifying remodeling of the human cervix during pregnancy. Ultrasound Med Biol 2019; 45:429-439.
Oelze ML. Quantitative ultrasound techniques and improvements to diagnostic ultrasonic imaging. IEEE International Ultrasonics Symposium. 2012; 232-239.
Vajihi Z, Rosado-Mendez IM, Hall TJ, Rivaz H. Low variance estimation of backscatter quantitative ultrasound parameters using dynamic programming. IEEE Trans Ultrason Ferroelectr Freq Control 2018; 65:2042-2053.
Yao LX, Zagzebski JA, Madsen EL. Backscatter coefficient measurements using a reference phantom to extract depth-dependent instrumentation factors. Ultrason Imaging 1990; 12:58-70.
Zagzebski JA, Lu ZF, Yao LX. Quantitative ultrasound imaging: in vivo results in normal liver. Ultrason Imaging 1993; 15:335-351.
Nam K, Rosado-Mendez IM, Wirtzfeld LA, et al. Ultrasonic attenuation and backscatter coefficient estimates of rodent-tumor-mimicking structures: comparison of results among clinical scanners. Ultrason Imaging 2011; 33:233-250.
Golub RM, Parsons RE, Sigel B, et al. Differentiation of breast tumors by ultrasonic tissue characterization. J Ultrasound Med 1993; 12:601-608.
Nam K, Zagzebski JA, Hall TJ. Quantitative assessment of in vivo breast masses using ultrasound attenuation and backscatter. Ultrason Imaging 2013; 35:146-161.
Nasief HG, Rosado-Mendez IM, Zagzebski JA, Hall TJ. Acoustic properties of breast fat. J Ultrasound Med 2015; 34:2007-2016.
Anderson JJ, Herd MT, King MR, et al. Interlaboratory comparison of backscatter coefficient estimates for tissue-mimicking phantoms. Ultrason Imaging 2010; 32:48-64.
Nam K, Rosado-Mendez IM, Wirtzfeld LA, et al. Comparison of ultrasound attenuation and backscatter estimates in layered tissue-mimicking phantoms among three clinical scanners. Ultrason Imaging 2012; 34:209-221.
Nam K, Rosado-Mendez IM, Wirtzfeld LA, et al. Cross-imaging system comparison of backscatter coefficient estimates from a tissue-mimicking material. J Acoust Soc Am 2012; 132:1319-1324.
Percival DB, Walden AT. Spectral Analysis for Physical Applications. Cambridge, UK: Cambridge University Press; 1993.
Samimi K, Varghese T. Performance evaluation of the spectral centroid downshift method for attenuation estimation. IEEE Trans Ultrason Ferroelectr Freq Control 2015; 62:871-880.
Samimi K, Varghese T. Optimum diffraction-corrected frequency-shift estimator of the ultrasonic attenuation coefficient. IEEE Trans Ultrason Ferroelectr Freq Control 2016; 63:691-702.
Samimi K, Varghese T. Lower bound on estimation variance of the ultrasonic attenuation coefficient using the spectral-difference reference-phantom method. Ultrason Imaging 2017; 39:151-171.
Tu H, Varghese T, Madsen EL, Chen Q, Zagzebski JA. Ultrasound attenuation imaging using compound acquisition and processing. Ultrason Imaging 2003; 25:245-261.
Zenteno O, Luchies A, Oelze M, Lavarello R. Improving the quality of attenuation imaging using full angular spatial compounding. IEEE International Ultrasonics Symposium 2014; 2426-2429.
Kim H, Shim J, Heo SW. Improved attenuation estimation of ultrasonic signals using frequency compounding method. J Electri Eng Technol 2018; 13:430-437.
Castañeda-Martinez L. Comparación de algoritmos de estimación de atenuación acústica para Ultrasonido Cuantitativo de cáncer de mama. Tesis Maestría en Ciencias (Física Médica) Julio 2021.
Coila AL, Lavarello R. Regularized spectral log difference technique for ultrasonic attenuation imaging. IEEE Trans Ultrason Ferroelectr Freq Control 2017; 65:378-389.
Labyed Y, Bigelow TA. A theoretical comparison of attenuation measurement techniques from backscattered ultrasound echoes. J Acoust Soc Am 2011; 129:2316-2324.
Romero SE, Coila A, Lavarello RJ. A regularized quantitative ultrasound method for simultaneous calculation of backscatter and attenuation coefficients. In 15th International Symposium on Medical Information Processing and Analysis. 2020; 11330: 220-230.
Nam K, Zagzebski JA, Hall TJ. Simultaneous backscatter and attenuation estimation using a least squares method with constraints. Ultrasound Med Biol 2011; 37:2096-2104.
Jafarpisheh N, Hall TJ, Rivaz H, Rosado-Mendez IM. Analytic global regularized backscatter quantitative ultrasound. IEEE Trans Ultrason Ferroelectr Freq Control 2020; 68:1605-1617.
Jafarpisheh N, Rosado-Mendez IM, Hall TJ, Rivaz H. Evaluation of contrast to noise ratio of parametric images of regularized estimates of quantitative ultrasound. IEEE International Ultrasonics Symposium (IUS) 2020; 1-4.
Jafarpisheh N, Rosado-Mendez IM, Hall TJ, Rivaz H. Regularized estimation of effective scatterer size and acoustic concentration quantitative ultrasound parameters using dynamic programming. 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). 2020; 13-16.
Han A, Andre MP, Erdman JW, Loomba R, Sirlin CB, O'Brien WD. Repeatability and reproducibility of a clinically based QUS phantom study and methodologies. IEEE Trans Ultrason Ferroelectr Freq Control 2017; 64:218-231.
Raunig DL, McShane LM, Pennello G, et al. Quantitative imaging biomarkers: a review of statistical methods for technical performance assessment. Stat Methods Med Res 2015; 24:27-67.
Han A, Labyed Y, Sy EZ, et al. Inter-sonographer reproducibility of quantitative ultrasound outcomes and shear wave speed measured in the right lobe of the liver in adults with known or suspected non-alcoholic fatty liver disease. Eur Radiol 2018; 28:4992-5000.
Han A, Zhang YN, Boehringer AS, et al. Inter-platform reproducibility of ultrasonic attenuation and backscatter coefficients in assessing NAFLD. Eur Radiol 2019; 29:4699-4708.
Nasief HG, Rosado-Mendez IM, Zagzebski JA, Hall TJ. A quantitative ultrasound-based multi-parameter classifier for breast masses. Ultrasound Med Biol 2019; 45:1603-1616.
Mendelson EB, Bbhm-Vélez M, Berg WA, et al. ACR BI-RADS® ultrasound. ACR BI-RADS® Atlas, Breast Imaging Reporting and Data System. Reston, VA: American College of Radiology; 2013.
Calas MJG, Almeida RMVR, Gutfilen B, Pereira WCA. Intraobserver interpretation of breast ultrasonography following the BI-RADS classification. Eur J Radiol 2010; 74:525-528.
Rosado-Mendez IM, Nam K, Hall TJ, Zagzebski JA. Task-oriented comparison of power spectral density estimation methods for quantifying acoustic attenuation in diagnostic ultrasound using a reference phantom method. Ultrason Imaging 2013; 35:214-234.
Brunke SS, Insana MF, Dahl JJ, Hansen C, Ashfaq M, Ermert H. An ultrasound research interface for a clinical system. IEEE Trans Ultrason Ferroelectr Freq Control 2007; 54:198-210.
Gammex Inc. 410 HE Series Multi-Purpose Accreditation Phantom with Multi-Frequency HE Gel™. User's Guide, Middleton, WI.
Rosado-Mendez IM, Castañeda-Martinez L, López JC, et al. Preliminary evaluation of inter- and intra-operator variability of quantitative ultrasound biomarkers for breast cancer characterization. 15th International Workshop on Breast Imaging (IWBI2020). International Society for Optics and Photonics 2020; 11513: 1151328-1:8.
Thomson DJ. Spectrum estimation and harmonic analysis. Proc IEEE 1982; 70:1055-1096.
Castañeda-Martinez L, Noguchi KK, Ikonomidou C, Zagzebski JA, Hall TJ, Rosado-Mendez IM. Optimization of ultrasound backscatter spectroscopy to assess neurotoxic effects of anesthesia in the newborn non-human primate brain. Ultrasound Med Biol 2020; 46:2044-2056.
Carrasco-Carrasco M. Técnicas de regularización en regresión: implementación y aplicaciones. Universidad de Sevilla; 2016. https://idus.us.es/bitstream/handle/11441/43746/Carrasco%20Carrasco%2C%20Mar%C3%ADa%20TFG.pdf?sequence=1&isAllowed=y.
Castañeda-Martinez L, Whitson H, Jafarpisheh N, et al. Comparison of attenuation compensation methods in the estimation of the backscatter coefficient of breast cancer. J Acoust Soc Am 2021; 150:A55.
Bass V, Mateos MJ, Rosado-Mendez IM, Marquez JA. Breast lesion segmentation and characterization using the Small Tumor-Aware Network (STAN) and 2D/3D shape descriptors in ultrasound images. 17th International Symposium on Medical Information Processing and Analysis. SPIE 2021; 12088:124-131.
MathWorks®, bwdist. (1994-2022). Help Center website The MathWorks, Inc. https://la.mathworks.com/help/images/ref/bwdist.html. Accessed September 12, 2021.
Zampirolli FDA, Lotufo RDA. Classification of the distance transformation algorithms under the mathematical morphology approach. In Proceedings 13th Brazilian Symposium on Computer Graphics and Image Processing 2000; Cat. No. PR00878: 292-299.
MathWorks®, Distance transform of a binary image. (1994-2022). Help Center website The MathWorks, Inc. https://la.mathworks.com/help/images/distance-transform-of-a-binary-image.html. Accessed September 12, 2021.
Maurer CR, Qi R, Raghavan V. A linear time algorithm for computing exact Euclidean distance transforms of binary images in arbitrary dimensions. IEEE Trans Pattern Anal Mach Intell 2003; 25:265-270.
Rubio IT, Marco V. La importancia de los márgenes quirúrgicos en la cirugía conservadora en el cáncer de mama. Cir Esp 2006; 79:3-9.
Martinez-Gonzalez MA, Sanchez-Villegas A, Toledo-Atucha EA, Faulin-Fajardo J. Bioestadistica Amigable. 3rd ed. Barcelona, Spain: Elsevier; 2014: 1-3, 45-46, 143, 178, 190-194, 217-218, 587-588.
Garcia-Nogales A. Elementos de Bioestadistica. 3rd ed. Caceres, Spain: University of Extremadura; 2011:183-186.
Moncho-Vasallo J. Estadística aplicada a las ciencias de la salud. Colección cuidados de salud avanzados. Elsevier España, S.L. Travessera de Gràcia, Barcelona, España. 2015; 137-173.
Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979; 86:420-428.
Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016; 15:155-163.
Dynamic Ecology. Is it a fixed or random effect? Posted on November 4, 2015 by McGill B. https://dynamicecology.wordpress.com/2015/11/04/is-it-a-fixed-or-random-effect/. Accessed November 22, 2021.
Aguilar-Ramos MI, Cruces E, Diaz B. Analisis de la varianza (ANOVA). Statistics, Universidad de Málaga. 2015.
Cohen J. The statistical power of abnormal-social psychological research: a review. J Abnorm Soc Psychol 1962; 65:145-153.
Castro MC, Martini HA. Potencia estadistica y calculo del tamaño del efecto en G* Power: complementos a las pruebas de significacion estadistica y su aplicacion en psicologia. Salud Soc 2014; 5:210-224.
Kirk RE. Practical significance: a concept whose time has come. Educ Psychol Meas 1996; 56:746-759.
Cohen J. A power primer. Psychol Bull 1992; 112:155-159.
McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods 1996; 1:30-46.
Hoffmann H. 2015: violin.m - Simple violin plot using matlab default kernel density estimation. INRES (University of Bonn).
D'Astous FT, Foster FS. Frequency dependence of ultrasound attenuation and backscatter in breast tissue. Ultrasound Med Biol 1986; 12:795-808.
Pelea LP. ¿Cómo proceder ante el incumplimiento de las premisas de los métodos paramétricos? o ¿cómo trabajar con variables biológicas no normales? Rev Jard Bot Nac 2018; 39:1-12.
Grant Information:
CF2019 1311307 Consejo Nacional de Ciencia y Tecnología; CVU 1008486 Consejo Nacional de Ciencia y Tecnología; CVU 298645 Consejo Nacional de Ciencia y Tecnología; School of Medicine and Public Health, University of Wisconsin-Madison; Universidad Nacional Autónoma de México; Wisconsin Partnership Program; IN107022 DGAPA-UNAM; Departments of Medical Physics and Radiology of the University of Wisconsin-Madison
Contributed Indexing:
Keywords: backscatter coefficient; breast cancer; inter-operator variability; intra-operator variability; quantitative ultrasound; regularization
Entry Date(s):
Date Created: 20230725 Date Completed: 20260311 Latest Revision: 20260311
Update Code:
20260312
DOI:
10.1002/jum.16292
PMID:
37490582
Database:
MEDLINE

*Further Information*

*Objectives: Here we report on the intra- and inter-operator variability of the backscatter coefficient (BSC) estimated with a new low-variance quantitative ultrasound (QUS) approach applied to breast lesions in vivo.
Methods: Radiofrequency (RF) echo signals were acquired from 29 BIRADS 4 and 5 breast lesions in 2 sequential cohorts following 2 imaging protocols: cohort 1) radial and antiradial views, and cohort 2) short- and long-axis views. Protocol 2 was implemented after retraining and discussion on how to improve reproducibility. Each patient was scanned by at least 2 of 3 radiologists; each performed 3 acquisitions with transducer and patient repositioning in between acquisitions. BSC was estimated using a low-variance QUS approach based on regularization. Intra- and inter-operator variability of the intra-lesion median BSC was evaluated with a multifactorial ANOVA test (P-values) and the intraclass correlation coefficient (ICC).
Results: Inter-operator variability was only significant in the first protocol (P < .007); ICC<subscript>inter</subscript>  = .77 (95% CI .71-.82), indicating good inter-operator agreement. In the second protocol, the inter-operator variability was not significant (P > .05) and agreement was excellent (ICC<subscript>inter</subscript>  = .92 [.89-.94]). In both protocols, the intra-operator variability was not significant.
Conclusions: Our findings demonstrate the need for standardizing image acquisition protocols for backscatter-based QUS to reduce inter-operator variability and ensure its successful translation to the characterization of suspicious breast masses.
(© 2023 The Authors. Journal of Ultrasound in Medicine published by Wiley Periodicals LLC on behalf of American Institute of Ultrasound in Medicine.)*