1. |
Yap M.♦, Bill C.♦, Byra M., Ting-yu L.♦, Huahu Y.♦, Galdran A.♦, Yung-Han C.♦, Raphael B.♦, Sven K.♦, Friedrich C.♦, Yu-wen L.♦, Ching-hui Y.♦, Kang L.♦, Qicheng L.♦, Ballester M.♦, Carneiro G.♦, Yi-Jen J.♦, Juinn-Dar H.♦, Pappachan J.♦, Reeves N.♦, Vishnu C.♦, Darren D.♦, Diabetic foot ulcers segmentation challenge report: Benchmark and analysis,
Medical Image Analysis, ISSN: 1361-8415, DOI: 10.1016/j.media.2024.103153, Vol.94, No.103153, pp.1-14, 2024Streszczenie: Monitoring the healing progress of diabetic foot ulcers is a challenging process. Accurate segmentation of foot ulcers can help podiatrists to quantitatively measure the size of wound regions to assist prediction of healing status. The main challenge in this field is the lack of publicly available manual delineation, which can be time consuming and laborious. Recently, methods based on deep learning have shown excellent results in automatic segmentation of medical images, however, they require large-scale datasets for training, and there is limited consensus on which methods perform the best. The 2022 Diabetic Foot Ulcers segmentation challenge was held in conjunction with the 2022 International Conference on Medical Image Computing and Computer Assisted Intervention, which sought to address these issues and stimulate progress in this research domain. A training set of 2000 images exhibiting diabetic foot ulcers was released with corresponding segmentation ground truth masks. Of the 72 (approved) requests from 47 countries, 26 teams used this data to develop fully automated systems to predict the true segmentation masks on a test set of 2000 images, with the corresponding ground truth segmentation masks kept private. Predictions from participating teams were scored and ranked according to their average Dice similarity coefficient of the ground truth masks and prediction masks. The winning team achieved a Dice of 0.7287 for diabetic foot ulcer segmentation. This challenge has now entered a live leaderboard stage where it serves as a challenging benchmark for diabetic foot ulcer segmentation. Słowa kluczowe: Deep learning, Diabetic foot ulcers, Segmentation, Convolutional neural networks Afiliacje autorów:
Yap M. | - | inna afiliacja | Bill C. | - | inna afiliacja | Byra M. | - | IPPT PAN | Ting-yu L. | - | inna afiliacja | Huahu Y. | - | inna afiliacja | Galdran A. | - | inna afiliacja | Yung-Han C. | - | inna afiliacja | Raphael B. | - | inna afiliacja | Sven K. | - | inna afiliacja | Friedrich C. | - | inna afiliacja | Yu-wen L. | - | inna afiliacja | Ching-hui Y. | - | inna afiliacja | Kang L. | - | inna afiliacja | Qicheng L. | - | inna afiliacja | Ballester M. | - | inna afiliacja | Carneiro G. | - | inna afiliacja | Yi-Jen J. | - | inna afiliacja | Juinn-Dar H. | - | inna afiliacja | Pappachan J. | - | inna afiliacja | Reeves N. | - | inna afiliacja | Vishnu C. | - | inna afiliacja | Darren D. | - | inna afiliacja |
| | 200p. |
2. |
Muhammad Febrian R.♦, Byra M., Henrik S.♦, A new family of instance-level loss functions for improving instance-level segmentation and detection of white matter hyperintensities in routine clinical brain MRI,
Computers in Biology and Medicine, ISSN: 0010-4825, DOI: 10.1016/j.compbiomed.2024.108414, Vol.174, No.108414, pp.1-13, 2024Streszczenie: In this study, we introduce ‘‘instance loss functions’’, a new family of loss functions designed to enhance the
training of neural networks in the instance-level segmentation and detection of objects in biomedical image
data, particularly those of varied numbers and sizes. Intended to be utilized conjointly with traditional loss
functions, these proposed functions, prioritize object instances over pixel-by-pixel comparisons. The specific
functions, the instance segmentation loss (instance), the instance center loss (center), the false instance rate
loss (false), and the instance proximity loss (proximity), serve distinct purposes. Specifically, instance improves
instance-wise segmentation quality, center enhances segmentation quality of small instances, false minimizes
the rate of false and missed detections across varied instance sizes, and proximity improves detection quality
by pulling predicted instances towards the ground truth instances. Through the task of segmenting white
matter hyperintensities (WMH) in brain MRI, we benchmarked our proposed instance loss functions, both
individually and in combination via an ensemble inference models approach, against traditional pixel-level
loss functions. Data were sourced from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) and the
WMH Segmentation Challenge datasets, which exhibit significant variation in WMH instance sizes. Empirical
evaluations demonstrate that combining two instance-level loss functions through ensemble inference models
outperforms models using other loss function on both the ADNI and WMH Segmentation Challenge datasets for
the segmentation and detection of WMH instances. Further, applying these functions to the segmentation of
nuclei in histopathology images demonstrated their effectiveness and generalizability beyond WMH, improving
performance even in contexts with less severe instance imbalance. Słowa kluczowe: Instance-level segmentation loss, Instance-level detection loss, White matter hyperintensities, Brain lesions Afiliacje autorów:
Muhammad Febrian R. | - | inna afiliacja | Byra M. | - | IPPT PAN | Henrik S. | - | inna afiliacja |
| | 100p. |
3. |
Byra M., Poon C.♦, Rachmadi Muhammad F.♦, Schlachter M.♦, Skibbe H.♦, Exploring the performance of implicit neural representations for brain image registration,
Scientific Reports, ISSN: 2045-2322, DOI: 10.1038/s41598-023-44517-5, Vol.13, No.17334, pp.1-13, 2023Streszczenie: Pairwise image registration is a necessary prerequisite for brain image comparison and data integration in neuroscience and radiology. In this work, we explore the efficacy of implicit neural representations (INRs) in improving the performance of brain image registration in magnetic resonance imaging. In this setting, INRs serve as a continuous and coordinate based approximation of the deformation field obtained through a multi-layer perceptron. Previous research has demonstrated that sinusoidal representation networks (SIRENs) surpass ReLU models in performance. In this study, we first broaden the range of activation functions to further investigate the registration performance of implicit networks equipped with activation functions that exhibit diverse oscillatory properties. Specifically, in addition to the SIRENs and ReLU, we evaluate activation functions based on snake, sine+, chirp and Morlet wavelet functions. Second, we conduct experiments to relate the hyper-parameters of the models to registration performance. Third, we propose and assess various techniques, including cycle consistency loss, ensembles and cascades of implicit networks, as well as a combined image fusion and registration objective, to enhance the performance of implicit registration networks beyond the standard approach. The investigated implicit methods are compared to the VoxelMorph convolutional neural network and to the symmetric image normalization (SyN) registration algorithm from the Advanced Normalization Tools (ANTs). Our findings not only highlight the remarkable capabilities of implicit networks in addressing pairwise image registration challenges, but also showcase their potential as a powerful and versatile off-the-shelf tool in the fields of neuroscience and radiology. Afiliacje autorów:
Byra M. | - | IPPT PAN | Poon C. | - | inna afiliacja | Rachmadi Muhammad F. | - | inna afiliacja | Schlachter M. | - | inna afiliacja | Skibbe H. | - | inna afiliacja |
| | 140p. |
4. |
Thomas C.♦, Byra M., Marti R.♦, Yap Moi H.♦, Zwiggelaar R.♦, BUS-Set: A benchmark for quantitative evaluation of breast ultrasound segmentation networks with public datasets,
Medical Physics, ISSN: 0094-2405, DOI: 10.1002/mp.16287, pp.1-21, 2023Streszczenie: Purpose: BUS-Set is a reproducible benchmark for breast ultrasound (BUS) lesion segmentation, comprising of publicly available images with the aim of improving future comparisons between machine learning models within the field of BUS. Method: Four publicly available datasets were compiled creating an overall set of 1154 BUS images, from five different scanner types. Full dataset details have been provided, which include clinical labels and detailed annotations. Further- more, nine state-of -the-art deep learning architectures were selected to form the initial benchmark segmentation result, tested using five-fold cross-validation and MANOVA/ANOVA with Tukey statistical significance test with a threshold of 0.01. Additional evaluation of these architectures was conducted, exploring possible training bias, and lesion size and type effects. Results: Of the nine state-of -the-art benchmarked architectures, Mask R-CNN obtained the highest overall results, with the following mean metric scores: Dice score of 0.851, intersection over union of 0.786 and pixel accuracy of 0.975. MANOVA/ANOVA and Tukey test results showed Mask R-CNN to be statistically significant better compared to all other benchmarked models with a p-value > 0.01. Moreover, Mask R-CNN achieved the highest mean Dice score of 0.839 on an additional 16 image dataset, that contained multiple lesions per image. Further analysis on regions of interest was conducted, assessing Hamming distance, depth-to-width ratio (DWR), circularity, and elongation, which showed that the Mask R-CNN’s segmentations maintained the most morphological fea-tures with correlation coefficients of 0.888, 0.532, 0.876 for DWR, circularity, and elongation, respectively. Based on the correlation coefficients, statistical test indicated that Mask R-CNN was only significantly different to Sk-U-Net.Conclusions: BUS-Set is a fully reproducible benchmark for BUS lesion seg-mentation obtained through the use of public datasets and GitHub. Of the state-of -the-art convolution neural network (CNN)-based architectures, Mask R-CNN achieved the highest performance overall, further analysis indicated that a training bias may have occurred due to the lesion size variation in the dataset. All dataset and architecture details are available at GitHub: https://github.com/corcor27/BUS-Set, which allows for a fully reproducible benchmark. Słowa kluczowe: breast segmentation,public datasets Afiliacje autorów:
Thomas C. | - | inna afiliacja | Byra M. | - | IPPT PAN | Marti R. | - | inna afiliacja | Yap Moi H. | - | inna afiliacja | Zwiggelaar R. | - | inna afiliacja |
| | 100p. |
5. |
Byra M., Szmigielski C.♦, Kalinowski P.♦, Paluszkiewicz R.♦, Ziarkiewicz-Wróblewska B.♦, Zieniewicz K.♦, Styczyński G.♦, Ultrasound and biomarker based assessment of hepatic steatosis in patients with severe obesity,
POLISH ARCHIVES OF INTERNAL MEDICINE, ISSN: 1897-9483, DOI: 10.20452/pamw.16343, Vol.1, pp.1-23, 2022Streszczenie: Introduction: Nonalcoholic fatty liver disease (NAFLD) is a common liver abnormality, but its non-invasive diagnosis in patients with severe obesity remains difficult.
Objectives: To investigate the usefulness of the ultrasound (US) based hepatorenal index (HRI) technique, and two biomarker-based methods, including the hepatic steatosis index (HSI) and NAFLD logit score for the diagnosis of NAFLD in subjects referred for the bariatric surgery.
Patients and methods: 162 subjects, 106 with NAFLD, admitted for the bariatric surgery participated in the study. Fat fraction level and the presence of NAFLD were determined using surgical liver biopsy. Each patient underwent liver US examination and blood tests to determine the HRI, HSI and NAFLD logit score.
Results: For the NAFLD diagnosis, the HRI, HSI and NAFLD logit score techniques achieved areas under the receiver operating characteristic curves of 0.879, 0.577 and 0.825, respectively. The Spearman’s correlation coefficients between the liver fat fraction values and the HRI, HSI and NAFLD logit score were equal to 0.695, 0.215 and 0.595, respectively. The optimal cut-off values for the NAFLD diagnosis for the HRI, HSI and NAFLD logit score were equal to 1.12, 56.1 and 0.59, and significantly differed from the cut-off values reported for the general population in the literature.
Conclusions: Our study confirms the usefulness of only two out of three techniques, the HRI and the NAFLD logit score for the diagnosis of NAFLD in patients with severe obesity. Methods designed for the general population require different cut-off values to achieve accurate performance in severe obesity.
Słowa kluczowe: biomarkers, fatty liver disease, hepatorenal index, obesity, ultrasound Afiliacje autorów:
Byra M. | - | IPPT PAN | Szmigielski C. | - | Medical University of Warsaw (PL) | Kalinowski P. | - | Medical University of Warsaw (PL) | Paluszkiewicz R. | - | Medical University of Warsaw (PL) | Ziarkiewicz-Wróblewska B. | - | Medical University of Warsaw (PL) | Zieniewicz K. | - | Medical University of Warsaw (PL) | Styczyński G. | - | Medical University of Warsaw (PL) |
| | 140p. |
6. |
Byra M., Klimonda Z., Kruglenko E., Gambin B., Unsupervised deep learning based approach to temperature monitoring in focused ultrasound treatment,
Ultrasonics, ISSN: 0041-624X, DOI: 10.1016/j.ultras.2022.106689, Vol.122, pp.106689-1-7, 2022Streszczenie: Temperature monitoring in ultrasound (US) imaging is important for various medical treatments, such as high-intensity focused US (HIFU) therapy or hyperthermia. In this work, we present a deep learning based approach to temperature monitoring based on radio-frequency (RF) US data. We used Siamese neural networks in an unsupervised way to spatially compare RF data collected at different time points of the heating process. The Siamese model consisted of two identical networks initially trained on a large set of simulated RF data to assess tissue backscattering properties. To illustrate our approach, we experimented with a tissue-mimicking phantom and an ex-vivo tissue sample, which were both heated with a HIFU transducer. During the experiments, we collected RF data with a regular US scanner. To determine spatiotemporal variations in temperature distribution within the samples, we extracted small 2D patches of RF data and compared them with the Siamese network. Our method achieved good performance in determining the spatiotemporal distribution of temperature during heating. Compared with the temperature monitoring based on the change in radio-frequency signal backscattered energy parameter, our method provided more smooth spatial parametric maps and did not generate ripple artifacts. The proposed approach, when fully developed, might be used for US based temperature. Słowa kluczowe: temperature monitoring, high intensity ultrasound, deep learning, transfer learning, ultrasound imaging Afiliacje autorów:
Byra M. | - | IPPT PAN | Klimonda Z. | - | IPPT PAN | Kruglenko E. | - | IPPT PAN | Gambin B. | - | IPPT PAN |
| | 140p. |
7. |
Byra M., Jarosik P., Dobruch-Sobczak K., Klimonda Z., Piotrzkowska-Wróblewska H., Litniewski J., Nowicki A., Joint segmentation and classification of breast masses based on ultrasound radio-frequency data and convolutional neural networks,
Ultrasonics, ISSN: 0041-624X, DOI: 10.1016/j.ultras.2021.106682, Vol.121, pp.106682-1-9, 2022Streszczenie: In this paper, we propose a novel deep learning method for joint classification and segmentation of breast masses based on radio-frequency (RF) ultrasound (US) data. In comparison to commonly used classification and segmentation techniques, utilizing B-mode US images, we train the network with RF data (data before envelope detection and dynamic compression), which are considered to include more information on tissue’s physical properties than standard B-mode US images. Our multi-task network, based on the Y-Net architecture, can effectively process large matrices of RF data by mixing 1D and 2D convolutional filters. We use data collected from 273 breast masses to compare the performance of networks trained with RF data and US images. The multi-task model developed based on the RF data achieved good classification performance, with area under the receiver operating characteristic curve (AUC) of 0.90. The network based on the US images achieved AUC of 0.87. In the case of the segmentation, we obtained mean Dice scores of 0.64 and 0.60 for the approaches utilizing US images and RF data, respectively. Moreover, the interpretability of the networks was studied using class activation mapping technique and by filter weights visualizations. Słowa kluczowe: breast mass classification, breast mass segmentation, convolutional neural networks, deep learning, quantitative ultrasound, ultrasound imagin Afiliacje autorów:
Byra M. | - | IPPT PAN | Jarosik P. | - | IPPT PAN | Dobruch-Sobczak K. | - | IPPT PAN | Klimonda Z. | - | IPPT PAN | Piotrzkowska-Wróblewska H. | - | IPPT PAN | Litniewski J. | - | IPPT PAN | Nowicki A. | - | IPPT PAN |
| | 140p. |
8. |
Byra M., Dobruch-Sobczak K., Piotrzkowska-Wróblewska H., Klimonda Z., Litniewski J., Prediction of response to neoadjuvant chemotherapy in breast cancer with recurrent neural networks and raw ultrasound signals,
PHYSICS IN MEDICINE AND BIOLOGY, ISSN: 0031-9155, DOI: 10.1088/1361-6560/ac8c82, Vol.67, No.18, pp.1-15, 2022Streszczenie: Objective. Prediction of the response to neoadjuvant chemotherapy (NAC) in breast cancer is important for patient outcomes. In this work, we propose a deep learning based approach to NAC response prediction in ultrasound (US) imaging. Approach. We develop recurrent neural networks that can process serial US imaging data to predict chemotherapy outcomes. We present models that can process either raw radio-frequency (RF) US data or regular US images. The proposed approach is evaluated based on 204 sequences of US data from 51 breast cancers. Each sequence included US data collected before the chemotherapy and after each subsequent dose, up to the 4th course. We investigate three pre-trained convolutional neural networks (CNNs) as back-bone feature extractors for the recurrent network. The CNNs were pre-trained using raw US RF data, US b-mode images and RGB images from the ImageNet dataset. The first two networks were developed using US data collected from malignant and benign breast masses. Main results. For the pre-treatment data, the better performing network, with back-bone CNN pre-trained on US images, achieved area under the receiver operating curve (AUC) of 0.81 (±0.04). Performance of the recurrent networks improved with each course of the chemotherapy. For the 4th course, the better performing model, based on the CNN pre-trained with RGB images, achieved AUC value of 0.93 (±0.03). Statistical analysis based on the DeLong test presented that there were no significant differences in AUC values between the pre-trained networks at each stage of the chemotherapy (p-values > 0.05). Significance. Our study demonstrates the feasibility of using recurrent neural networks for the NAC response prediction in breast cancer US.
Słowa kluczowe: breast cancer, deep learning, neoadjuvant chemotherapy, reccurent neural networks, ultrasound imaging Afiliacje autorów:
Byra M. | - | IPPT PAN | Dobruch-Sobczak K. | - | IPPT PAN | Piotrzkowska-Wróblewska H. | - | IPPT PAN | Klimonda Z. | - | IPPT PAN | Litniewski J. | - | IPPT PAN |
| | 100p. |
9. |
Byra M., Dobruch-Sobczak K., Piotrzkowska-Wróblewska H., Klimonda Z., Litniewski J., Explaining a deep learning based breast ultrasound image classifier with saliency maps,
Journal of Ultrasonography, ISSN: 2084-8404, DOI: 10.15557/JoU.2022.0013, Vol.22, pp.e70-e75, 2022Streszczenie: Aim of the study: Deep neural networks have achieved good performance in breast mass classification in ultrasound imaging. However, their usage in clinical practice is still lim¬ited due to the lack of explainability of decisions conducted by the networks. In this study, to address the explainability problem, we generated saliency maps indicating ultrasound image regions important for the network’s classification decisions. Material and methods: Ultrasound images were collected from 272 breast masses, including 123 malignant and 149 benign. Transfer learning was applied to develop a deep network for breast mass clas¬sification. Next, the class activation mapping technique was used to generate saliency maps for each image. Breast mass images were divided into three regions: the breast mass region, the peritumoral region surrounding the breast mass, and the region below the breast mass. The pointing game metric was used to quantitatively assess the overlap between the saliency maps and the three selected US image regions. Results: Deep learning classifier achieved the area under the receiver operating characteristic curve, accuracy, sensitivity, and specific¬ity of 0.887, 0.835, 0.801, and 0.868, respectively. In the case of the correctly classified test US images, analysis of the saliency maps revealed that the decisions of the network could be associated with the three selected regions in 71% of cases. Conclusions: Our study is an important step toward better understanding of deep learning models developed for breast mass diagnosis. We demonstrated that the decisions made by the network can be related to the appearance of certain tissue regions in breast mass US images. Słowa kluczowe: deep learning, breast mass diagnosis, attention maps, explainability Afiliacje autorów:
Byra M. | - | IPPT PAN | Dobruch-Sobczak K. | - | IPPT PAN | Piotrzkowska-Wróblewska H. | - | IPPT PAN | Klimonda Z. | - | IPPT PAN | Litniewski J. | - | IPPT PAN |
| | 20p. |
10. |
Xue YP.♦, Jang H.♦, Byra M., Cai ZY.♦, Wu M.♦, Chang EY.♦, Ma YJ.♦, Su J.♦, Automated cartilage segmentation and quantification using 3D ultrashort echo time (UTE) cones MR imaging with deep convolutional neural networks,
European Radiology, ISSN: 1432-1084, DOI: 10.1007/s00330-021-07853-6, Vol.31, pp.7653-7663, 2021Streszczenie: Objective: To develop a fully automated full-thickness cartilage segmentation and mapping of T1, T1ρ, and T2*, as well as macromolecular fraction (MMF) by combining a series of quantitative 3D ultrashort echo time (UTE) cones MR imaging with a transfer learning–based U-Net convolutional neural networks (CNN) model. Methods: Sixty-five participants (20 normal, 29 doubtful-minimal osteoarthritis (OA), and 16 moderate-severe OA) were scanned using 3D UTE cones T1 (Cones-T1), adiabatic T1ρ (Cones-AdiabT1ρ), T2* (Cones-T2*), and magnetization transfer (Cones-MT) sequences at 3 T. Manual segmentation was performed by two experienced radiologists, and automatic segmentation was completed using the proposed U-Net CNN model. The accuracy of cartilage segmentation was evaluated using the Dice score and volumetric overlap error (VOE). Pearson correlation coefficient and intraclass correlation coefficient (ICC) were calculated to evaluate the consistency of quantitative MR parameters extracted from automatic and manual segmentations. UTE biomarkers were compared among different subject groups using one-way ANOVA. Results: The U-Net CNN model provided reliable cartilage segmentation with a mean Dice score of 0.82 and a mean VOE of 29.86%. The consistency of Cones-T1, Cones-AdiabT1ρ, Cones-T2*, and MMF calculated using automatic and manual segmentations ranged from 0.91 to 0.99 for Pearson correlation coefficients, and from 0.91 to 0.96 for ICCs, respectively. Significant increases in Cones-T1, Cones-AdiabT1ρ, and Cones-T2* (p < 0.05) and a decrease in MMF (p < 0.001) were observed in doubtful-minimal OA and/or moderate-severe OA over normal controls. Conclusion: Quantitative 3D UTE cones MR imaging combined with the proposed U-Net CNN model allows a fully automated comprehensive assessment of articular cartilage. Słowa kluczowe: deep learning, cartilage, biomarkers, osteoarthritis Afiliacje autorów:
Xue YP. | - | South China Normal University (CN) | Jang H. | - | University of California (US) | Byra M. | - | IPPT PAN | Cai ZY. | - | inna afiliacja | Wu M. | - | University of California (US) | Chang EY. | - | University of California (US) | Ma YJ. | - | University of California (US) | Su J. | - | inna afiliacja |
| | 140p. |
11. |
Byra M., Breast mass classification with transfer learning based on scaling of deep representations,
Biomedical Signal Processing and Control, ISSN: 1746-8094, DOI: 10.1016/j.bspc.2021.102828, Vol.69, pp.102828-1-8, 2021Streszczenie: Ultrasound (US) imaging is widely used to help radiologists in diagnosing breast cancer. In this work, we propose a deep learning based approach to breast mass classification in US. Transfer learning with convolutional neural networks (CNNs) is commonly used to develop object recognition models in medical image analysis. The most widely used fine-tuning techniques aim to modify weights of pre-trained networks to address target medical problems. However, fine-tuning can be difficult when the number of trainable parameters of the pre-trained network is large and the available medical data are scarce. To address this issue, we propose a novel transfer learning technique based on deep representation scaling (DRS) layers, which are inserted between the blocks of a pre-trained CNN to enable better flow of information in the network. During network training, we only update the parameters of the DRS layers in order to adjust the pre-trained CNN to process breast mass US images. We present that the DRS based approach greatly reduces the number of trainable parameters, and achieves better or comparable performance to the standard transfer learning techniques. The proposed DRS layer method combined with the standard fine-tuning techniques achieved excellent breast mass classification performance, with area under the receiver operating characteristic curve of 0.955 and accuracy of 0.915. Słowa kluczowe: breast mass classification, convolutional neural networks, deep learning, transfer learning, ultrasound imaging Afiliacje autorów:
| | 140p. |
12. |
Byra M., Dobruch-Sobczak K., Klimonda Z., Piotrzkowska-Wróblewska H., Litniewski J., Early prediction of response to neoadjuvant chemotherapy in breast cancer sonography using Siamese convolutional neural networks,
IEEE Journal of Biomedical and Health Informatics, ISSN: 2168-2208, DOI: 10.1109/JBHI.2020.3008040, Vol.25, No.3, pp.797-805, 2021Streszczenie: Early prediction of response to neoadjuvant chemotherapy (NAC) in breast cancer is crucial for guiding therapy decisions. In this work, we propose a deep learning based approach for the early NAC response prediction in ultrasound (US) imaging. We used transfer learning with deep convolutional neural networks (CNNs) to develop the response prediction models. The usefulness of two transfer learning techniques was examined. First, a CNN pre-trained on the ImageNet dataset was utilized. Second, we applied double transfer learning, the CNN pre-trained on the ImageNet dataset was additionally fine-tuned with breast mass US images to differentiate malignant and benign lesions. Two prediction tasks were investigated. First, a L1 regularized logistic regression prediction model was developed based on generic neural features extracted from US images collected before the chemotherapy (a priori prediction). Second, Siamese CNNs were used to quantify differences between US images collected before the treatment and after the first and second course of NAC. The proposed methods were evaluated using US data collected from 39 tumors. The better performing deep learning models achieved areas under the receiver operating characteristic curve of 0.797 and 0.847 in the case of the a priori prediction and the Siamese model, respectively. The proposed approach was compared with a
method based on handcrafted morphological features. Our study presents the feasibility of using transfer learning with CNNs for the NAC response prediction in US imaging. Słowa kluczowe: breast cancer, deep learning, neoadjuvant chemotherapy, Siamese convolutional neural networks, ultrasound imaging Afiliacje autorów:
Byra M. | - | IPPT PAN | Dobruch-Sobczak K. | - | IPPT PAN | Klimonda Z. | - | IPPT PAN | Piotrzkowska-Wróblewska H. | - | IPPT PAN | Litniewski J. | - | IPPT PAN |
| | 140p. |
13. |
Strzelczyk J.♦, Kalinowski P.♦, Zieniewicz K.♦, Szmigielski C.♦, Byra M., Styczyński G.♦, The influence of surgical weight reduction on left atrial strain,
Obesity Surgery, ISSN: 0960-8923, DOI: 10.1007/s11695-021-05710-5, Vol.31, pp.5243-5250, 2021Streszczenie: Background: Obesity increases and surgical weight reduction decreases the risk of atrial fibrillation (AF) and heart failure (HF). We hypothesized that surgically induced weight loss may favorably affect left atrial (LA) mechanical function measured by longitudinal strain, which has recently emerged as an independent imaging biomarker of increased AF and HF risk. Methods: We retrospectively evaluated echocardiograms performed before and 12.2 ± 2.2 months after bariatric surgery in 65 patients with severe obesity (mean age 39 [36; 47] years, 72% of females) with no known cardiac disease or arrhythmia. The LA mechanical function was measured by the longitudinal strain using the semi-automatic speckle tracking method. Results: After surgery, body mass index decreased from 43.72 ± 4.34 to 30.04 ± 4.33 kg/m2. We observed a significant improvement in all components of the LA strain. LA reservoir strain (LASR) and LA conduit strain (LASCD) significantly increased (35.7% vs 38.95%, p = 0.0005 and − 19.6% vs − 24.4%, p < 0.0001) and LA contraction strain (LASCT) significantly decreased (− 16% vs − 14%, p = 0.0075). There was a significant correlation between an increase in LASR and LASCD and the improvement in parameters of left ventricular diastolic and longitudinal systolic function (increase in E’ and MAPSE). Another significant correlation was identified between the decrease in LASCT and an improvement in LA function (decrease in A’). Conclusions: The left atrial mechanical function improves after bariatric surgery. It is partially explained by the beneficial effect of weight reduction on the left ventricular diastolic and longitudinal systolic function. This effect may contribute to decreased risk of AF and HF after bariatric surgery. Słowa kluczowe: left atrial strain, bariatric surgery, atrial fibrillation, heart failure Afiliacje autorów:
Strzelczyk J. | - | inna afiliacja | Kalinowski P. | - | Medical University of Warsaw (PL) | Zieniewicz K. | - | Medical University of Warsaw (PL) | Szmigielski C. | - | Medical University of Warsaw (PL) | Byra M. | - | IPPT PAN | Styczyński G. | - | Medical University of Warsaw (PL) |
| | 100p. |
14. |
Byra M., Han A.♦, Boehringer A.S.♦, Zhang Y.N.♦, O'Brien Jr W.D.♦, Erdman Jr J.W.♦, Loomba R.♦, Sirlin C.B.♦, Andre M.♦, Liver fat assessment in multiview sonography using transfer learning with convolutional neural networks,
Journal of Ultrasound in Medicine, ISSN: 0278-4297, DOI: 10.1002/jum.15693, pp.1-10, 2021Streszczenie: Objectives - To develop and evaluate deep learning models devised for liver fat assessment based on ultrasound (US) images acquired from four different liver views: transverse plane (hepatic veins at the confluence with the inferior vena cava, right portal vein, right posterior portal vein) and sagittal plane (liver/kidney). Methods - US images (four separate views) were acquired from 135 participants with known or suspected nonalcoholic fatty liver disease. Proton density fat fraction (PDFF) values derived from chemical shift-encoded magnetic resonance imaging served as ground truth. Transfer learning with a deep convolutional neural network (CNN) was applied to develop models for diagnosis of fatty liver (PDFF ≥ 5%), diagnosis of advanced steatosis (PDFF ≥ 10%), and PDFF quantification for each liver view separately. In addition, an ensemble model based on all four liver view models was investigated. Diagnostic performance was assessed using the area under the receiver operating characteristics curve (AUC), and quantification was assessed using the Spearman correlation coefficient (SCC). Results - The most accurate single view was the right posterior portal vein, with an SCC of 0.78 for quantifying PDFF and AUC values of 0.90 (PDFF ≥ 5%) and 0.79 (PDFF ≥ 10%). The ensemble of models achieved an SCC of 0.81 and AUCs of 0.91 (PDFF ≥ 5%) and 0.86 (PDFF ≥ 10%). Conclusion - Deep learning-based analysis of US images from different liver views can help assess liver fat. Słowa kluczowe: attention mechanism, convolutional neural networks, deep learning, nonalcoholic fatty liver disease, proton density fat fraction, ultrasound images Afiliacje autorów:
Byra M. | - | IPPT PAN | Han A. | - | University of Illinois at Urbana-Champaign (US) | Boehringer A.S. | - | University of California (US) | Zhang Y.N. | - | University of California (US) | O'Brien Jr W.D. | - | inna afiliacja | Erdman Jr J.W. | - | University of Illinois at Urbana-Champaign (US) | Loomba R. | - | University of California (US) | Sirlin C.B. | - | University of California (US) | Andre M. | - | University of California (US) |
| | 70p. |
15. |
Han A.♦, Byra M., Heba E.♦, Andre M.P.♦, Erdman J.W.Jr.♦, Loomba R.♦, Sirlin C.B.♦, O'Brien W.D.Jr., Noninvasive diagnosis of nonalcoholic fatty liver disease and quantification of liver fat with radiofrequency ultrasound data using one-dimensional convolutional neural networks,
Radiology, ISSN: 0033-8419, DOI: 10.1148/radiol.2020191160, Vol.295, No.2, pp.342-350, 2020Streszczenie: Background: Radiofrequency ultrasound data from the liver contain rich information about liver microstructure and composition. Deep learning might exploit such information to assess nonalcoholic fatty liver disease (NAFLD). Purpose: To develop and evaluate deep learning algorithms that use radiofrequency data for NAFLD assessment, with MRI-derived proton density fat fraction (PDFF) as the reference. Materials and Methods: A HIPAA-compliant secondary analysis of a single-center prospective study was performed for adult participants with NAFLD and control participants without liver disease. Participants in the parent study were recruited between February 2012 and March 2014 and underwent same-day US and MRI of the liver. Participants were randomly divided into an equal number of training and test groups. The training group was used to develop two algorithms via cross-validation: a classifier to diagnose NAFLD (MRI PDFF ≥ 5%) and a fat fraction estimator to predict MRI PDFF. Both algorithms used one-dimensional convolutional neural networks. The test group was used to evaluate the classifier for sensitivity, specificity, positive predictive value, negative predictive value, and accuracy and to evaluate the estimator for correlation, bias, limits of agreements, and linearity between predicted fat fraction and MRI PDFF. Results: A total of 204 participants were analyzed, 140 had NAFLD (mean age, 52 years ± 14 [standard deviation]; 82 women) and 64 were control participants (mean age, 46 years ± 21; 42 women). In the test group, the classifier provided 96% (95% confidence interval [CI]: 90%, 99%) (98 of 102) accuracy for NAFLD diagnosis (sensitivity, 97% [95% CI: 90%, 100%], 68 of 70; specificity, 94% [95% CI: 79%, 99%], 30 of 32; positive predictive value, 97% [95% CI: 90%, 99%], 68 of 70; negative predictive value, 94% [95% CI: 79%, 98%], 30 of 32). The estimator-predicted fat fraction correlated with MRI PDFF (Pearson r = 0.85). The mean bias was 0.8% (P = .08), and 95% limits of agreement were -7.6% to 9.1%. The predicted fat fraction was linear with an MRI PDFF of 18% or less (r = 0.89, slope = 1.1, intercept = 1.3) and nonlinear with an MRI PDFF greater than 18%. Conclusion: Deep learning algorithms using radiofrequency ultrasound data are accurate for diagnosis of nonalcoholic fatty liver disease and hepatic fat fraction quantification when other causes of steatosis are excluded. Afiliacje autorów:
Han A. | - | University of Illinois at Urbana-Champaign (US) | Byra M. | - | IPPT PAN | Heba E. | - | inna afiliacja | Andre M.P. | - | University of California (US) | Erdman J.W.Jr. | - | University of Illinois at Urbana-Champaign (US) | Loomba R. | - | University of California (US) | Sirlin C.B. | - | University of California (US) |
| | 200p. |
16. |
Byra M., Jarosik P.♦, Szubert A.♦, Galperine M.♦, Ojeda-Fournier H.♦, Olson L.♦, Comstock Ch.♦, Andre M.♦, Andre M., Breast mass segmentation in ultrasound with selective kernel U-Net convolutional neural network,
Biomedical Signal Processing and Control, ISSN: 1746-8094, DOI: 10.1016/j.bspc.2020.102027, Vol.61, pp.102027-1-10, 2020Streszczenie: In this work, we propose a deep learning method for breast mass segmentation in ultrasound (US). Variations in breast mass size and image characteristics make the automatic segmentation difficult. To addressthis issue, we developed a selective kernel (SK) U-Net convolutional neural network. The aim of the SKswas to adjust network's receptive fields via an attention mechanism, and fuse feature maps extractedwith dilated and conventional convolutions. The proposed method was developed and evaluated usingUS images collected from 882 breast masses. Moreover, we used three datasets of US images collectedat different medical centers for testing (893 US images). On our test set of 150 US images, the SK-U-Netachieved mean Dice score of 0.826, and outperformed regular U-Net, Dice score of 0.778. When evaluatedon three separate datasets, the proposed method yielded mean Dice scores ranging from 0.646 to 0.780. Additional fine-tuning of our better-performing model with data collected at different centers improvedmean Dice scores by ~6%. SK-U-Net utilized both dilated and regular convolutions to process US images. We found strong correlation, Spearman's rank coefficient of 0.7, between the utilization of dilated convo-lutions and breast mass size in the case of network's expansion path. Our study shows the usefulness ofdeep learning methods for breast mass segmentation. SK-U-Net implementation and pre-trained weightscan be found at github.com/mbyr/bus_seg. Słowa kluczowe: attention mechanism, breast mass segmentation, convolutional neural networks, deep learning, receptive field, ultrasound imaging Afiliacje autorów:
Byra M. | - | IPPT PAN | Jarosik P. | - | inna afiliacja | Szubert A. | - | inna afiliacja | Galperine M. | - | inna afiliacja | Ojeda-Fournier H. | - | University of California (US) | Olson L. | - | University of California (US) | Comstock Ch. | - | Memorial Sloan-Kettering Cancer Center (US) | Andre M. | - | University of California (US) |
| | 140p. |
17. |
Jarosik P., Klimonda Z., Lewandowski M., Byra M., Breast lesion classification based on ultrasonic radio-frequency signals using convolutional neural networks,
Biocybernetics and Biomedical Engineering, ISSN: 0208-5216, DOI: 10.1016/j.bbe.2020.04.002, Vol.40, No.3, pp.977-986, 2020Streszczenie: We propose a novel approach to breast mass classification based on deep learning models that utilize raw radio-frequency (RF) ultrasound (US) signals. US images, typically displayed by US scanners and used to develop computer-aided diagnosis systems, are reconstructed using raw RF data. However, information related to physical properties of tissues present in RF signals is partially lost due to the irreversible compression necessary to make raw data readable to the human eye. To utilize the information present in raw US data, we develop deep learning models that can automatically process small 2D patches of RF signals and their amplitude samples. We compare our approach with classification method based on the Nakagami parameter, a widely used quantitative US technique utilizing RF data amplitude samples. Our better performing deep learning model, trained using RF signals and their envelope samples, achieved good classification performance, with the area under the receiver attaining operating characteristic curve (AUC) and balanced accuracy of 0.772 and 0.710, respectively. The proposed method significantly outperformed the Nakagami parameter-based classifier, which achieved AUC and accuracy of 0.64 and 0.611, respectively. The developed deep learning models were used to generate parametric maps illustrating the level of mass malignancy. Our study presents the feasibility of using RF data for the development of deep learning breast mass classification models. Słowa kluczowe: breast lesion classification, convolutional neural networks, deep learning, radio-frequency signals, ultrasound imaging Afiliacje autorów:
Jarosik P. | - | IPPT PAN | Klimonda Z. | - | IPPT PAN | Lewandowski M. | - | IPPT PAN | Byra M. | - | IPPT PAN |
| | 100p. |
18. |
Byra M., Wu M.♦, Zhang X.♦, Jang H.♦, Ma Y-J.♦, Chang E.Y.♦, Shah S.♦, Du J.♦, Knee menisci segmentation and relaxometry of 3D ultrashort echo time cones MR imaging using attention U‐Net with transfer learning,
Magnetic Resonance in Medicine, ISSN: 1522-2594, DOI: 10.1002/mrm.27969, Vol.83, No.3, pp.1109-1122, 2020Streszczenie: Purpose: To develop a deep learning-based method for knee menisci segmentation in 3D ultrashort echo time (UTE) cones MR imaging, and to automatically determine MR relaxation times, namely the T1, T1ρ, and T2* parameters, which can be used to assess knee osteoarthritis (OA). Methods: Whole knee joint imaging was performed using 3D UTE cones sequences to collect data from 61 human subjects. Regions of interest (ROIs) were outlined by 2 experienced radiologists based on subtracted T1ρ-weighted MR images. Transfer learning was applied to develop 2D attention U-Net convolutional neural networks for the menisci segmentation based on each radiologist's ROIs separately. Dice scores were calculated to assess segmentation performance. Next, the T1, T1ρ, T2* relaxations, and ROI areas were determined for the manual and automatic segmentations, then compared. Results: The models developed using ROIs provided by 2 radiologists achieved high Dice scores of 0.860 and 0.833, while the radiologists' manual segmentations achieved a Dice score of 0.820. Linear correlation coefficients for the T1, T1ρ, and T2* relaxations calculated using the automatic and manual segmentations ranged between 0.90 and 0.97, and there were no associated differences between the estimated average meniscal relaxation parameters. The deep learning models achieved segmentation performance equivalent to the inter-observer variability of 2 radiologists. Conclusion: The proposed deep learning-based approach can be used to efficiently generate automatic segmentations and determine meniscal relaxations times. The method has the potential to help radiologists with the assessment of meniscal diseases, such as OA. Słowa kluczowe: deep learning, menisci, osteoarthritis, quantitative MR, segmentation Afiliacje autorów:
Byra M. | - | IPPT PAN | Wu M. | - | University of California (US) | Zhang X. | - | University of California (US) | Jang H. | - | University of California (US) | Ma Y-J. | - | University of California (US) | Chang E.Y. | - | University of California (US) | Shah S. | - | University of California (US) | Du J. | - | University of California (US) |
| | 100p. |
19. |
Byra M., Hentzen E.♦, Du J.♦, Andre M.♦, Chang E.Y.♦, Shah S.♦, Assessing the performance of morphologic and echogenic features in median nerve ultrasound for carpal tunnel syndrome diagnosis,
Journal of Ultrasound in Medicine, ISSN: 0278-4297, DOI: 10.1002/jum.15201, Vol.39, No.6, pp.1165-1174, 2020Streszczenie: Objectives: To assess the feasibility of using ultrasound (US) image features related to the median nerve echogenicity and shape for carpal tunnel syndrome (CTS) diagnosis. Methods: In 31 participants (21 healthy participants and 10 patients with CTS), US images were collected with a 30-MHz transducer from median nerves at the wrist crease in 2 configurations: a neutral position and with wrist extension. Various morphologic features, including the cross-sectional area (CSA), were calculated to assess the nerve shape. Carpal tunnel syndrome commonly results in loss of visualization of the nerve fascicular pattern on US images. To assess this phenomenon, we developed a nerve-tissue contrast index (NTI) method. The NTI is a ratio of average brightness levels of surrounding tissue and the median nerve, both calculated on the basis of a US image. The area under the curve (AUC) from a receiver operating characteristic curve analysis and t test were used to assess the usefulness of the features for differentiation of patients with CTS from control participants. Results: We obtained significant differences in the CSA and NTI parameters between the patients with CTS and control participants (P < .01), with the corresponding highest AUC values equal to 0.885 and 0.938, respectively. For the remaining investigated morphologic features, the AUC values were less than 0.685, and the differences in means between the patients and control participants were not statistically significant (P > .10). The wrist configuration had no impact on differences in average parameter values (P > .09). Conclusions: Patients with CTS can be differentiated from healthy individuals on the basis of the median nerve CSA and echogenicity. Carpal tunnel syndrome is not manifested in a change of the median nerve shape that could be related to circularity or contour variability. Słowa kluczowe: carpal tunnel syndrome, cross-sectional area, echogenicity, median nerve, morphologic features, ultrasound Afiliacje autorów:
Byra M. | - | IPPT PAN | Hentzen E. | - | inna afiliacja | Du J. | - | University of California (US) | Andre M. | - | University of California (US) | Chang E.Y. | - | University of California (US) | Shah S. | - | University of California (US) |
| | 70p. |
20. |
Guo T.♦, Ma Y-J.♦, High R.A.♦, Tang Q.♦, Wong J.H.♦, Byra M., Searleman A.C.♦, To S.C.♦, Wan L.♦, Le N.♦, Du J.♦, Chang E.♦, Assessment of an in vitro model of rotator cuff degeneration using quantitative magnetic resonance and ultrasound imaging with biochemical and histological correlation,
European Journal of Radiology, ISSN: 0720-048X, DOI: 10.1016/j.ejrad.2019.108706, Vol.121, pp.108706-1-10, 2019Streszczenie: Purpose: Quantitative imaging methods could improve diagnosis of rotator cuff degeneration, but the capability of quantitative MR and US imaging parameters to detect alterations in collagen is unknown. The goal of this study was to assess quantitative MR and US imaging measures for detecting abnormalities in collagen using an in vitro model of tendinosis with biochemical and histological correlation. Method: 36 pieces of supraspinatus tendons from 6 cadaveric donors were equally distributed into 3 groups (2 subjected to different concentrations of collagenase and a control group). Ultrashort echo time MR and US imaging measures were performed to assess changes at baseline and after 24 h of enzymatic digestion. Biochemical and histological measures, including brightfield, fluorescence, and polarized microscopy, were used to verify the validity of the model and were compared with quantitative imaging parameters. Correlations between the imaging parameters and biochemically measured digestion were analyzed. Results: Among the imaging parameters, macromolecular fraction (MMF), adiabatic T1p, T2*, and backscatter coefficient (BSC) were useful in differentiating between the extent of degeneration among the 3 groups. MMF strongly correlated with collagen loss (r=-0.81; 95% confidence interval [CI]: -0.90,-0.66), while the adiabatic T1p (r = 0.66; CI: 0.42,0.81), T2* (r = 0.58; CI: 0.31,0.76), and BSC (r = 0.51; CI: 0.22,0.72) moderately correlated with collagen loss. Conclusions: MMF, adiabatic T1p, and T2* measured and US BSC can detect alterations in collagen. Of the quantitative MR and US imaging measures evaluated, MMF showed the highest correlation with collagen loss and can be used to assess rotator cuff degeneration. Słowa kluczowe: rotator cuff tendon, tendinopathy, quantitative MRI, UTE, quantitative ultrasound Afiliacje autorów:
Guo T. | - | University of California (US) | Ma Y-J. | - | University of California (US) | High R.A. | - | University of California (US) | Tang Q. | - | University of California (US) | Wong J.H. | - | University of California (US) | Byra M. | - | IPPT PAN | Searleman A.C. | - | University of California (US) | To S.C. | - | University of California (US) | Wan L. | - | University of California (US) | Le N. | - | University of California (US) | Du J. | - | University of California (US) | Chang E. | - | University of California (US) |
| | 100p. |
21. |
Byra M., Galperin M.♦, Ojeda-Fournier H.♦, Olson L.♦, O Boyle M.♦, Comstock C.♦, Andre M.♦, Breast mass classification in sonography with transfer learning using a deep convolutional neural network and color conversion,
Medical Physics, ISSN: 0094-2405, DOI: 10.1002/mp.13361, Vol.46, No.2, pp.746-755, 2019Streszczenie: Purpose: We propose a deep learning-based approach to breast mass classification in sonographyand compare it with the assessment of four experienced radiologists employing breast imagingreporting and data system 4th edition lexicon and assessment protocol. Methods: Several transfer learning techniques are employed to develop classifiers based on a set of882 ultrasound images of breast masses. Additionally, we introduce the concept of a matching layer. The aim of this layer is to rescale pixel intensities of the grayscale ultrasound images and convertthose images to red, green, blue (RGB) to more efficiently utilize the discriminative power of theconvolutional neural network pretrained on the ImageNet dataset. We present how this conversioncan be determined during fine-tuning using back-propagation. Next, we compare the performance ofthe transfer learning techniques with and without the color conversion. To show the usefulness of ourapproach, we additionally evaluate it using two publicly available datasets. Results: Color conversion increased the areas under the receiver operating curve for each transferlearning method. For the better-performing approach utilizing the fine-tuning and the matching layer,the area under the curve was equal to 0.936 on a test set of 150 cases. The areas under the curves forthe radiologists reading the same set of cases ranged from 0.806 to 0.882. In the case of the two sepa-rate datasets, utilizing the proposed approach we achieved areas under the curve of around 0.890. Conclusions: The concept of the matching layer is generalizable and can be used to improve theoverall performance of the transfer learning techniques using deep convolutional neural networks. When fully developed as a clinical tool, the methods proposed in this paper have the potential to helpradiologists with breast mass classification in ultrasound. Słowa kluczowe: BI-RADS, breast mass classification, convolutional neural networks, transfer learning, ultrasound imaging Afiliacje autorów:
Byra M. | - | IPPT PAN | Galperin M. | - | Almen Laboratories, Inc. (US) | Ojeda-Fournier H. | - | University of California (US) | Olson L. | - | University of California (US) | O Boyle M. | - | University of California (US) | Comstock C. | - | Memorial Sloan-Kettering Cancer Center (US) | Andre M. | - | University of California (US) |
| | 100p. |
22. |
Byra M., Wan L.♦, Wong J.H.♦, Du J.♦, Shah SB.♦, Andre M.P.♦, Chang E.Y.♦, Quantitative ultrasound and b-mode image texture featurescorrelate with collagen and myelin content in human ulnarnerve fascicles,
ULTRASOUND IN MEDICINE AND BIOLOGY, ISSN: 0301-5629, DOI: 10.1016/j.ultrasmedbio.2019.02.019, Vol.45, No.7, pp.1830-1840, 2019Streszczenie: We investigate the usefulness of quantitative ultrasound and B-mode texture features for characterization of ulnar nerve fascicles. Ultrasound data were acquired from cadaveric specimens using a nominal 30-MHz probe. Next, the nerves were extracted to prepare histology sections. Eighty-five fascicles were matched between the B-mode images and the histology sections. For each fascicle image, we selected an intra-fascicular region of interest. We used histology sections to determine features related to the concentration of collagen and myelin and ultrasound data to calculate the backscatter coefficient (–24.89 ± 8.31 dB), attenuation coefficient (0.92 ± 0.04 db/cm-MHz), Nakagami parameter (1.01 ± 0.18) and entropy (6.92 ± 0.83), as well as B-mode texture features obtained via the gray-level co-occurrence matrix algorithm. Significant Spearman rank correlations between the combined collagen and myelin concentrations were obtained for the backscatter coefficient (R = –0.68), entropy (R = –0.51) and several texture features. Our study indicates that quantitative ultrasound may potentially provide information on structural components of nerve fascicles. Słowa kluczowe: nerve, quantitative ultrasound, high frequency, histology, pattern recognition, texture analysis Afiliacje autorów:
Byra M. | - | IPPT PAN | Wan L. | - | University of California (US) | Wong J.H. | - | University of California (US) | Du J. | - | University of California (US) | Shah SB. | - | University of California (US) | Andre M.P. | - | University of California (US) | Chang E.Y. | - | University of California (US) |
| | 70p. |
23. |
Byra M., Styczyński G.♦, Szmigielski C.♦, Kalinowski P.♦, Michałowski Ł.♦, Paluszkiewicz R.♦, Ziarkiewicz-Wróblewska B.♦, Zieniewicz K.♦, Sobieraj P.♦, Nowicki A., Transfer learning with deep convolutiona lneural network for liver steatosis assessment in ultrasound images,
International Journal of Computer Assisted Radiology and Surgery, ISSN: 1861-6410, DOI: 10.1007/s11548-018-1843-2, Vol.13, No.12, pp.1895-1903, 2018Streszczenie: Purpose
The nonalcoholic fatty liver disease is the most common liver abnormality. Up to date, liver biopsy is the reference standard for direct liver steatosis quantification in hepatic tissue samples. In this paper we propose a neural network-based approach for nonalcoholic fatty liver disease assessment in ultrasound.
Methods
We used the Inception-ResNet-v2 deep convolutional neural network pre-trained on the ImageNet dataset to extract high-level features in liver B-mode ultrasound image sequences. The steatosis level of each liver was graded by wedge biopsy. The proposed approach was compared with the hepatorenal index technique and the gray-level co-occurrence matrix algorithm. After the feature extraction, we applied the support vector machine algorithm to classify images containing fatty liver. Based on liver biopsy, the fatty liver was defined to have more than 5% of hepatocytes with steatosis. Next, we used the features and the Lasso regression method to assess the steatosis level.
Results
The area under the receiver operating characteristics curve obtained using the proposed approach was equal to 0.977, being higher than the one obtained with the hepatorenal index method, 0.959, and much higher than in the case of the gray-level co-occurrence matrix algorithm, 0.893. For regression the Spearman correlation coefficients between the steatosis level and the proposed approach, the hepatorenal index and the gray-level co-occurrence matrix algorithm were equal to 0.78, 0.80 and 0.39, respectively.
Conclusions
The proposed approach may help the sonographers automatically diagnose the amount of fat in the liver. The presented approach is efficient and in comparison with other methods does not require the sonographers to select the region of interest. Słowa kluczowe: Nonalcoholic fatty, liver disease, Ultrasound imaging Deep learning, Convolutional neural networks, Hepatorenal index, Transfer learning Afiliacje autorów:
Byra M. | - | IPPT PAN | Styczyński G. | - | Medical University of Warsaw (PL) | Szmigielski C. | - | Medical University of Warsaw (PL) | Kalinowski P. | - | Medical University of Warsaw (PL) | Michałowski Ł. | - | Medical University of Warsaw (PL) | Paluszkiewicz R. | - | Medical University of Warsaw (PL) | Ziarkiewicz-Wróblewska B. | - | Medical University of Warsaw (PL) | Zieniewicz K. | - | Medical University of Warsaw (PL) | Sobieraj P. | - | Medical University of Warsaw (PL) | Nowicki A. | - | IPPT PAN |
| | 25p. |
24. |
Byra M., Wójcik J., Nowicki A., Using Empirical Mode Decomposition of Backscattered Ultrasound Signal Power Spectrum for Assessment of Tissue Compression,
ARCHIVES OF ACOUSTICS, ISSN: 0137-5075, DOI: 10.24425/123916, Vol.43, No.3, pp.447-453, 2018Streszczenie: Quantitative ultrasound has been widely used for tissue characterization. In this paper we propose a new approach for tissue compression assessment. The proposed method employs the relation between the tissue scatterers' local spatial distribution and the resulting frequency power spectrum of the backscat- tered ultrasonic signal. We show that due to spatial distribution of the scatterers, the power spectrum exhibits characteristic variations. These variations can be extracted using the empirical mode decomposition and analyzed. Validation of our approach is performed by simulations and in-vitro experiments using a tissue sample under compression. The scatterers in the compressed tissue sample approach each other and consequently, the power spectrum of the backscattered signal is modified. We present how to assess this phenomenon with our method. The proposed in this paper approach is general and may provide useful information on tissue scattering properties. Słowa kluczowe: tissue characterization, tissue compression, quantitative ultrasound, empirical mode decomposition, signal anaysis Afiliacje autorów:
Byra M. | - | IPPT PAN | Wójcik J. | - | IPPT PAN | Nowicki A. | - | IPPT PAN |
| | 20p. |
25. |
Byra M., Discriminant analysis of neural style representations for breast lesion classification in ultrasound,
Biocybernetics and Biomedical Engineering, ISSN: 0208-5216, DOI: 10.1016/j.bbe.2018.05.003, Vol.38, pp.684-690, 2018Streszczenie: Ultrasound imaging is widely used for breast lesion differentiation. In this paper we propose a neural transfer learning method for breast lesion classification in ultrasound. As reported in several papers, the content and the style of a particular image can be separated with a convolutional neural network. The style, coded by the Gram matrix, can be used to perform neural transfer of artistic style. In this paper we extract the neural style representations of malignant and benign breast lesions using the VGG19 neural network. Next, the Fisher discriminant analysis is used to separate those neural style representations and perform classification. The proposed approach achieves good classification performance (AUC of 0.847). Our method is compared with another transfer learning technique based on extracting pooling layer features (AUC of 0.826). Moreover, we apply the Fisher discriminant analysis to differentiate breast lesions using ultrasound images (AUC of 0.758). Additionally, we extract the eigenimages related to malignant and benign breast lesions and show that these eigenimages present features commonly associated with lesion type, such as contour attributes or shadowing. The proposed techniques may be useful for the researchers interested in ultrasound breast lesion characterization. Słowa kluczowe: Breast lesions classification, Deep learning, Discriminant analysis, Transfer learning, Ultrasound imaging Afiliacje autorów:
| | 15p. |
26. |
Piotrzkowska-Wróblewska H., Dobruch-Sobczak K., Byra M., Nowicki A., Open access database of raw ultrasonic signals acquired from malignant and benign breast lesions,
Medical Physics, ISSN: 0094-2405, DOI: 10.1002/mp.12538, Vol.44, No.11, pp.6105-6109, 2017Streszczenie: Purpose: The aim of this paper is to provide access to a database consisting of the raw radio-frequency ultrasonic echoes acquired from malignant and benign breast lesions. The database is freely available for study and signal analysis. Acquisition and validation methods: The ultrasonic radio-frequency echoes were recorded from breast focal lesions of patients of the Institute of Oncology in Warsaw. The data were collected between 11/2013 and 10/2015. Patients were examined by a radiologist with 18 yr' experience in the ultrasonic examination of breast lesions. The set of data includes scans from 52 malignant and 48 benign breast lesions recorded in a group of 78 women. For each lesion, two individual orthogonal scans from the pathological region were acquired with the Ultrasonix SonixTouch Research ultrasound scanner using the L14-5/38 linear array transducer. All malignant lesions were histologically assessed by core needle biopsy. In the case of benign lesions, part of them was histologically assessed and another part was observed over a 2-year period. Data format and usage notes: The radio-frequency echoes were stored in Matlab file format. For each scan, the region of interest was provided to correctly indicate the lesion area. Moreover, for each lesion, the BI-RADS category and the lesion class were included. Two code examples of data manipulation are presented. The data can be downloaded via the Zenodo repository (https://doi.org/10.5281/zenodo.545928) or the website http ://bluebox.ippt.gov.pl/~hpiotrzk. Potential applications: The database can be used to test quantitative ultrasound techniques and ultrasound image processing algorithms, or to develop computer-aided diagno sis systems. Słowa kluczowe: breast lesions, dataset, ultrasonic signals, ultrasonography Afiliacje autorów:
Piotrzkowska-Wróblewska H. | - | IPPT PAN | Dobruch-Sobczak K. | - | IPPT PAN | Byra M. | - | IPPT PAN | Nowicki A. | - | IPPT PAN |
| | 35p. |
27. |
Kujawska T., Secomski W., Byra M., Postema M., Nowicki A., Annular phased array transducer for preclinical testing of anti-cancer drug efficacy on small animals,
Ultrasonics, ISSN: 0041-624X, DOI: 10.1016/j.ultras.2016.12.008, Vol.76, pp.92-98, 2017Streszczenie: A technique using pulsed High Intensity Focused Ultrasound (HIFU) to destroy deep-seated solid tumors is a promising noninvasive therapeutic approach. A main purpose of this study was to design and test a HIFU transducer suitable for preclinical studies of efficacy of tested, anti-cancer drugs, activated by HIFU beams, in the treatment of a variety of solid tumors implanted to various organs of small animals at the depth of the order of 1–2 cm under the skin. To allow focusing of the beam, generated by such transducer, within treated tissue at different depths, a spherical, 2-MHz, 29-mm diameter annular phased array transducer was designed and built. To prove its potential for preclinical studies on small animals, multiple thermal lesions were induced in a pork loin ex vivo by heating beams of the same: 6 W, or 12 W, or 18 W acoustic power and 25 mm, 30 mm, and 35 mm focal lengths. Time delay for each annulus was controlled electronically to provide beam focusing within tissue at the depths of 10 mm, 15 mm, and 20 mm. The exposure time required to induce local necrosis was determined at different depths using thermocouples. Location and extent of thermal lesions determined from numerical simulations were compared with those measured using ultrasound and magnetic resonance imaging techniques and verified by a digital caliper after cutting the tested tissue samples. Quantitative analysis of the results showed that the location and extent of necrotic lesions on the magnetic resonance images are consistent with those predicted numerically and measured by caliper. The edges of lesions were clearly outlined although on ultrasound images they were fuzzy. This allows to conclude that the use of the transducer designed offers an effective noninvasive tool not only to induce local necrotic lesions within treated tissue without damaging the surrounding tissue structures but also to test various chemotherapeutics activated by the HIFU beams in preclinical studies on small animals. Słowa kluczowe: spherical annular phased array transducer, pulsed HIFU beam, electronically adjustable focal length, local tissue heating, thermal ablation, necrotic lesion Afiliacje autorów:
Kujawska T. | - | IPPT PAN | Secomski W. | - | IPPT PAN | Byra M. | - | IPPT PAN | Postema M. | - | IPPT PAN | Nowicki A. | - | IPPT PAN |
| | 35p. |
28. |
Byra M., Kruglenko E., Gambin B., Nowicki A., Temperature Monitoring during Focused Ultrasound Treatment by Means of the Homodyned K Distribution,
ACTA PHYSICA POLONICA A, ISSN: 0587-4246, DOI: 10.12693/APhysPolA.131.1525, Vol.131, No.6, pp.1525-1528, 2017Streszczenie: Temperature monitoring is essential for various medical treatments. In this work, we investigate the impact of temperature on backscattered ultrasound echo statistics during a high intensity focused ultrasound treatment. A tissue mimicking phantom was heated with a spherical ultrasonic transducer up to 56 _C in order to imitate tissue necrosis. During the heating, an imaging scanner was used to acquire backscattered echoes from the heated region. These data was then modeled with the homodyned K distribution. We found that the best temperature indicator can be obtained by combining two parameters of the model, namely the backscattered echo mean intensity and the effective number of scatterers per resolution cell. Next, ultrasonic thermometer was designed and used to create a map of the temperature induced within the tissue phantom during the treatment Słowa kluczowe: Temperature monitoring, homodyned K distribution, focused ultrasound Afiliacje autorów:
Byra M. | - | IPPT PAN | Kruglenko E. | - | IPPT PAN | Gambin B. | - | IPPT PAN | Nowicki A. | - | IPPT PAN |
| | 15p. |
29. |
Byra M., Nowicki A., Piotrzkowska-Wróblewska H., Dobruch-Sobczak K., Classification of breast lesions using segmented quantitative ultrasound maps of homodyned K distribution parameters,
Medical Physics, ISSN: 0094-2405, DOI: 10.1118/1.4962928, Vol.43, No.10, pp.5561-5569, 2016Streszczenie: Purpose:
Statistical modeling of an ultrasound backscattered echo envelope is used for tissue characterization. However, in the presence of complex structures within the analyzed area, estimation of parameters is disturbed and unreliable, e.g., in the case of breast tumor classification. In order to improve the differentiation of breast lesions, the authors proposed a method based on the segmentation of homodyned K distribution parameter maps. Regions within lesions of different scattering properties were extracted and analyzed. In order to improve the classification, the best-performing features were selected from various regions and then combined.
Methods: A radio-frequency data set consisting of 103 breast lesions was used in the authors’ analysis. Maps of homodyned K distribution parameters were created using an algorithm based on signal-to-noise ratio, kurtosis, and skewness of fractional-order envelope moments. A Markov random field model was used to segment parametric maps. Features of different segments were extracted and evaluated based on bootstrapping and the receiver operating characteristic curve. To determine the best-performing feature subset, the authors applied the joint mutual information criterion.
Results:
It was found that there were individual features which performed better than the ones commonly used for lesion characterization, like the parameter obtained through averaging of values over the whole lesion. The authors selected and discussed the best-performing features. Properties of different extracted regions were important and improved the distinction between benign and malignant tumors. The best performance was obtained by combining four features with the area under the receiver operating curve of 0.84.
Conclusions:
The study showed that the analysis of internal changes in lesion parametric maps leads to a better classification of breast tumors. The authors recommend combining multiple features for characterization, instead of using only one parameter, especially in the case of heterogeneous lesions. Słowa kluczowe: Cancer, Ultrasonography, Backscattering, Data sets, Medical image noise Afiliacje autorów:
Byra M. | - | IPPT PAN | Nowicki A. | - | IPPT PAN | Piotrzkowska-Wróblewska H. | - | IPPT PAN | Dobruch-Sobczak K. | - | IPPT PAN |
| | 35p. |
30. |
Gambin B., Byra M., Kruglenko E., Doubrovina O.♦, Nowicki A., Ultrasonic Measurement of Temperature Rise in Breast Cyst and in Neighbouring Tissues as a Method of Tissue Differentiation,
ARCHIVES OF ACOUSTICS, ISSN: 0137-5075, DOI: 10.1515/aoa-2016-0076, Vol.41, No.4, pp.791-798, 2016Streszczenie: Texture of ultrasound images contain information about the properties of examined tissues. The analysis of statistical properties of backscattered ultrasonic echoes has been recently successfully applied to differentiate healthy breast tissue from the benign and malignant lesions. We propose a novel procedure of tissue characterization based on acquiring backscattered echoes from the heated breast. We have proved that the temperature increase inside the breast modifies the intensity, spectrum of the backscattered signals and the probability density function of envelope samples. We discuss the differences in probability density functions in two types of tissue regions, e.g. cysts and the surrounding glandular tissue regions. Independently, Pennes bioheat equation in heterogeneous breast tissue was used to describe the heating process. We applied the finite element method to solve this equation. Results have been compared with the ultrasonic predictions of the temperature distribution. The results confirm the possibility of distinguishing the differences in thermal and acoustical properties of breast cyst and surrounding glandular tissues. Słowa kluczowe: medical ultrasound, temperature changes in vivo, breast tissue, ultrasonic temperature measurement Afiliacje autorów:
Gambin B. | - | IPPT PAN | Byra M. | - | IPPT PAN | Kruglenko E. | - | IPPT PAN | Doubrovina O. | - | Belarussian State University (BY) | Nowicki A. | - | IPPT PAN |
| | 15p. |
31. |
Wójcik J., Byra M., Nowicki A., A spectral-based method for tissue characterization,
HYDROACOUSTICS, ISSN: 1642-1817, Vol.19, pp.369-375, 2016Streszczenie: Quantitative ultrasound methods are widely investigated as a promising tool for tissue characterization. In this paper, a novel quantitative method is developed which can be used to assess scattering properties of tissues. The proposed method is based on analysis of oscillations of the backscattered echo power spectrum. It is shown that these oscillations of the power spectrum are connected with the distances between scatterers within the medium. Two techniques are proposed to assess the scatterer’s distribution. First, we show that the inverse Fourier transform of the backscattered echo power spectrum corresponds to a histogram of the distances between scatterers. Second, the Hilbert-Huang transform is used to directly extract the power spectrum oscillations. Both methods are examined by means of a numerical experiment. A cellular gas model of a biological medium is considered. Results are presented and discussed. Both methods can be used to evaluate the scatterer’s distribution by means of the power spectrum oscillations. Słowa kluczowe: quantitative ultrasound, signal analysis, wave scattering Afiliacje autorów:
Wójcik J. | - | IPPT PAN | Byra M. | - | IPPT PAN | Nowicki A. | - | IPPT PAN |
| | 6p. |
32. |
Gambin B., Kruglenko E., Byra M., Relationships between Acoustical Properties and Stiffness of Soft Tissue Phantoms,
HYDROACOUSTICS, ISSN: 1642-1817, Vol.19, pp.111-120, 2016Streszczenie: Polyvinyl-alcohol cryogel is commonly used for soft tissue phantom manufacture. The gel formation from an aqueous solution of polyvinyl-alcohol takes place during the freezing and thawing cycle. The aim of this work was to assess the degree of gel solidification, hence the material stiffness, by means of quantitative ultrasound. We manufactured three phantoms which differed in the number of freezing/thawing cycles. First, tissue phantoms were examined with an elastography technique. Next, we measured the speed of sound and the attenuation coefficient. What is more, the inter structure variations in phantoms were assessed with the Nakagami imaging which quantifies the scattering properties of the backscattered ultrasound echo. Obtained results confirmed the connection between the number of freezing/thawing cycles and the solidification process. We defined the boundary layer as a region which has a different structure than the sample interior. Next, for each phantom this layer was extracted based on a Nakagami parameter map. We calculated that the thickness of the boundary layer was lower in samples which were subjected to a larger number of freezing/thawing cycles. Słowa kluczowe: soft tissue phantoms, elastography, ultrasound attenuation, speed of sound, Nakagami maps, stiffness Afiliacje autorów:
Gambin B. | - | IPPT PAN | Kruglenko E. | - | IPPT PAN | Byra M. | - | IPPT PAN |
| | 6p. |
33. |
Byra M., Gambin B., Temperature detection based on nonparametric statistics of ultrasound echoes,
HYDROACOUSTICS, ISSN: 1642-1817, Vol.18, pp.17-23, 2015Streszczenie: Different ultrasound echoes properties have been used for the noninvasive temperature monitoring. Temperature variations that occur during heating/cooling process induce changes in a random process of ultrasound backscattering. It was already proved that the probability distribution of the backscattered RF (radio frequency) signals is sensitive to the temperature variations. Contrary to previously used methods which explored models of scattering and involved techniques of fitting histograms to a special probability distribution two more direct measures of changes in statistics are proposed in this paper as temperature markers. They measure the ”distance” between the probability distributions. The markers are the Kolmogorov Smirnov distance and Kulback-Leiber divergence. The feasibility of using such nonparametric statistics for noninvasive ultrasound temperature estimation is demonstrated on the ultrasounds data collected during series of heating experiments in which the temperature was independently registered by the classical thermometer or thermocouples. Słowa kluczowe: ultrasoud echoes, non-invasive temperaturę monitoring, Kolmogorov Smirnov distance, Kulback-Leiber divergence Afiliacje autorów:
Byra M. | - | IPPT PAN | Gambin B. | - | IPPT PAN |
| | 6p. |
34. |
Nowicki A., Byra M., Litniewski J., Wójcik J., Ultrasound imaging of stiffness with two frequency pulse,
HYDROACOUSTICS, ISSN: 1642-1817, Vol.17, pp.151-160, 2014Streszczenie: Nowadays there are new modalities in ultrasound imaging allowing better characterization of tissue regions with different stiffness. We are proposing a novel approach based on compression and rarefaction of tissue simultaneously with imaging. The propagating wave is a combination of two pulses. A low frequency pulse is expected to change the local scattering properties of the tissue due to compression/rarefaction while a high frequency pulse is used for imaging. Two transmissions are performed for each scanning line. First, with the imaging pulse that propagates on maximum compression caused by a low frequency wave. Next, the low frequency wave is inverted and the imaging pulse propagates over the maximum rarefaction. After the processing of the subtracted echoes from subsequent transmissions including wavelet transform and band-pass filtering, differential images were reconstructed. The low frequency wave has a visible impact on the scattering properties of the tissue which can be observed on a differential image. Afiliacje autorów:
Nowicki A. | - | IPPT PAN | Byra M. | - | IPPT PAN | Litniewski J. | - | IPPT PAN | Wójcik J. | - | IPPT PAN |
| | 7p. |