Objective. The image reconstruction of ultrasound computed tomography is computationally expensive with conventional iterative methods. The fully learned direct deep learning reconstruction is promising to speed up image reconstruction significantly. However, for direct reconstruction from measurement data, due to the lack of real labeled data, the neural network is usually trained on a simulation dataset and shows poor performance on real data because of the simulation-to-real gap.Approach. To improve the simulation-to-real generalization of neural networks, a series of strategies are developed including a Fourier-transform-integrated neural network, measurement-domain data augmentation methods, and a self-supervised-learning-based patch-wise preprocessing neural network. Our strategies are evaluated on both the simulation dataset and real measurement datasets from two different prototype machines.Main results. The experimental results show that our deep learning methods help to improve the neural networks' robustness against noise and the generalizability to real measurement data.Significance. Our methods prove that it is possible for neural networks to achieve superior performance to traditional iterative reconstruction algorithms in imaging quality and allow for real-time 2D-image reconstruction. This study helps pave the path for the application of deep learning methods to practical ultrasound tomography image reconstruction based on simulation datasets.

Deep neural networks have proven to excel classical medical image reconstruction techniques. Some networks are based on fully connected (FC) layers to achieve domain transformation such as from the data acquisition domain to the image domain. However, FC layers result in huge numbers of parameters which take a lot of GPU memory. Hence, they do not scale well, and the overall performance is limited. For ultrasound computed tomography (USCT) application, we propose a memory-efficient convolutional network that reconstructs images from the frequency domain to image domain with much less parameters compared with multilayer perceptron, by using data-driven learning. Extensive experiments demonstrate that our method achieves high reconstruction quality. It improves the structural similarity measure (SSIM) from 0.73 to 0.99 when compared with state-of-the-art reconstruction methods in this field while reduces 2/3 parameters when compared with deep neural network with FC layers to reconstruct images from frequency domain to image domain.

Image reconstruction of ultrasound computed tomography based on the wave equation is able to show much more structural details than simpler ray-based image reconstruction methods. However, to invert the wave-based forward model is computationally demanding. To address this problem, we develop an efficient fully learned image reconstruction method based on a convolutional neural network. The image is reconstructed via one forward propagation of the network given input sensor data, which is much faster than the reconstruction using conventional iterative optimization methods. To transform the ultrasound measured data in the sensor domain into the reconstructed image in the image domain, we apply multiple down-scaling and up-scaling convolutional units to efficiently increase the number of hidden layers with a large receptive and projective field that can cover all elements in inputs and outputs, respectively. For dataset generation, a paraxial approximation forward model is used to simulate ultrasound measurement data. The neural network is trained with a dataset derived from natural images in ImageNet and tested with a dataset derived from medical images in OA-Breast Phantom dataset. Test results show the superior efficiency of the proposed neural network to other reconstruction algorithms including popular neural networks. When compared with conventional iterative optimization algorithms, our neural network can reconstruct a 110 × 86 image more than 20 times faster on a CPU and 1000 times faster on a GPU with comparable image quality and is also more robust to noise.