We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
No ground truth needed: unsupervised sinogram inpainting for nanoparticle electron tomography (UsiNet) to correct missing wedges
Summary
Researchers developed an unsupervised deep learning method called UsiNet for correcting missing wedge artifacts in electron tomography without needing ground truth data. The technique improves three-dimensional imaging of complex materials at the nanoscale, which is relevant for characterizing synthetic nanoparticles and microstructural domains.
Abstract Complex natural and synthetic materials, such as subcellular organelles, device architectures in integrated circuits, and alloys with microstructural domains, require characterization methods that can investigate the morphology and physical properties of these materials in three dimensions (3D). Electron tomography has unparalleled (sub-)nm resolution in imaging 3D morphology of a material, critical for charting a relationship among synthesis, morphology, and performance. However, electron tomography has long suffered from an experimentally unavoidable missing wedge effect, which leads to undesirable and sometimes extensive distortion in the final reconstruction. Here we develop and demonstrate Unsupervised Sinogram Inpainting for Nanoparticle Electron Tomography (UsiNet) to correct missing wedges. UsiNet is the first sinogram inpainting method that can be realistically used for experimental electron tomography by circumventing the need for ground truth. We quantify its high performance using simulated electron tomography of nanoparticles (NPs). We then apply UsiNet to experimental tomographs, where >100 decahedral NPs and vastly different byproduct NPs are simultaneously reconstructed without missing wedge distortion. The reconstructed NPs are sorted based on their 3D shapes to understand the growth mechanism. Our work presents UsiNet as a potent tool to advance electron tomography, especially for heterogeneous samples and tomography datasets with large missing wedges, e.g. collected for beam sensitive materials or during temporally-resolved in-situ imaging.
Sign in to start a discussion.
More Papers Like This
Deep Neural Networks for Image Processing and Biomolecular Single-Particle 3D Reconstruction from Electron Micrographs
Researchers developed novel deep learning models for processing electron micrograph images and performing biomolecular single-particle 3D reconstruction, addressing the inverse problem of extracting accurate sample information from noisy electron micrographs affected by aberrations, astigmatism, and detection noise in imperfect imaging systems.
Synthetic Image Rendering Solves Annotation Problem in Deep Learning Nanoparticle Segmentation
Researchers developed a synthetic image rendering approach to solve the annotation bottleneck in deep learning-based nanoparticle segmentation, generating labeled training data automatically to enable precise statistical characterization of nanoparticle size and shape distributions.
A Comparative Study of State-of-the-Art Deep Learning Models for Semantic Segmentation of Pores in Scanning Electron Microscope Images of Activated Carbon
Researchers developed deep learning models to automatically identify and measure pores on activated carbon surfaces from electron microscope images. The study introduced a new dataset and tested several state-of-the-art models for this task, showing promising results compared to slow and costly manual analysis. The findings suggest that AI-based approaches could make quality assessment of activated carbon more efficient for applications in water purification and air filtration.
Automatic Segmentation of Novel Coronavirus Pneumonia Lesions in CT Images Utilizing Deep-Supervised Ensemble Learning Network
Researchers developed a deep-supervised full-resolution residual network for automatic segmentation of COVID-19 pneumonia lesions in CT images, achieving high accuracy in delineating ground-glass opacities and consolidations to assist clinical diagnosis.
Automatic quantification and classification of microplastics in scanning electron micrographs via deep learning
Researchers developed a deep learning system that can automatically detect and classify microplastics in scanning electron microscope images, replacing the time-consuming process of manual analysis. The system achieved high accuracy in identifying different types and shapes of microplastic particles, even very small ones that are difficult to spot by eye. This automated approach could significantly speed up microplastic monitoring and pollution assessment efforts.