J.P. Hoogenboom
Please Note
41 records found
1
Electron microscopy (EM) allows ultrastructural analysis of biological tissues and cells, but images frequently contain artifacts because biological samples have to undergo rigorous preparation to be resistant to vacuum conditions and electron beam exposure. Knowledge about the appearance of image artifacts and how they arise is crucial for their recognition and mitigation and for proper image interpretation. How artifacts appear depends strongly on the electron detection modality and the imaging conditions. Optical scanning transmission EM (OSTEM) is a detection technique compatible with single-beam and multibeam electron microscopes, in which tissue samples are directly deposited on a scintillator for imaging in transmission mode. Here, we identified several types of artifacts that may occur in single-beam and multibeam OSTEM. These artifacts arise or appear as a result of combining established sample preparation protocols with solid scintillator substrates and optical transmission detection. Artifacts can be effectively mitigated or minimized to ultimately enable high quality large-scale 2D and 3D acquisitions.
ColorEM-Net
Automated Segmentation of Structures in Large-Scale Electron Microscopy Using Element-Derived Ground Truth
Electron microscopy (EM) combined with energy dispersive x-ray (EDX) imaging (or ‘ColorEM’) of cells and tissues provides ultrastructural insight complemented with elemental context. The resulting hyperspectral datasets can be used to map the relative abundance of specific elements or subjected to more data-driven approaches such as spectral mixture analysis or clustering to highlight the ultrastructural components of interest. Despite the benefits of automatic segmentation over manual annotation, EDX imaging is two orders of magnitude slower than EM imaging precluding its routine use for segmentation. Large-scale ColorEM, however, does generate sufficient annotated labels, which we use as ground truth to train U-Net models, and thus enables the transfer of these labels to conventional EM data. Here, we present ColorEM-Net, a label-free segmentation technique based on features obtained from unsupervised clustering of ColorEM data. ColorEM-Net achieves label-free identification with over 95% accuracy for nuclei, lysosomes and exocrine granules. However, with an accuracy of 79%, the recognition of endocrine granules needs further effort in training for reliable segmentation. By reusing open-access ColorEM datasets, this approach facilitates automated segmentation of EM data, while eliminating the need for manual annotation and achieving scalability for tissue-scale segmentation.
In volume fluorescence microscopy, refractive index matching is essential to minimize aberrations. There are, however, common imaging scenarios where a refractive index mismatch (RIM) between immersion and a sample medium cannot be avoided. This RIM leads to an axial deformation in the acquired image data. Over the years, different axial scaling factors have been proposed to correct for this deformation. While some reports have suggested a depth-dependent axial deformation, so far none of the scaling theories has accounted for a depth-dependent, non-linear scaling. Here, we derive an analytical theory based on determining the leading constructive interference band in the objective lens pupil under RIM. We then use this to calculate a depth-dependent re-scaling factor as a function of the numerical aperture (NA), the refractive indices n1 and n2, and the wavelength λ. We compare our theoretical results with wave-optics calculations and experimental results obtained using a measurement scheme for different values of NA and RIM. As a benchmark, we recorded multiple datasets in different RIM conditions, and corrected these using our depth-dependent axial scaling theory. Finally, we present an online web applet that visualizes the depth-dependent axial re-scaling for specific optical setups. In addition, we provide software that will help microscopists to correctly re-scale the axial dimension in their imaging data when working under RIM.
FAST-EM array tomography:
A workflow for multibeam volume electron microscopy
Recent advances in electron microscopy techniques have led to a significant scale up in volumetric imaging of biological tissue. The throughput of electron microscopes, however, remains a limiting factor for the volume that can be imaged in high resolution within reasonable time. Faster detection methods will improve throughput. Here, we have characterized and benchmarked a novel detection technique for scanning electron microscopy: optical scanning transmission electron microscopy (OSTEM). A qualitative and quantitative comparison was performed between OSTEM, secondary and backscattered electron detection and annular dark field detection in scanning transmission electron microscopy. Our analysis shows that OSTEM produces images similar to backscattered electron detection in terms of contrast, resolution and signal-to-noise ratio. OSTEM can complement large scale imaging with (scanning) transmission electron microscopy and has the potential to speed up imaging in single-beam scanning electron microscope.
A quantitative four-dimensional scanning transmission electron microscopy (4D-STEM) imaging technique (q4STEM) for local thickness estimation across amorphous specimen such as obtained by focused ion beam (FIB)-milling of lamellae for (cryo-)TEM analysis is presented. This study is based on measuring spatially resolved diffraction patterns to obtain the angular distribution of electron scattering, or the ratio of integrated virtual dark and bright field STEM signals, and their quantitative evaluation using Monte Carlo simulations. The method is independent of signal intensity calibrations and only requires knowledge of the detector geometry, which is invariant for a given instrument. This study demonstrates that the method yields robust thickness estimates for sub-micrometer amorphous specimen using both direct detection and light conversion 2D-STEM detectors in a coincident FIB-SEM and a conventional SEM. Due to its facile implementation and minimal dose reauirements, it is anticipated that this method will find applications for in situ thickness monitoring during lamella fabrication of beam-sensitive materials.
Het boek is een algemene introductie in het elektromagnetisme, zoals in de meeste Amerikaanse universiteiten in het eerste jaar wordt gegeven. Uiteindelijk worden de wetten van Maxwell in integraal-vorm gegeven. De begrippen elektrische lading, krachten en velden worden beschreven. Hieruit wordt het begrip potentiaal gedefinieerd, met als toepassing de condensator. Vervolgens wordt er een link gelegd tussen het macroscopische en microscopische beeld van elektrische stroom. De relatie tussen stroom en magnetisch veld wordt gelegd en geïllustreerd aan de hand van spoelen. Het gedrag van condensatoren en spoelen in wisselstroomschakelingen wordt afgeleid. Tot slot laten we zien dat elektromagnetische golven voldoen aan de wetten van Maxwell.
De studenten leren de wetten van Maxwell toe te passen in eenvoudige problemen. Ze leren grootheden uit te rekenen en eenvoudige afleidingen te maken. Ze passen symmetrie toe om een probleem wiskundig sterk te vereenvoudigen.
...
Het boek is een algemene introductie in het elektromagnetisme, zoals in de meeste Amerikaanse universiteiten in het eerste jaar wordt gegeven. Uiteindelijk worden de wetten van Maxwell in integraal-vorm gegeven. De begrippen elektrische lading, krachten en velden worden beschreven. Hieruit wordt het begrip potentiaal gedefinieerd, met als toepassing de condensator. Vervolgens wordt er een link gelegd tussen het macroscopische en microscopische beeld van elektrische stroom. De relatie tussen stroom en magnetisch veld wordt gelegd en geïllustreerd aan de hand van spoelen. Het gedrag van condensatoren en spoelen in wisselstroomschakelingen wordt afgeleid. Tot slot laten we zien dat elektromagnetische golven voldoen aan de wetten van Maxwell.
De studenten leren de wetten van Maxwell toe te passen in eenvoudige problemen. Ze leren grootheden uit te rekenen en eenvoudige afleidingen te maken. Ze passen symmetrie toe om een probleem wiskundig sterk te vereenvoudigen.
Need for Speed
Imaging Biological Ultrastructure with the 64-beams FAST-EM
Volume electron microscopy (EM) of biological systems has grown exponentially in recent years due to innovative large-scale imaging approaches. As a standalone imaging method, however, large-scale EM typically has two major limitations: slow rates of acquisition and the difficulty to provide targeted biological information. We developed a 3D image acquisition and reconstruction pipeline that overcomes both of these limitations by using a widefield fluorescence microscope integrated inside of a scanning electron microscope. The workflow consists of acquiring large field of view fluorescence microscopy (FM) images, which guide to regions of interest for successive EM (integrated correlative light and electron microscopy). High precision EM-FM overlay is achieved using cathodoluminescent markers. We conduct a proof-of-concept of our integrated workflow on immunolabelled serial sections of tissues. Acquisitions are limited to regions containing biological targets, expediting total acquisition times and reducing the burden of excess data by tens or hundreds of GBs.
Ultrafast scanning electron microscopy images carrier dynamics and carrier induced surface voltages using a laser pump electron probe scheme, potentially surpassing all-optical techniques in probe resolution and surface sensitivity. Current implementations have left a four order of magnitude gap between optical pump and electron probe resolution, which particularly hampers spatial resolution in the investigation of carrier induced local surface photovoltages. Here, we present a system capable of focusing the laser using an inverted optical microscope built into an ultrafast scanning electron microscopy setup to enable high numerical aperture pulsed optical excitation in conjunction with ultrafast electron beam probing. We demonstrate an order of magnitude improvement in optical pump resolution, bringing this to sub-micrometer length scales. We further show that temporal laser pump resolution can be maintained inside the scanning electron microscope by pre-compensating dispersion induced by the components required to bring the beam into the vacuum chamber and to a tight focus. We illustrate our approach using molybdenum disulfide, a two-dimensional transition metal dichalcogenide, where we measure ultrafast carrier relaxation rates and induced negative surface potentials between different flakes selected with the scanning electron microscope as well as on defined positions within a single flake.
Here, we demonstrate ultrafast scanning electron microscopy (SEM) for making ultrafast movies of mechanical oscillators at resonance with nanoscale spatiotemporal resolution. Locking the laser excitation pulse sequence to the electron probe pulses allows for video framerates over 50 MHz, well above the detector bandwidth, while maintaining the electron beam resolution and depth of focus. The pulsed laser excitation is tuned to the oscillator resonance with a pulse frequency modulation scheme. We use an atomic force microscope cantilever as a model resonator, for which we show ultrafast real-space imaging of the first and even the 2 MHz second harmonic oscillation as well as verification of power and frequency response via the ultrafast movies series. We detect oscillation amplitudes as small as 20 nm and as large as 9 μm. Our implementation of ultrafast SEM for visualizing nanoscale oscillatory dynamics adds temporal resolution to the domain of SEM, providing new avenues for the characterization and development of devices based on micro- and nanoscale resonant motion.
Super-resolution fluorescence microscopy can be achieved by image reconstruction after spatially patterned illumination or sequential photo-switching and read-out. Reconstruction algorithms and microscope performance are typically tested using simulated image data, due to a lack of strategies to pattern complex fluorescent patterns with nanoscale dimension control. Here, we report direct electron-beam patterning of fluorescence nanopatterns as calibration standards for super-resolution fluorescence. Patterned regions are identified with both electron microscopy and fluorescence labelling of choice, allowing precise correlation of predefined pattern dimensions, a posteriori obtained electron images, and reconstructed super-resolution images.
Focal adhesions (FAs) are the main cellular structures to link the intracellular cytoskeleton to the extracellular matrix. FAs mediate cell adhesion, are important for cell migration and are involved in many (patho)-physiological processes. Here we examined FAs and their associated actin fibres using correlative fluorescence and scanning electron microscopy (SEM). We used fluorescence images of cells expressing paxillin-GFP to define the boundaries of FA complexes in SEM images, without using SEM contrast enhancing stains. We observed that SEM contrast was increased around the actin fibre entry site in 98% of FAs, indicating increases in protein density and possibly also phosphorylation levels in this area. In nearly three quarters of the FAs, these nanostructures had a fork shape, with the actin forming the stem and the high-contrast FA areas the fork. In conclusion, the combination of fluorescent and electron microscopy allowed accurate localisation of a highly abundant, novel fork structure at the FA-actin interface.
Detailed knowledge of biological structure has been key in understanding biology at several levels of organisation, from organs to cells and proteins. Volume electron microscopy (volume EM) provides high resolution 3D structural information about tissues on the nanometre scale. However, the throughput rate of conventional electron microscopes has limited the volume size and number of samples that can be imaged. Recent improvements in methodology are currently driving a revolution in volume EM, making possible the structural imaging of whole organs and small organisms. In turn, these recent developments in image acquisition have created or stressed bottlenecks in other parts of the pipeline, like sample preparation, image analysis and data management. While the progress in image analysis is stunning due to the advent of automatic segmentation and server-based annotation tools, several challenges remain. Here we discuss recent trends in volume EM, emerging methods for increasing throughput and implications for sample preparation, image analysis and data management.
Cryogenic electron tomography (cryo-ET) combined with sub-tomogram averaging, allows in-situ visualization and structure determination of macromolecular complexes at sub-nanometre resolution. Cryogenic focused ion beam (cryo-FIB) micromachining is used to prepare a thin lamella-shaped sample out of a frozen-hydrated cell for cryo-ET imaging, but standard cryo-FIB fabrication is blind to the precise location of the structure or proteins of interest. Fluorescence-guided focused ion beam (FIB) milling at target locations requires multiple sample transfers prone to contamination, and relocation and registration accuracy is often insufficient for 3D targeting. Here, we present in-situ fluorescence microscopy-guided FIB fabrication of a frozen-hydrated lamella to address this problem: we built a coincident 3-beam cryogenic correlative microscope by retrofitting a compact cryogenic microcooler, custom positioning stage, and an inverted widefield fluorescence microscope (FM) on an existing focused ion-beam scanning electron microscope (FIB-SEM). We show FM controlled targeting at every milling step in the lamella fabrication process, validated with transmission electron microscope (TEM) tomogram reconstructions of the target regions. The ability to check the lamella during and after the milling process results in a higher success rate in the fabrication process and will increase the throughput of fabrication for lamellae suitable for high-resolution imaging.