Smart microscopy is transforming biological imaging by integrating real-time analysis with adaptive acquisition to enhance imaging efficiency. Whereas many emerging implementations are event-driven and focus on on-demand data acquisition to reduce phototoxicity, we here present ‘outcome-driven’ microscopy, a framework combining smart microscopy with optogenetics to control cell biological processes and achieve predefined outcomes. We validate this approach using light-based control of cell migration and nucleocytoplasmic transport, demonstrating robust spatiotemporal control of cellular behaviour in single cells and in cell populations.

Forensic microtrace investigation relies on time- and labour-intensive microscopic analyses. To aid forensic experts in their investigations, an image recognition model for microtrace localisation and classification is needed. In this work, we use deep learning to automate trace recognition in images captured with automated microscopy. We localise and classify fibres, hairs, skin, glass and sand in microscopy scans through pixel-wise classification of tape-lift samples. As deep learning requires extensive amounts of annotated training data, we additionally investigate various pretraining strategies to minimise the required annotation workload. We compare ImageNet pretraining, pretraining with self-supervised learning and a sequential application of these approaches. We find that pretrained models are able to reduce the required annotated data twofold compared to models trained from scratch while retaining the prediction accuracy. While our ImageNet-pretrained models outperform our self-supervised-pretrained models, we achieve the highest accuracy by combining the two approaches, resulting in a factor 4 reduction of manual annotated microtraces or a 65 % improvement in recognition and localisation accuracy (mean intersection over union increases from 0.34 to 0.56 due to pretraining) when training on only 2.2 dm² of annotated tape lift scans. The developed models offer a solid fundament for automated analysis of forensic microtrace scans.

Image quality in single-molecule localization microscopy depends largely on the accuracy and precision of the localizations. While under ideal imaging conditions, the theoretically obtainable precision and accuracy are achieved; in practice, this changes if (field-dependent) aberrations are present. Currently, there is no simple way to measure and incorporate these aberrations into the point-spread function (PSF) fitting; therefore, the aberrations are often taken as constant or neglected altogether. Here we introduce a model-based approach to estimate the field-dependent aberration directly from single-molecule data without a calibration step. This is made possible by using nodal aberration theory to incorporate the field dependency of aberrations into our fully vectorial PSF model. This results in a limited set of aberration fit parameters that can be extracted from the raw frames without a bead calibration measurement, also in retrospect. The software implementation is computationally efficient, enabling the fitting of a full 2D or 3D dataset within a few minutes. We demonstrate our method on 2D and 3D localization data of microtubuli, nuclear pore complexes, and nuclear lamina over fields of view of up to 180 µm and compare it with Gaussian fitting, spline-based fitting, and a deep-learning-based approach.

Super-resolution microscopy (SRM) has undeniable potential for scientific discovery, yet still presents many challenges that hinder its widespread adoption, including technical trade-offs between resolution, speed and photodamage, as well as limitations in imaging live samples and larger, more complex biological structures. Furthermore, SRM often requires specialized expertise and complex instrumentation, which can deter biologists from fully embracing the technology. In this Perspective, a follow-up to our recent Q&A article, we aim to demystify these challenges by addressing common questions and misconceptions surrounding SRM. Experts offer practical insights into how biologists can maximize the benefits of SRM while navigating issues such as photobleaching, image artifacts and the limitations of existing techniques. We also highlight recent developments in SRM that continue to push the boundaries of resolution. Our goal is to equip researchers with the crucial knowledge they need to harness the full potential of SRM.

In the present study, the influence of topographic and mechanical cues on neuronal growth cones (NGCs) and network directionality in 3D-engineered cell culture models is explored. Two-photon polymerization (2PP) is employed to fabricate nanopillar arrays featuring tunable effective shear modulus. Large variations in mechanical properties are obtained by altering the aspect ratio of the nanostructures. The nanopillar arrays are seeded with different neuronal cell lines, including neural progenitor cells (NPCs) derived from human induced pluripotent stem cells (iPSCs), I³Neurons, and primary hippocampal neurons. All cell types exhibit preferential orientations according to the nanopillar topology, as shown by neurites creating a high number of oriented orthogonal networks. Furthermore, the differentiation and maturation of NPCs are affected by the topographic and mechanical properties of the nanopillars, as shown by the expression of the mature neuronal marker Synapsin I. Lastly, NGCs are influenced by effective shear modulus in terms of spreading area, and stochastic optical reconstruction microscopy (STORM) is employed to assess the cytoskeleton organization at nanometric resolution. The developed approach, involving laser-assisted 3D microfabrication, neuro-mechanobiology, and super-resolution microscopy, paves the way for prospective comparative studies on the evolution of neuronal networks and NGCs in healthy and diseased (e.g., neurodegenerative) conditions.

Super-resolution microscopy (SRM) is gaining popularity in biosciences; however, claims about optical resolution are contested and often misleading. In this Viewpoint, experts share their views on resolution and common trade-offs, such as labelling and post-processing, aiming to clarify them for biologists and facilitate deeper understanding and best use of SRM.

Image scanning microscopy (ISM) achieves resolution beyond the diffraction limit by a factor of √2. However, prior ISM research predominantly employs scalar diffraction theory, neglecting critical physical effects such as polarization, aberrations, and Stokes shift. This paper presents a comprehensive vectorial ISM point spread function (PSF) model that accounts for these phenomena. By considering the effect of polarization in emission and excitation paths, as well as aberrations and Stokes shift, our model provides a more accurate representation of ISM. We analyze the differences between scalar and vectorial theories in ISM and investigate the impact of pinhole size and aberration strength on resolution. At a numerical aperture of 1.2, the full width half maximum (FWHM) discrepancy between scalar and vectorial ISM PSFs can reach 45 nm, representing a 30% deviation from the vectorial model. Additionally, we explore multiphoton excitation in ISM and observe increased FWHM for 2-photon and 3-photon excitation compared to 1-photon excitation. The FWHM of the 2-photon excitation ISM PSF increases by 20% and the FWHM of the 3-photon excitation ISM PSF increases by 28% compared to the 1-photon excitation ISM. In addition, we found that the optimal sweep factor for 2-photon ISM is 1.22, and the optimal sweep factor of 3-photon ISM is 1.12 instead of the 2 predicted by the one-photon scalar ISM theory. Our work improves the understanding of ISM and contributes to its advancement as a high-resolution imaging technique.

Optical emitters in hexagonal boron nitride (hBN) are promising probes for single-molecule sensing platforms. When engineered in nanoparticle form, they can be integrated as detectors in nanodevices, yet positional control at the nanoscale is lacking. Here we demonstrate the functionalization of DNA origami nanopores with optically active hBN nanoparticles (NPs) with nanometer precision. The NPs are active under three wavelengths of visible illumination and display both stable and blinking emission, enabling their accurate localization by using wide-field optical nanoscopy. Correlative opto-structural characterization reveals deterministic binding of bright, multicolor hBN NPs at the pore rim due to π-π stacking interactions at site-specific locations on the DNA origami. Our work provides a scalable, bottom-up approach toward deterministic assembly of solid-state emitters on arbitrary structural elements based on DNA origami. Such a nanoscale arrangement of optically active components can advance the development of single-molecule platforms, including optical nanopores and nanochannel sensors.

Modulation enhanced single-molecule localization microscopy (meSMLM), where emitters are sparsely activated with sequentially applied patterned illumination, increases the localization precision over single-molecule localization microscopy (SMLM). The precision improvement of modulation enhanced SMLM is derived from retrieving the position of an emitter relative to individual illumination patterns, which adds to existing point spread function information from SMLM. Here, we introduce SpinFlux: modulation enhanced localization for spinning disk confocal microscopy. SpinFlux uses a spinning disk with pinholes in its illumination and emission paths, to sequentially illuminate regions in the sample during each measurement. The resulting intensity-modulated emission signal is analyzed for each individual pattern to localize emitters with improved precision. We derive a statistical image formation model for SpinFlux and we quantify the theoretical minimum localization uncertainty in terms of the Cramér-Rao lower bound. Using the theoretical minimum uncertainty, we compare SpinFlux to localization on Fourier reweighted image scanning microscopy reconstructions. We find that localization on image scanning microscopy reconstructions with Fourier reweighting ideally results in a global precision improvement of 2.1 over SMLM. When SpinFlux is used for sequential illumination with three patterns around the emitter position, the localization precision improvement over SMLM is twofold when patterns are focused around the emitter position. If four donut-shaped illumination patterns are used for SpinFlux, the maximum local precision improvement over SMLM is increased to 3.5. Localization of image scanning microscopy reconstructions thus has the largest potential for global improvements of the localization precision, where SpinFlux is the method of choice for local refinements.

Editorial.

In single-molecule microscopy, a big question is how precisely we can estimate the location of a single molecule. Our research shows that by using iterative localisation microscopy and factoring in the prior information, we can boost precision and reduce the number of photons needed. Leveraging the Van Trees inequality aids in determining the optimal precision achievable. Our approach holds promise for wider application in discerning the optimal precision across diverse imaging scenarios, encompassing various illumination strategies, point spread functions and overarching control methodologies.

A rapid and robust method to fabricate transmission diffractive optical elements in the visible wavelengths is presented. By additive manufacturing of a polymeric photo-resin using 2-photon lithography followed by encasing of the structure in another resin with similar refractive index, the height of the structure can be made much larger, thus trading-off fabrication height for refractive index difference of the two materials. After adjusting for resin shrinkage, different diffractive optical element designs including an m = 1 vortex plate, and Laguerre-Gaussian beams with azimuthal and radial indices of (1,1), (1,2), and (2,1) were demonstrated. Experimental results show intensity patterns matching that of simulations, including size and features, although some aberration was observed, possibly due to fabrication tolerance errors or beam misalignment. This technique adds to the toolkit of micro-optics fabrication methods using additive manufacturing and 3D printing, and it would be beneficial for rapid prototyping and integration with miniaturised systems.

Three dimensional modulation-enhanced single-molecule localization techniques, such as ModLoc, offer advancements in axial localization precision across the entire field of view and axial capture range, by applying phase shifting to the illumination pattern. However, this improvement is limited by the pitch of the illumination pattern that can be used and requires registration between separate regions of the camera. To overcome these limitations, we present ZIMFLUX, a method that combines astigmatic point-spread-function (PSF) engineering with a structured illumination pattern in all three spatial dimensions. In order to achieve this we address challenges such as optical aberrations, refractive index mismatch, supercritical angle fluorescence (SAF), and imaging at varying depths within a sample, by implementing a vectorial PSF model. In scenarios involving refractive index mismatch between the sample and immersion medium, the astigmatic PSF loses its ellipticity at greater imaging depths, leading to a deterioration in axial localization precision. In contrast, our simulations demonstrate that ZIMFLUX maintains high axial localization precision even when imaging deeper into the sample. Experimental results show unbiased localization of 3D 80 nm DNA-origami nanostructures in SAF conditions with a 1.5-fold improvement in axial localization precision when comparing ZIMFLUX to conventional SMLM methods that rely solely on astigmatic PSF engineering.

We demonstrate that a cavitation bubble initiated by a Nd:YAG laser pulse below breakdown threshold induces crystallization from supersaturated aqueous solutions with supersaturation and laser-energy-dependent nucleation kinetics. Combining high-speed video microscopy and simulations, we argue that a competition between the dissipation of absorbed laser energy as latent and sensible heat dictates the solvent evaporation rate and creates a momentary supersaturation peak at the vapor-liquid interface. The number and morphology of crystals correlate to the characteristics of the simulated supersaturation peak.

Kinetic inductance detectors (KIDs) are superconducting energy-resolving detectors, sensitive to single photons from the near-infrared to ultraviolet. We study a hybrid KID design consisting of a β-phase tantalum (β-Ta) inductor and a Nb-Ti-N interdigitated capacitor. The devices show an average intrinsic quality factor Qi of 4.3×105±1.3×105. To increase the power captured by the light-sensitive inductor, we 3D print an array of 150×150μm resin microlenses on the backside of the sapphire substrate. The shape deviation between design and printed lenses is smaller than 1μm, and the alignment accuracy of this process is δx=+5.8±0.5μm and δy=+8.3±3.3μm. We measure a resolving power for 1545-402 nm that is limited to 4.9 by saturation in the KID's phase response. We can model the saturation in the phase response with the evolution of the number of quasiparticles generated by a photon event. An alternative coordinate system that has a linear response raises the resolving power to 5.9 at 402 nm. We verify the measured resolving power with a two-line measurement using a laser source and a monochromator. We discuss several improvements that can be made to the devices on a route towards KID arrays with high resolving powers.

A low-cost glass-based microfluidic flow cell with a piezo actuator is built using off-the-shelf parts (total cost €9 per device) to apply acoustophoretic force on polystyrene micro-beads. The main challenge in the fabrication of these devices was to ensure their leak tightness, which we solved using double-sided tape and nail polish. Beads with 1.5 μm diameter flowing in a 100 μm deep channel were trapped at 7.5 MHz using a 23.7 peak-to-peak voltage (V_pp) sinusoidal input. The trap located at 50 ± 0.1 μm depth was measured to have a stiffness of approximately 0.6 pN/μm. With this simple device we can trap and control the axial position of micrometer scale objects, which allows for the manipulation of beads and cells. We intend to use the device for force spectroscopy on micro-bead tethered DNA. This can be combined with super-resolution imaging techniques to study mechanics and binding of protein structures along a DNA strand as a function of induced tension.

Single-molecule localization microscopy requires sparse activation of emitters to circumvent the diffraction limit. In densely labeled or thick samples, overlap of emitter images is inevitable. Single-molecule localization of these samples results in a biased parameter estimate with a wrong model of the number of emitters. On the other hand, multiple emitter fitting suffers from point spread function degeneracy, which increases model and parameter uncertainty. To better estimate the model, parameters and uncertainties, a three-dimensional Bayesian multiple emitter fitting algorithm was constructed using Reversible Jump Markov Chain Monte Carlo. It reconstructs the posterior density of both the model and the parameters, namely the three-dimensional position and photon intensity, of overlapping emitters. The ability of the algorithm to separate two emitters at varying distance was evaluated using an astigmatic point spread function. We found that for astigmatic imaging, the posterior distribution of the emitter positions is multimodal when emitters are within two times the in-focus standard deviation of the point spread function. This multimodality describes the ambiguity in position that astigmatism introduces in localization microscopy. Biplane imaging was also tested, proving capable of separating emitters up to 0.75 times the in-focus standard deviation of the point spread function while staying free of multimodality. The posteriors seen in astigmatic and biplane imaging demonstrate how the algorithm can identify point spread function degeneracy and evaluate imaging techniques for three-dimensional multiple-emitter fitting performance.

We propose to use the State Estimation by Sum-of-Norms Regularisation (STATESON-)algorithm for recovering the tip-sample interaction in high-speed tapping mode atomic force microscopy (AFM). This approach enables accurate sample height estimation for each independent cantilever oscillation period, provided that the tip-sample interaction dominates the noise. The entire course of the cantilever deflection signal is compared to a modelled counterpart in subsequent convex minimisations, such that the sparse tip-sample interaction can be recovered. Afterwards, the sample height is determined using the minimum smoothed cantilever deflection per cantilever oscillation period. Results from simulation experiments are in favour of the proposed approach as it consistently reveals sharp edges in sample height, as opposed to both the conventional and a closely related existing approach. However, the non-processed cantilever deflection provided most accurate sample height estimation. It is recommended to implement the STATESON-algorithm in the form of a filter to use it in feedback control of the scanner and cantilever excitation.

Optofluidic devices have revolutionized the manipulation and transportation of fluid at smaller length scales ranging from micrometers to millimeters. We describe a dedicated optical setup for studying laser-induced cavitation inside a microchannel. In a typical experiment, we use a tightly focused laser beam to locally evaporate the solution laced with a dye resulting in the formation of a microbubble. The evolving bubble interface is tracked using high-speed microscopy and digital image analysis. Furthermore, we extend this system to analyze fluid flow through fluorescence-Particle Image Velocimetry (PIV) technique with minimal adaptations. In addition, we demonstrate the protocols for the in-house fabrication of a microchannel tailored to function as a sample holder in this optical setup. In essence, we present a complete guide for constructing a fluorescence microscope from scratch using standard optical components with flexibility in the design and at a lower cost compared to its commercial analogues.