D. Kalisvaart
info
Please Note
<p>This page displays the records of the person named above and is not linked to a unique person identifier. This record may need to be merged to a profile.</p>
2 records found
1
Master thesis
(2024)
-
G.M. Rijpkema, C.S. Smith, D. Kalisvaart, S. Korovin, Jaap van der Weerd, Holger Caesar, A. Jakobi
Forensic microtrace investigation relies on a time- and labour-intensive process of manually analysing samples via microscopy. To aid forensic experts in their investigations, an image recognition model for microtrace localisation and classification is needed. This work investigates the trace recognition accuracy that can be achieved by analysing images captured with automated microscopy through deep learning. Fibres, hairs, skin, glass and sand are pixel-wise classified in microscopy scans of tape-lift samples. As deep learning requires extensive amounts of annotated training data, pretraining is investigated to minimise the required annotation workload. ImageNet pretraining, pretraining with self-supervised learning and a sequential application of these approaches are tested. It is found that pretrained models are able to reduce the required annotated data twofold compared to models trained from scratch, while retaining the prediction accuracy. While the ImageNet-pretrained models outperform the self-supervised-pretrained models, the highest accuracy is achieved by combining the two approaches. With this, traces are recognised with a mean intersection over union of 0.56 when training on only 2.2 dm2 of annotated tape lift scans.
...
Forensic microtrace investigation relies on a time- and labour-intensive process of manually analysing samples via microscopy. To aid forensic experts in their investigations, an image recognition model for microtrace localisation and classification is needed. This work investigates the trace recognition accuracy that can be achieved by analysing images captured with automated microscopy through deep learning. Fibres, hairs, skin, glass and sand are pixel-wise classified in microscopy scans of tape-lift samples. As deep learning requires extensive amounts of annotated training data, pretraining is investigated to minimise the required annotation workload. ImageNet pretraining, pretraining with self-supervised learning and a sequential application of these approaches are tested. It is found that pretrained models are able to reduce the required annotated data twofold compared to models trained from scratch, while retaining the prediction accuracy. While the ImageNet-pretrained models outperform the self-supervised-pretrained models, the highest accuracy is achieved by combining the two approaches. With this, traces are recognised with a mean intersection over union of 0.56 when training on only 2.2 dm2 of annotated tape lift scans.
Optical microscopes are fundamentally limited to a resolution of several hundreds of nanometers by the diffraction of light. Single-molecule localization microscopy (SMLM) circumvents this limit by sparsely exciting fluorescent molecules at different time instances. Single molecules can subsequently be localized with improved precision over the diffraction limit. Due to their high frame rate, single-photon avalanche diode (SPAD) arrays are imagers that can be used for SMLM. Most SPADs have to recharge after each photon arrival. During this recharging period, the SPAD is insensitive to more photon arrivals. As a result, SPAD arrays will measure zero or one photons for each pixel in each frame, whereas scientific complementary metal-oxide semiconductor (sCMOS) imagers and electron multiplying charge-coupled devices (EMCCD) have a discrete frame output. Here, we describe the photon arrivals in the image formation model of the SPAD array as a binomial process rather than as a Poissonian process. In addition, we quantify the minimum theoretical uncertainty of single-molecule localizations using a binomial Cramér-Rao lower bound and benchmark it with simulated and experimental data. We show that if the expected photon count is larger than one for all pixels within one standard deviation of a Gaussian point spread function, the binomial CRLB gives a 46% higher theoretical uncertainty than the Poissonian CRLB. Without saturation, which is the case for most SMLM applications, the binomial CRLB model gives the same uncertainty as the Poissonian CRLB. Therefore, the binomial CRLB can be used to predict and benchmark localization uncertainty for SMLM with SPAD arrays for all practical emitter intensities.
...
Optical microscopes are fundamentally limited to a resolution of several hundreds of nanometers by the diffraction of light. Single-molecule localization microscopy (SMLM) circumvents this limit by sparsely exciting fluorescent molecules at different time instances. Single molecules can subsequently be localized with improved precision over the diffraction limit. Due to their high frame rate, single-photon avalanche diode (SPAD) arrays are imagers that can be used for SMLM. Most SPADs have to recharge after each photon arrival. During this recharging period, the SPAD is insensitive to more photon arrivals. As a result, SPAD arrays will measure zero or one photons for each pixel in each frame, whereas scientific complementary metal-oxide semiconductor (sCMOS) imagers and electron multiplying charge-coupled devices (EMCCD) have a discrete frame output. Here, we describe the photon arrivals in the image formation model of the SPAD array as a binomial process rather than as a Poissonian process. In addition, we quantify the minimum theoretical uncertainty of single-molecule localizations using a binomial Cramér-Rao lower bound and benchmark it with simulated and experimental data. We show that if the expected photon count is larger than one for all pixels within one standard deviation of a Gaussian point spread function, the binomial CRLB gives a 46% higher theoretical uncertainty than the Poissonian CRLB. Without saturation, which is the case for most SMLM applications, the binomial CRLB model gives the same uncertainty as the Poissonian CRLB. Therefore, the binomial CRLB can be used to predict and benchmark localization uncertainty for SMLM with SPAD arrays for all practical emitter intensities.