C. Lofi
Please Note
97 records found
1
Building a Phishing Kit Intelligence System
How Structural Fingerprinting Reveals the Hidden Lineages of Industrialized Cybercrime
Current reactive defenses, such as URL blacklisting, are increasingly insufficient due to the extreme speed of modern campaigns and the widespread use of cloaking techniques.
To address these challenges, this thesis proposes a proactive methodology for phishing kit attribution, shifting the analytical focus from ephemeral webpages to the underlying software infrastructure.
We design a system in which we approach kit attribution as an incremental supervised binary classification problem using separate Random Forest models for each phishing kit family.
Our approach prioritizes the "attacker's view" by modeling phishing kits as hierarchical directory trees and extracting stable filesystem artifacts like the presence of files in particular locations.
Through systematic optimization using the \textit{uAdmin} phishing kit family, we demonstrate that this structural fingerprinting provides near-perfect discriminative power for the data-rich \textit{uAdmin} family.
Stress tests reveal that the system is resilient against some levels of obfuscation and that the model's ranking capability remains intact, even at higher levels of perturbation.
Furthermore, learning curve analysis confirms the system's few-shot capability.
When there are not many discovered samples from a phishing kit family, our results show that appending artificially generated samples of phishing kits to the original samples could contribute to a model's performance.
The practical utility of this methodology was validated through an incremental attribution workflow that has generated 23 models for different phishing kit families, which cover over 2000 phishing kits from our database.
A critical real-world application involving a forensic data dump from a German server seizure allowed us to test this incremental attribution workflow on real operational data.
We practically demonstrate two ways to map live phishing pages to known phishing kits, an approach that is based on the most important paths in phishing kit families and an approach that is based on the network activity of a phishing website.
The primary limitations of this thesis are that the client-side artifacts are not taken into consideration, and that live phishing pages do not always correlate well to paths in a phishing kit.
By registering phishing kits and models for phishing kit families alongside with actionable metadata, this thesis provides a scalable phishing kit intelligence system that could help LEAs toward the structural detection and dismantling of industrialized phishing. ...
Current reactive defenses, such as URL blacklisting, are increasingly insufficient due to the extreme speed of modern campaigns and the widespread use of cloaking techniques.
To address these challenges, this thesis proposes a proactive methodology for phishing kit attribution, shifting the analytical focus from ephemeral webpages to the underlying software infrastructure.
We design a system in which we approach kit attribution as an incremental supervised binary classification problem using separate Random Forest models for each phishing kit family.
Our approach prioritizes the "attacker's view" by modeling phishing kits as hierarchical directory trees and extracting stable filesystem artifacts like the presence of files in particular locations.
Through systematic optimization using the \textit{uAdmin} phishing kit family, we demonstrate that this structural fingerprinting provides near-perfect discriminative power for the data-rich \textit{uAdmin} family.
Stress tests reveal that the system is resilient against some levels of obfuscation and that the model's ranking capability remains intact, even at higher levels of perturbation.
Furthermore, learning curve analysis confirms the system's few-shot capability.
When there are not many discovered samples from a phishing kit family, our results show that appending artificially generated samples of phishing kits to the original samples could contribute to a model's performance.
The practical utility of this methodology was validated through an incremental attribution workflow that has generated 23 models for different phishing kit families, which cover over 2000 phishing kits from our database.
A critical real-world application involving a forensic data dump from a German server seizure allowed us to test this incremental attribution workflow on real operational data.
We practically demonstrate two ways to map live phishing pages to known phishing kits, an approach that is based on the most important paths in phishing kit families and an approach that is based on the network activity of a phishing website.
The primary limitations of this thesis are that the client-side artifacts are not taken into consideration, and that live phishing pages do not always correlate well to paths in a phishing kit.
By registering phishing kits and models for phishing kit families alongside with actionable metadata, this thesis provides a scalable phishing kit intelligence system that could help LEAs toward the structural detection and dismantling of industrialized phishing.
Predicting treatment of rheumatoid arthritis with LIVI
Prediction with a classifier on top of the LIVI model
Capturing Clinical Heterogeneity in Rheumatoid Arthritis
Evaluating the LIVI Latent Space using Gene Expression Data
Associating Single-Cell Latent Factors with Genetic Risk
An analysis on a clinical patient cohort
Multi-omic Latent Interaction Modelling at Single-Cell Resolution
Extending Latent Interaction Variational Inference (LIVI) Model with Protein Modality
However, looking too far can blur distant nodes together. A common remedy is to train the model on a random subset of the links and discard the rest, in the hope of preventing it from over-relying on any single part of the graph. This idea was proposed and tested only on the simpler problem in which each entity carries exactly one label. Many real-world problems are not like this. A single protein may participate in multiple biological processes simultaneously, so an effective predictor must assign several labels at once. Whether dropping links still helps in this more realistic multi-label setting has not been studied.
This work addresses that question using synthetic graphs with precisely controlled structure, ranging from strongly clustered to nearly random, as well as three real biological and bibliographic datasets spanning the same range. In almost every case, dropping links harms performance rather than improving it, and the damage increases with the fraction of removed links, with a single weak exception on the most strongly multi-label, lowest-homophily real graph.
The cause is not a flaw in the technique but a property of the multi-label task itself. When multiple labels must be predicted from the same node representation, each label receives only a fraction of the learning signal it would obtain in a single-label setting. Discarding links reduces this already limited signal even further. ...
However, looking too far can blur distant nodes together. A common remedy is to train the model on a random subset of the links and discard the rest, in the hope of preventing it from over-relying on any single part of the graph. This idea was proposed and tested only on the simpler problem in which each entity carries exactly one label. Many real-world problems are not like this. A single protein may participate in multiple biological processes simultaneously, so an effective predictor must assign several labels at once. Whether dropping links still helps in this more realistic multi-label setting has not been studied.
This work addresses that question using synthetic graphs with precisely controlled structure, ranging from strongly clustered to nearly random, as well as three real biological and bibliographic datasets spanning the same range. In almost every case, dropping links harms performance rather than improving it, and the damage increases with the fraction of removed links, with a single weak exception on the most strongly multi-label, lowest-homophily real graph.
The cause is not a flaw in the technique but a property of the multi-label task itself. When multiple labels must be predicted from the same node representation, each label receives only a fraction of the learning signal it would obtain in a single-label setting. Discarding links reduces this already limited signal even further.
https://doi.org/10.5281/zenodo.19496755 Repository link
Replication package of "Retrieval First: LLM- Assisted Type Inference for Automatic Test Case Generation in JavaScript" ...
https://doi.org/10.5281/zenodo.19496755 Repository link
Replication package of "Retrieval First: LLM- Assisted Type Inference for Automatic Test Case Generation in JavaScript"
Improving Response Time and Fairness with Efficient Scheduling and Partitioning
In Multi-User Apache Spark Environments
In this work, we present User Weighted Fair Queuing (UWFQ) scheduler that can minimize the response time of jobs in Apache Spark, while ensuring that users are allocated a fair share of resources that they equally distribute among their jobs. This is done by simulating a virtual fair scheduler, and assigning the highest priority to jobs that complete the earliest in the virtual scheduler. The algorithm is an extension to Cluster Fair Queuing designed by C. Chen et al., with an added fairness layer to ensure that each user is entitled to a fair share of resources. To address the problem of task skew present in Spark, we introduce runtime partitioning that can more effectively avoid task skew by splitting them into more partitions. We implement our scheduler in the Apache Spark framework and show that UWFQ with runtime partitioning can decrease the average response time of small jobs by up to 70% in certain workloads, while still providing fair resource allocation in critical scenarios.
...
In this work, we present User Weighted Fair Queuing (UWFQ) scheduler that can minimize the response time of jobs in Apache Spark, while ensuring that users are allocated a fair share of resources that they equally distribute among their jobs. This is done by simulating a virtual fair scheduler, and assigning the highest priority to jobs that complete the earliest in the virtual scheduler. The algorithm is an extension to Cluster Fair Queuing designed by C. Chen et al., with an added fairness layer to ensure that each user is entitled to a fair share of resources. To address the problem of task skew present in Spark, we introduce runtime partitioning that can more effectively avoid task skew by splitting them into more partitions. We implement our scheduler in the Apache Spark framework and show that UWFQ with runtime partitioning can decrease the average response time of small jobs by up to 70% in certain workloads, while still providing fair resource allocation in critical scenarios.
Heuristic Optimization of Amazon Redshift Table Configurations
Focusing on Distribution Style, Sort Keys and Column Encodings in Amazon Redshift
The study addresses four research questions examining individual parameter optimization strategies and their integrated effects on system performance. The experimental evaluation employs two datasets: a primary table containing 300 million data records across 23 columns where optimization is performed, and a secondary join table with 117.5 million data records across 12 columns that remains unchanged. Scale-dependent analysis is conducted using subsets of 10 million and 100 million data records selected from the primary dataset to enable controlled comparison across different data volumes.
Key findings demonstrate that table configuration optimization in Amazon Redshift exhibits pronounced scale-dependent performance characteristics across the experimental datasets, with three distinct performance regimes identified: a small-scale regime (10M data records) characterized by query-type dependent optimization effectiveness, a medium-scale regime (100M data records) showing optimization trade-off transitions, and a large-scale regime (300M data records) dominated by I/O and storage optimizations. The research reveals mixed optimization outcomes, with performance improvements ranging from 21 percent CPU reduction at small scales to 62 percent I/O improvement at large scales, while demonstrating that optimization strategies effective at one scale can become counterproductive at another. Overall, the framework shows variable success in parameter selection for distribution style, sort key and encoding selection.
The research identifies fundamental challenges in optimizing Amazon Redshift table configurations where internal algorithms remain opaque and optimization benefits exhibit non-linear scaling patterns across the tested different data volumes. While the framework provides valuable insights into scale-dependent optimization patterns, the mixed results highlight the complexity of achieving consistent performance improvements across different scales and query types. These findings challenge assumptions about uniform optimization benefits and emphasize the need for empirical validation approaches in cloud database optimization, providing practical insights for database administrators and theoretical foundations for developing adaptive optimization systems. ...
The study addresses four research questions examining individual parameter optimization strategies and their integrated effects on system performance. The experimental evaluation employs two datasets: a primary table containing 300 million data records across 23 columns where optimization is performed, and a secondary join table with 117.5 million data records across 12 columns that remains unchanged. Scale-dependent analysis is conducted using subsets of 10 million and 100 million data records selected from the primary dataset to enable controlled comparison across different data volumes.
Key findings demonstrate that table configuration optimization in Amazon Redshift exhibits pronounced scale-dependent performance characteristics across the experimental datasets, with three distinct performance regimes identified: a small-scale regime (10M data records) characterized by query-type dependent optimization effectiveness, a medium-scale regime (100M data records) showing optimization trade-off transitions, and a large-scale regime (300M data records) dominated by I/O and storage optimizations. The research reveals mixed optimization outcomes, with performance improvements ranging from 21 percent CPU reduction at small scales to 62 percent I/O improvement at large scales, while demonstrating that optimization strategies effective at one scale can become counterproductive at another. Overall, the framework shows variable success in parameter selection for distribution style, sort key and encoding selection.
The research identifies fundamental challenges in optimizing Amazon Redshift table configurations where internal algorithms remain opaque and optimization benefits exhibit non-linear scaling patterns across the tested different data volumes. While the framework provides valuable insights into scale-dependent optimization patterns, the mixed results highlight the complexity of achieving consistent performance improvements across different scales and query types. These findings challenge assumptions about uniform optimization benefits and emphasize the need for empirical validation approaches in cloud database optimization, providing practical insights for database administrators and theoretical foundations for developing adaptive optimization systems.
Learning to Learn from Microbiome Data
Benchmarking Meta-Learning for Disease Classification on Microbiome Abundance Data
Transformer-Based Synthetic Relational Data
Closing the Gap Between Diffusion-Based and Transformer-Based Synthetic Relational Data Generation
Recent advances in synthetic data generation have demonstrated considerable success for single-table datasets, with emerging research extending these capabilities to multi-table relational scenarios.
While transformer and diffusion architectures achieve state-of-the-art performance in single-table generation, a notable performance gap emerges when applied to relational data, where diffusion approaches consistently outperform transformer-based methods.
This thesis examines the factors contributing to this performance difference, conducting an evaluation using multiple baselines across both single and relational tabular datasets, with REaLTabformer and ClavaDDPM as state-of-the-art transformer- and diffusion-based approaches, respectively.
Our investigation reveals that the performance can mainly be attributed to the inadequate processing of contextual relationships and suboptimal strategies for representing inter-table dependencies in transformer-based models.
To close this gap, we introduce two changes for transformer-based models: layer sharing to enhance parameter utilization and contextual encoding to better preserve the relational structure.
These changes provide insight into the key design principles behind effective synthetic relational data generation using transformer-based models, particularly the need for architectures that account for context and facilitate practical knowledge transfer.
The proposed methods result in substantial performance improvements, with a 1.52-fold improvement in Logistic Detection and a 1.94-fold reduction in the Discriminator Measure metric.
...
Recent advances in synthetic data generation have demonstrated considerable success for single-table datasets, with emerging research extending these capabilities to multi-table relational scenarios.
While transformer and diffusion architectures achieve state-of-the-art performance in single-table generation, a notable performance gap emerges when applied to relational data, where diffusion approaches consistently outperform transformer-based methods.
This thesis examines the factors contributing to this performance difference, conducting an evaluation using multiple baselines across both single and relational tabular datasets, with REaLTabformer and ClavaDDPM as state-of-the-art transformer- and diffusion-based approaches, respectively.
Our investigation reveals that the performance can mainly be attributed to the inadequate processing of contextual relationships and suboptimal strategies for representing inter-table dependencies in transformer-based models.
To close this gap, we introduce two changes for transformer-based models: layer sharing to enhance parameter utilization and contextual encoding to better preserve the relational structure.
These changes provide insight into the key design principles behind effective synthetic relational data generation using transformer-based models, particularly the need for architectures that account for context and facilitate practical knowledge transfer.
The proposed methods result in substantial performance improvements, with a 1.52-fold improvement in Logistic Detection and a 1.94-fold reduction in the Discriminator Measure metric.
Sample-Based t-SNE Embeddings
How different Sampling Strategies influence the Quality of Low-Dimensional Embeddings
High-Dimensional Data Visualization via Sampling-Based Approaches
Measurement of structural similarity between different embeddings as a way of predicting a suitable perplexity
High-Dimensional Data Visualization via Sampling-Based Approaches
Effect of Perplexity at different levels of Sampling-Based Approach
In this work, we systematically investigate the impact of varying combinations of sample perplexity and full perplexity on the quality of the final t-SNE embedding. Our findings show that sample perplexity predominantly determines the global layout of the embedding, while full perplexity influences local refinement. We also compare our approach with different strategies for choosing perplexity values, and find that while some offer better preservation of structural details, they provide less flexibility. ...
In this work, we systematically investigate the impact of varying combinations of sample perplexity and full perplexity on the quality of the final t-SNE embedding. Our findings show that sample perplexity predominantly determines the global layout of the embedding, while full perplexity influences local refinement. We also compare our approach with different strategies for choosing perplexity values, and find that while some offer better preservation of structural details, they provide less flexibility.
To reduce the costs of parameter optimisation, t-SNE is performed on a sample of the original data. After sampling the points, the distances between them need to be calculated, which is expensive due to the high dimensionality of the data. We apply Dijkstra's algorithm to approximate the distances and similarities between the sampled points. This reduces the algorithm's execution time by up to 40% without degrading the quality of the projections. ...
To reduce the costs of parameter optimisation, t-SNE is performed on a sample of the original data. After sampling the points, the distances between them need to be calculated, which is expensive due to the high dimensionality of the data. We apply Dijkstra's algorithm to approximate the distances and similarities between the sampled points. This reduces the algorithm's execution time by up to 40% without degrading the quality of the projections.
A Storytelling Robot for People with Dementia
Designing a simple interface, suitable for People with Dementia