Jorge Abraham Martinez Castaneda
Please Note
47 records found
1
Probabilistic Nonlinear Spatial Filtering for Multi-Talker Speech Enhancement
Multi-Source Speech Presence Probability Estimation and DNN-Guided MVDR Beamforming in Multichannel Reverberant Environments
The estimator is shown to be structurally equivalent to the nonlinear spatial filter of Tesch and Gerkmann. Two sub-networks with no shared parameters estimate only these posteriors; all filtering is performed by the model-based filters. On a simulated five-talker reverberant corpus captured with a three-microphone array, the system improves SI-SDR by 11.26 dB and PESQ by 0.53, exceeding an end-to-end complex-mask baseline of comparable cost and more than doubling the gain of an oracle MVDR. Because the network outputs posteriors rather than a mask, the estimated quantities can be inspected directly and are shown to recover the intended signal-activity decomposition. ...
The estimator is shown to be structurally equivalent to the nonlinear spatial filter of Tesch and Gerkmann. Two sub-networks with no shared parameters estimate only these posteriors; all filtering is performed by the model-based filters. On a simulated five-talker reverberant corpus captured with a three-microphone array, the system improves SI-SDR by 11.26 dB and PESQ by 0.53, exceeding an end-to-end complex-mask baseline of comparable cost and more than doubling the gain of an oracle MVDR. Because the network outputs posteriors rather than a mask, the estimated quantities can be inspected directly and are shown to recover the intended signal-activity decomposition.
Towards a Dial for Vection
Evaluating a World-Space Phase-Shifting Grating for Modulating Perceived Self-Motion in VR
The proposed algorithm is evaluated under stationary and non-stationary noise conditions using synthetic, real, and speech-contaminated signals across multiple signal-to-noise ratios. Experimental results demonstrate improved noise tracking accuracy and reduced estimation variance while maintaining computational efficiency suitable for real-time embedded implementation. The proposed method provides an effective and practical solution for robust noise PSD estimation in next-generation hearing-aid systems.
...
The proposed algorithm is evaluated under stationary and non-stationary noise conditions using synthetic, real, and speech-contaminated signals across multiple signal-to-noise ratios. Experimental results demonstrate improved noise tracking accuracy and reduced estimation variance while maintaining computational efficiency suitable for real-time embedded implementation. The proposed method provides an effective and practical solution for robust noise PSD estimation in next-generation hearing-aid systems.
...
To make linguistic suitability interpretable, the study first investigates how individual linguistic properties vary across texts intended for different levels of complexity. A broad set of linguistic measures is examined across two independently constructed collections of levelled texts, and the observed patterns are compared with expectations from the literature. This analysis identifies properties that vary meaningfully with level and provides an empirical basis for interpreting linguistic differences in QA responses. The retained properties are then used to evaluate responses to 1,400 grade-adapted science questions produced by four QA systems representing retrieval-based, extractive, and generative approaches. Semantic adequacy is assessed through complementary measures of correspondence with the expected content, while linguistic suitability is evaluated by comparing the linguistic profile of each response with the level-adapted ground truth for the same question.
The first analysis shows that several linguistic properties vary systematically with increasing text complexity, while others show weaker or less consistent relationships. Most properties for which the literature provides a directional expectation follow that expected direction, although some do not. In the QA evaluation, the generative systems show the strongest overall performance, although their semantic profiles differ across measures. The retrieval-based system performs less strongly overall, while the extractive system shows the weakest profile. The feature-level linguistic analysis further shows that different properties can account for a system's distance from the ground truth at different grade levels, even when its overall distance changes little.
The results show that evaluating QA responses for children benefits from considering both semantic adequacy and linguistic suitability. By decomposing linguistic profile differences into interpretable properties, the proposed approach identifies not only how closely system responses align with level-adapted answers, but also the linguistic characteristics through which that alignment or divergence arises. ...
To make linguistic suitability interpretable, the study first investigates how individual linguistic properties vary across texts intended for different levels of complexity. A broad set of linguistic measures is examined across two independently constructed collections of levelled texts, and the observed patterns are compared with expectations from the literature. This analysis identifies properties that vary meaningfully with level and provides an empirical basis for interpreting linguistic differences in QA responses. The retained properties are then used to evaluate responses to 1,400 grade-adapted science questions produced by four QA systems representing retrieval-based, extractive, and generative approaches. Semantic adequacy is assessed through complementary measures of correspondence with the expected content, while linguistic suitability is evaluated by comparing the linguistic profile of each response with the level-adapted ground truth for the same question.
The first analysis shows that several linguistic properties vary systematically with increasing text complexity, while others show weaker or less consistent relationships. Most properties for which the literature provides a directional expectation follow that expected direction, although some do not. In the QA evaluation, the generative systems show the strongest overall performance, although their semantic profiles differ across measures. The retrieval-based system performs less strongly overall, while the extractive system shows the weakest profile. The feature-level linguistic analysis further shows that different properties can account for a system's distance from the ground truth at different grade levels, even when its overall distance changes little.
The results show that evaluating QA responses for children benefits from considering both semantic adequacy and linguistic suitability. By decomposing linguistic profile differences into interpretable properties, the proposed approach identifies not only how closely system responses align with level-adapted answers, but also the linguistic characteristics through which that alignment or divergence arises.
Does Representation Matter? Comparing Algebraic and Geometric Approaches to Teaching L1/L2 Regularization
Effects on Conceptual Understanding, Problem-Solving, and Knowledge Transfer
Two interactive notebooks, matched on learning objectives, length, and reading difficulty, were developed to teach the concept in each format and are released openly; they were compared in a between-subjects experiment with students who had completed an introductory machine learning course. Learning was measured with a post-test spanning conceptual understanding, problem-solving, and knowledge transfer, alongside a thematic analysis of students’ written explanations.
Both formats supported practical reasoning about regularization, but not identically: the algebraic group performed better overall, with its clearest advantage in conceptual understanding, no reliable difference on problem-solving, and an inconclusive result on transfer. The two groups largely shared the same core understanding but expressed it through different vocabularies: a penalty on the loss function versus a shrinking constraint region in weight space. Representational choice therefore appears to shape how students explain regularization more than whether they grasp it, suggesting that combining the two formats may best support learning.
...
Two interactive notebooks, matched on learning objectives, length, and reading difficulty, were developed to teach the concept in each format and are released openly; they were compared in a between-subjects experiment with students who had completed an introductory machine learning course. Learning was measured with a post-test spanning conceptual understanding, problem-solving, and knowledge transfer, alongside a thematic analysis of students’ written explanations.
Both formats supported practical reasoning about regularization, but not identically: the algebraic group performed better overall, with its clearest advantage in conceptual understanding, no reliable difference on problem-solving, and an inconclusive result on transfer. The two groups largely shared the same core understanding but expressed it through different vocabularies: a penalty on the loss function versus a shrinking constraint region in weight space. Representational choice therefore appears to shape how students explain regularization more than whether they grasp it, suggesting that combining the two formats may best support learning.
Teaching Gradient Descent
An Exploratory Study on Classic Textbook vs. Multiple Representations Approaches
This paper investigates whether multiple representations can support beginner understanding compared with a classic textbook-style explanation.
A small-scale exploratory experiment was conducted with students who had little or no prior machine learning experience. Participants completed a prerequisite pre-test, studied gradient descent using either a text-and-formula-based explanation or a multiple-representations explanation, completed a post-test, and answered an experience survey.
The multiple-representations condition showed higher post-test performance, especially on computation and application tasks, as well as higher confidence, clarity, usefulness, and engagement. Perceived cognitive load remained similar across conditions.
These findings suggest that aligned multiple representations can help beginners connect formal notation with concrete calculations and intuitive understanding, although the results should be interpreted cautiously because of the small sample size. ...
This paper investigates whether multiple representations can support beginner understanding compared with a classic textbook-style explanation.
A small-scale exploratory experiment was conducted with students who had little or no prior machine learning experience. Participants completed a prerequisite pre-test, studied gradient descent using either a text-and-formula-based explanation or a multiple-representations explanation, completed a post-test, and answered an experience survey.
The multiple-representations condition showed higher post-test performance, especially on computation and application tasks, as well as higher confidence, clarity, usefulness, and engagement. Perceived cognitive load remained similar across conditions.
These findings suggest that aligned multiple representations can help beginners connect formal notation with concrete calculations and intuitive understanding, although the results should be interpreted cautiously because of the small sample size.
Teaching Decision Trees in Machine Learning using multiple representations
Effects on Conceptual understanding, Problem-solving performance, and Knowledge transfer ability
To examine the lack of empirical evidence on multi-representational teaching for Decision Trees in ML education, a mixed-methods pilot experiment was employed with 10 participants was employed, comparing a multi-representation tutorial group to a text-only group. After a pre-test on mathematical and logical reasoning, participants completed a structured learning phase and a post-test measuring conceptual understanding, problem-solving, and transfer. Semi-structured interviews were also conducted to capture learner experiences.
Quantitative analysis included independent group comparisons using descriptive statistics, and inferential tests. Qualitative data were analyzed with inductive and deductive thematic analysis.
This study provides preliminary evidence that multi-representational instruction may improve problem-solving performance in Decision Tree learning. However, due to the small sample size and lack of statistical significance on two of three outcomes, these findings should be interpreted cautiously and require replication with larger samples.
The study contributes a structured evaluation framework for multi-representational ML education and provides evidence supporting the potential benefits of interactive instructional design in teaching Decision Trees. ...
To examine the lack of empirical evidence on multi-representational teaching for Decision Trees in ML education, a mixed-methods pilot experiment was employed with 10 participants was employed, comparing a multi-representation tutorial group to a text-only group. After a pre-test on mathematical and logical reasoning, participants completed a structured learning phase and a post-test measuring conceptual understanding, problem-solving, and transfer. Semi-structured interviews were also conducted to capture learner experiences.
Quantitative analysis included independent group comparisons using descriptive statistics, and inferential tests. Qualitative data were analyzed with inductive and deductive thematic analysis.
This study provides preliminary evidence that multi-representational instruction may improve problem-solving performance in Decision Tree learning. However, due to the small sample size and lack of statistical significance on two of three outcomes, these findings should be interpreted cautiously and require replication with larger samples.
The study contributes a structured evaluation framework for multi-representational ML education and provides evidence supporting the potential benefits of interactive instructional design in teaching Decision Trees.
Teaching Principal Component Analysis Through Multiple Representations
Impacts on Conceptual Understanding, Problem Solving and Knowledge Transfer
While it can affect many domains, the consequences are especially severe in certain contexts. One such context is health, where exposure to misinformation may lead to harmful health decisions. Because web search is a widely used tool to access health information, it is also an important context in which such misinformation is encountered.
All search processes begin with a query, and the way a query is phrased directly impacts the search results.
Query reformulation techniques have been used to modify queries, with the goal of improving search outcomes.
A large body of research has focused on developing different reformulation techniques that improve topical relevance. However, how such techniques affect the presence of misinformation in health search results remains unexplored. In this work, we address this research gap by conducting an empirical exploration of how different query reformulation techniques affect misinformation retrieval in health search. We consider a range of reformulation techniques based on different underlying methods and compare them on the TREC 2021 Health Misinformation dataset by analyzing their effects on misinformation, topical relevance, and correct information across ranked search results.
Our results indicate that "one size fits all'' is not the way to go, as most reformulation techniques do not systematically alter misinformation presence. However, we identify three techniques: two simple knowledge model-based approaches and one more recent LLM-based approach, that show potential to reduce misinformation relative to topically relevant information. While query reformulation cannot eradicate misinformation entirely, it can have an impact. Our research demonstrates both the potential of query reformulation as one component of a broader strategy for combating misinformation, and the importance of considering misinformation in the future development of reformulation techniques. ...
While it can affect many domains, the consequences are especially severe in certain contexts. One such context is health, where exposure to misinformation may lead to harmful health decisions. Because web search is a widely used tool to access health information, it is also an important context in which such misinformation is encountered.
All search processes begin with a query, and the way a query is phrased directly impacts the search results.
Query reformulation techniques have been used to modify queries, with the goal of improving search outcomes.
A large body of research has focused on developing different reformulation techniques that improve topical relevance. However, how such techniques affect the presence of misinformation in health search results remains unexplored. In this work, we address this research gap by conducting an empirical exploration of how different query reformulation techniques affect misinformation retrieval in health search. We consider a range of reformulation techniques based on different underlying methods and compare them on the TREC 2021 Health Misinformation dataset by analyzing their effects on misinformation, topical relevance, and correct information across ranked search results.
Our results indicate that "one size fits all'' is not the way to go, as most reformulation techniques do not systematically alter misinformation presence. However, we identify three techniques: two simple knowledge model-based approaches and one more recent LLM-based approach, that show potential to reduce misinformation relative to topically relevant information. While query reformulation cannot eradicate misinformation entirely, it can have an impact. Our research demonstrates both the potential of query reformulation as one component of a broader strategy for combating misinformation, and the importance of considering misinformation in the future development of reformulation techniques.
Auditory Kernels for Representing Degraded Speech
Auditory Kernels in an Efficient Representation of Degraded Speech
Much Ado about Accessibility
Exploration of online information seeking tools' responses to Autistic users
To advance knowledge in the accessibility of popular online ISTs when catering to the information needs of autistic users, we conducted an empirical exploration focusing on the accessibility of the textual
information in the IST responses. We specifically examined the responses on three aspects of text accessibility for autistic users - (1) text structure, (2) text readability, and (3) text concreteness using
“accessibility indicators” i.e. quantifiable features created by us based on widely accepted web content accessibility guidelines for autistic users. Due to the lack of standard query datasets for autistic users, we had to generate synthetic queries representative of autistic users’ information needs to collect responses from four popular ISTs Google, Bing, Gemini, and ChatGPT. We examined the differences in the way ISTs respond to queries characteristic to autistic users in contrast to queries typically asked by the general public, as well as the differences in IST responses across different kinds of queries asked by autistic users. We also investigated if an autistic user were to reformulate their query and explicitly state that they are autistic in their query would nudge the IST to respond differently to their query.
Juxtaposing the IST responses generated for control and ASD group queries revealed that the ISTs not only responded differently to the queries asked by the two user groups, but the responses generated for the control group were surprisingly more accessible for autistic users than the IST responses generated for their queries. For queries typically asked by autistic users, none of the ISTs produced responses
suitable for autistic users. However, each IST had its strengths in the context of the accessibility which can employed in the other ISTs to improve the general accessibility of the responses generated by all ISTs. We also found that our query and prompt reformulation strategies affected the accessibility of each IST differently. In general, the reformulations did nudge the ISTs to generate responses that are more suitable for autistic users. This presents an optimistic solution to the issue of ISTs not catering to the accessibility needs of autistic users when they search for information on the web. Our results highlight areas where popular ISTs can be improved to make their responses more accessible to autistic users. Our systematic empirical investigation pipeline can also be extended to investigate IST responses on other factors that influence the accessibility of web content for autistic users. ...
To advance knowledge in the accessibility of popular online ISTs when catering to the information needs of autistic users, we conducted an empirical exploration focusing on the accessibility of the textual
information in the IST responses. We specifically examined the responses on three aspects of text accessibility for autistic users - (1) text structure, (2) text readability, and (3) text concreteness using
“accessibility indicators” i.e. quantifiable features created by us based on widely accepted web content accessibility guidelines for autistic users. Due to the lack of standard query datasets for autistic users, we had to generate synthetic queries representative of autistic users’ information needs to collect responses from four popular ISTs Google, Bing, Gemini, and ChatGPT. We examined the differences in the way ISTs respond to queries characteristic to autistic users in contrast to queries typically asked by the general public, as well as the differences in IST responses across different kinds of queries asked by autistic users. We also investigated if an autistic user were to reformulate their query and explicitly state that they are autistic in their query would nudge the IST to respond differently to their query.
Juxtaposing the IST responses generated for control and ASD group queries revealed that the ISTs not only responded differently to the queries asked by the two user groups, but the responses generated for the control group were surprisingly more accessible for autistic users than the IST responses generated for their queries. For queries typically asked by autistic users, none of the ISTs produced responses
suitable for autistic users. However, each IST had its strengths in the context of the accessibility which can employed in the other ISTs to improve the general accessibility of the responses generated by all ISTs. We also found that our query and prompt reformulation strategies affected the accessibility of each IST differently. In general, the reformulations did nudge the ISTs to generate responses that are more suitable for autistic users. This presents an optimistic solution to the issue of ISTs not catering to the accessibility needs of autistic users when they search for information on the web. Our results highlight areas where popular ISTs can be improved to make their responses more accessible to autistic users. Our systematic empirical investigation pipeline can also be extended to investigate IST responses on other factors that influence the accessibility of web content for autistic users.
This thesis explores the integration of VLP with a balloon-enabled drone—a novel UAV setup featuring a buoyant balloon that extends flight duration. A balloon-enabled drone introduces both opportunities and challenges for VLP methods due to its size. Its large surface area can block light paths, which may impact signal reception and positioning accuracy. On the other hand, it also allows for the use of multiple receivers across the surface, potentially improving positioning reliability.
Traditional VLP systems typically utilize multiple transmitters and a single receiver; however, our approach takes advantage of the large surface area of a balloon-enabled drone by using only a single transmitter with multiple receivers strategically positioned on the balloon. This setup leverages the balloon’s curved surface to capture a diverse range of light intensities and angles, thereby improving positioning accuracy. We developed a 2D+H RSS-based VLP model specifically designed for balloon-enabled drones. This model takes into account factors like light transmission and optical channel loss. Our VLP system includes multiple receivers placed on the balloon’s surface and a single transmitter. We analyzed the optimal number and placement of these receivers to enhance positioning accuracy.
The system’s performance was tested through both static and dynamic experiments. In static tests, our configuration achieved an average positioning error of 4 cm. During dynamic tests, which involved movement and tilt, the mean error increased to 10-12 cm, largely due to difficulties in estimating height and managing tilt angles. Overall, our system shows an improvement over existing positioning methods like Crazyflie, while also maintaining low energy consumption and computational complexity. This work highlights the potential of our VLP model to improve the positioning accuracy of balloon-enabled drones for various applications. ...
This thesis explores the integration of VLP with a balloon-enabled drone—a novel UAV setup featuring a buoyant balloon that extends flight duration. A balloon-enabled drone introduces both opportunities and challenges for VLP methods due to its size. Its large surface area can block light paths, which may impact signal reception and positioning accuracy. On the other hand, it also allows for the use of multiple receivers across the surface, potentially improving positioning reliability.
Traditional VLP systems typically utilize multiple transmitters and a single receiver; however, our approach takes advantage of the large surface area of a balloon-enabled drone by using only a single transmitter with multiple receivers strategically positioned on the balloon. This setup leverages the balloon’s curved surface to capture a diverse range of light intensities and angles, thereby improving positioning accuracy. We developed a 2D+H RSS-based VLP model specifically designed for balloon-enabled drones. This model takes into account factors like light transmission and optical channel loss. Our VLP system includes multiple receivers placed on the balloon’s surface and a single transmitter. We analyzed the optimal number and placement of these receivers to enhance positioning accuracy.
The system’s performance was tested through both static and dynamic experiments. In static tests, our configuration achieved an average positioning error of 4 cm. During dynamic tests, which involved movement and tilt, the mean error increased to 10-12 cm, largely due to difficulties in estimating height and managing tilt angles. Overall, our system shows an improvement over existing positioning methods like Crazyflie, while also maintaining low energy consumption and computational complexity. This work highlights the potential of our VLP model to improve the positioning accuracy of balloon-enabled drones for various applications.
Playlist: A personal sequence of learning activities
Full report on a holistic approach towards designing an educational tool
This report holds the full description of the integrated thesis. The first part including the chapters of ”Fostering a personal sequence of learning activities in Skill Circuits”.
The study uses a design-based research approach, which involves iterative development and research cycles and including students in the evaluation phases. By drawing on educational theories and addressing practical needs identified at TU Delft, the Playlist tool was designed to seamlessly integrate into the existing learning environment. The tool’s functionalities were prioritized based on user feedback provided by Computer Science students and gathered through surveys and focus group sessions.
Key findings indicate that playlists can improve student engagement, motivation, and overall learning experience by supporting students in finding learning activities aligned with their learning preferences and goals. The research highlights the importance of providing students with tools that improve navigating the learning environment and support them in self-directed learning. The Playlist feature not only aids students in organizing their learning activities but also promotes a holistic approach to education by incorporating supporting activities such as reflection and taking breaks.
The integrated thesis hopes to demonstrate the potential and importance of designing tools to personalize learning and support students in achieving their learning goals. It also explains why personalization tools in higher education should be implemented in an iterative manner. ...
This report holds the full description of the integrated thesis. The first part including the chapters of ”Fostering a personal sequence of learning activities in Skill Circuits”.
The study uses a design-based research approach, which involves iterative development and research cycles and including students in the evaluation phases. By drawing on educational theories and addressing practical needs identified at TU Delft, the Playlist tool was designed to seamlessly integrate into the existing learning environment. The tool’s functionalities were prioritized based on user feedback provided by Computer Science students and gathered through surveys and focus group sessions.
Key findings indicate that playlists can improve student engagement, motivation, and overall learning experience by supporting students in finding learning activities aligned with their learning preferences and goals. The research highlights the importance of providing students with tools that improve navigating the learning environment and support them in self-directed learning. The Playlist feature not only aids students in organizing their learning activities but also promotes a holistic approach to education by incorporating supporting activities such as reflection and taking breaks.
The integrated thesis hopes to demonstrate the potential and importance of designing tools to personalize learning and support students in achieving their learning goals. It also explains why personalization tools in higher education should be implemented in an iterative manner.