M.S. Pera
Please Note
166 records found
1
Blurred Lines
Understanding the Fit of Song Lyrics in Music Catalogs That Can Reach Children Through Recommendations
Query performance prediction (QPP) methods have primarily been tailored to mainstream users, thus relying on the traditional concept of relevance. In the case of children, however, relevance goes beyond content-based resource-query matching, which is why we gauge the performance of existing QPP methods in estimating the fit of resources retrieved in response to child-formulated queries. Outcomes from our empirical exploration of various QPP methods using a traditional and a child-focused definition of relevance on 2 datasets reveal the limitations in the adaptability of existing methods to the context of child information retrieval.
All That Matters
Revisiting Children’s Concept of Relevance in Primary School Context
The concept of relevance in Information Retrieval (IR) has been extensively studied. However, most mainstream IR models have been developed with adult users in mind, assuming cognitive maturity and autonomous interaction. Younger searchers, who increasingly integrate IR systems into their information-seeking practices, differ in cognitive abilities, information needs, and limited digital knowledge, which shape how they judge relevance, often diverging from traditional definitions assumed to work for adults. This calls for a deeper understanding of how this underrepresented group judges online content. In this study, we explore how children interpret and determine relevance when searching for information online in primary school classrooms. As information-seeking in this context is often guided by teachers, we also probe their criteria for relevance. By comparing both perspectives, we uncover points of alignment and divergence. These findings contribute to revisiting the concept of relevance for the primary school context and, more broadly, to the design and evaluation of equitable, context-aware IR systems that support responsible and inclusive information seeking practices.
Agents based on Large Language Models (LLM) have introduced a new way of information seeking that could simplify the search process to suit children’s cognitive skills, as these agents often respond to natural language inquiries with easy-to-read and plausible answers. Still, with emotions playing a crucial role in children’s information seeking and consumption behaviours, it is important to consider whether these agents suit children’s emotional intelligence. With that in mind, in this work, we examine the emotional undertones of LLM agent responses for children’s inquiries. Considering the known impact of prompt engineering on an agent’s response, we investigate whether explicitly informing an agent that the user is a child influences the emotions conveyed in its response. Outcomes from this empirical study reveal the limitations of LLM agents to fit children’s emotional intelligence, with agents tending to over-amplify any underlying emotion in a child’s inquiry. With our findings, we advance knowledge in the role of emotions in children’s online search and offer insights that could be used to improve children’s online information access.
The way people seek, access, and use information for learning has changed. Once the primary gateway to information, search engines now share the stage with various digital/social platforms. This change is perhaps more notable among teenagers and has undoubtedly influenced how they browse and select resources to support their learning. To understand their habits and how alternatives to search engines have influenced them, in this work, we explore how high school students conduct online inquiries in the classroom. Our findings reveal that search engines are not always students’ first choice; social networks often play a leading role. This shift has important implications for the design of information retrieval technology, as researchers should consider how teenagers—an understudied population—use this range of tools. In addition, it is critical to foster search and media literacy skills among young users, who increasingly turn to tools not designed to search for information for educational purposes.
Simulation is widely used in recommender systems research to study algorithm behavior and its impact on users. A common strategy involves adopting a universal choice model to represent users, assuming all follow the same consumption patterns. This one-size-fits-all approach overlooks the diversity in user preferences and decision-making patterns. In this work, we scrutinize whether this universal view fails to account for unique user behavior, thus harming realism and reliability of simulation outcomes. We conduct multiple simulations with various recommendation algorithms and choice models in the movie domain, comparing outcomes to users’ organic consumption patterns. Further, we evaluate whether a holistic model that captures users’ differences in behavior would better reflect a wide user base. Our findings highlight the limitations of using a naive, universal choice model and emphasize the need for more nuanced, user-specific approaches to make contributions from simulation studies more reflective of real-world effects.
The rise of digital platforms for accessing online content-from popular search engines to social media sites- has contributed to the (un)intentional propagation of misleading information. This phenomenon, known as Information Disorder, affects individuals and society. Extensive research has been conducted to study and address Information Disorder as it pertains to the general population. Yet, little is known about how children, who have specific needs and behaviours when interacting with digital content, deal with misleading information and how the algorithms, that underlay the information access tools they use, mitigate or exacerbate the issue. Through a systematic literature review, we present research efforts that address or discuss the impact of Information Disorder on children and their overall information-seeking experience. We analyse the literature from various perspectives, including children's behaviour across platforms and the solutions developed to mitigate misleading information. Inspired by the knowledge distilled and gaps identified in our review, we discuss research directions that tackle both technological and human-centred challenges children face when dealing with misleading information, seeking to establish a foundation to mitigate the effects of Information Disorder among children.
We’re Still Doing It (All) Wrong
Recommender Systems, Fifteen Years Later
In 2011, Xavier Amatriain sounded the alarm: recommender systems research was “doing it all wrong” [1]. His critique, rooted in statistical misinterpretation and methodological shortcuts, remains as relevant today as it was then. But rather than correcting course, we added new layers of sophistication on top of the same broken foundations. This paper revisits Amatriain’s diagnosis and argues that many of the conceptual, epistemological, and infrastructural failures he identified still persist, in more subtle or systemic forms. Drawing on recent work in reproducibility, evaluation methodology, environmental impact, and participatory design, we showcase how the field’s accelerating complexity has outpaced its introspection. We highlight ongoing community-led initiatives that attempt to shift the paradigm, including workshops, evaluation frameworks, and calls for value-sensitive and participatory research. At the same time, we contend that meaningful change will require not only new metrics or better tooling, but a fundamental reframing of what recommender systems research is for, who it serves, and how knowledge is produced and validated. Our call is not just for technical reform, but for a recommender systems research agenda grounded in epistemic humility, human impact, and sustainable practice.
From Previous Plays to Long-Term Tastes
Exploring the Long-term Reliability of Recommender Systems Simulations for Children
De-centering the (Traditional) user
Multistakeholder evaluation of recommender systems
Multistakeholder recommender systems are those that account for the impacts and preferences of multiple groups of individuals, not just the end users receiving recommendations. Due to their complexity, these systems cannot be evaluated strictly by the overall utility of a single stakeholder, as is often the case of more mainstream recommender system applications. In this article, we focus our discussion on the challenges of multistakeholder evaluation of recommender systems. We bring attention to the different aspects involved—from the range of stakeholders involved (including but not limited to providers and consumers) to the values and specific goals of each relevant stakeholder. We discuss how to move from theoretical principles to practical implementation, providing specific use case examples. Finally, we outline open research directions for the RecSys community to explore. We aim to provide guidance to researchers and practitioners about incorporating these complex and domain-dependent issues of evaluation in the course of designing, developing, and researching applications with multistakeholder aspects.
Misinformation in video recommendations
An exploration of Top-N recommendation algorithms
With this paper, we delve into the problem of misinformation propagation in the video recommendation domain, focusing on top-N recommendation algorithms (RAs). We evaluate a broad spectrum of RAs to probe their ability to minimize misinformation recommendations while optimizing the RAs for overall performance. The results of an empirical exploration conducted using a suite of Top-N RAs and a video recommendation dataset [1] show that certain RAs excel in both performance and misinformation handling, while others struggle in mitigating misinformation. Our findings emphasize the potential of neighbourhood-based, neural, and other advanced collaborative filtering (CF) approaches in combating misinformation and contributing to more responsible recommender systems. Inspired by our findings, we propose investigating hybrid RAs and exploring specific features influencing misinformation recommendations, to further enhance the understanding and effectiveness of mitigating misinformation in recommendation systems.
Information Retrieval (IR) remains an active, fast-paced area of research. However, most advances in IR have predominantly benefited the so-called “classical” users, e.g., English-speaking adults. We envision IR4U2as a forum to spotlight efforts that, while sparse, consider diverse, and often understudied, user groups when designing, developing, assessing, and deploying the IR technologies that directly impact them. The key objectives for IR4U2 are: (1) raise awareness about ongoing efforts focused on IR technologies designed for and used by often understudied user groups, (2) identify challenges and open issues impacting this area of research, (3) ignite discussions to identify common frameworks for future research, and (4) enable cross-fertilization and community-building by sharing lessons learned from research catering to different audiences by researchers and (industry) practitioners across various disciplines.