Circular Image

M.S. Pera

info

Please Note

175 records found

Journal article (2026) - Christine Pinney, Casey Kennington, Katherine Landau Wright, M.S. Pera, Jerry Alan A. Fails
Children are increasingly interacting with search tools and exploring information online, whether it is for academic purposes or just for fun. Young searchers tend to favor search tools designed for adults and, as a result, face unique barriers to information access at all stages of the online search process. There have been many explorations into the obstacles children encounter during information retrieval (IR), but there is a lack of available data that can support further research from multiple perspectives and engage the larger IR community, resulting in stifled progress towards addressing the unique needs of young searchers. To address this lack of data, we introduce CASTlog a new dataset that captures the search queries of children ages 6-12 and the user-system interactions as searchers complete various kinds of online information discovery tasks. We also provide statistics of the data and an initial data analysis informed by empirical explorations based on the dataset. CASTlog serves as a foundational resource for researchers and practitioners focused on developing search tools that address the information needs of children. ...
Teamwork is an integral part of computer science, but group projects in education do not always teach teamwork skills tailored to the context of software project teams. As a result, early-career computer scientists often struggle with team projects that involve interdependent tasks. This research focuses on identifying which teamwork skills are important to computer scientists at the start of their careers and how they perceive the career-education gap regarding teamwork. We conducted semi-structured interviews with 19 early-career computer scientists and analysed them using deductive and inductive coding. Social skills were perceived as the most important by the participants. Although leadership and coordination were among the most prevalent in university education, they were considered less important in industry. These findings can be used to motivate educational design choices in university group projects, focusing on teaching the teamwork skills that will be relevant to students' careers. ...
Foreword postscript (2026) - Alejandro Bellogin, Ludovico Boratto, Federica Cena, Angelo Geninatti Cossatin, Theo Huibers, Styliani Kleanthous, Elisabeth Lex, Monica Landoni, Maria Soledad Pera, More authors...

How to Represent User-System Mismatches

Conference paper (2026) - Diletta Micol Tobia, Hrishita Chakrabarti, Maria Soledad Pera, Monica Landoni
User models, which represent the needs of users an online information access system is meant to serve, can facilitate the design and evaluation of the system. However, these models typically rely on assumptions drawn from adult users, such as advanced literacy levels or the ability to evaluate retrieved content critically. Hence, they often overlook the distinct needs and search habits of children, despite the growing prevalence of information access systems among youngsters. In this work, we introduce a set of child anti-personas, user models representing classes of users for whom the system is not designed. To substantiate these mismatches, we investigate how primary school children's behaviors when interacting with different search tools diverge from the assumptions of typical user models. Thereafter, we identify recurring patterns of misalignment between children's behavior and system expectations and link these patterns to the risks identified by adult stakeholders involved in children's online searching. By representing children as anti-personas of contemporary search tools, this work contributes to the quest for more informed and less stereotypical user modeling when it comes to information access for underrepresented groups, such as children. ...

Why Recommender Systems Require Human-Aware Evaluation for Children

Conference paper (2026) - Robin Ungruh, Alejandro Bellogin, Dominik Kowald, Soledad Pera
Children regularly interact with recommender systems, yet little is known about whether the suggestions they encounter fit them. Traditional accuracy-based evaluation accounts for user preference, providing an incomplete picture of how well recommenders serve young users. With that in mind, we adopt a human-centric, specifically child-centric, evaluation perspective to empirically examine whether recommender systems address children's needs. Focusing on content maturity as a key dimension influencing what is considered fitting as per developmental needs, we probe a range of recommender algorithms on whether their suggestions align with children's developmental maturity and how closely these suggestions reflect the content maturity of previously consumed items. Our analysis showcases that traditional evaluation paradigms fail to uncover dynamics that affect alignment with children's needs. ...

Understanding the Fit of Song Lyrics in Music Catalogs That Can Reach Children Through Recommendations

Conference paper (2026) - Jasper Heijne, Robin Ungruh, Maria Soledad Pera
Recommender systems on popular online platforms expose impressionable and easily influenced younger listeners to varied content, making it crucial to reflect on the songs children can encounter due to their interactions with recommender systems. To set a foundation, we analyze the lyrics of a catalog comprised of ∼30,000 songs to gauge their suitability to children. Our multi-perspective exploration reveals a high prevalence of inappropriate lyrics in music commonly heard by children. This highlights the need for further explorations pertaining online platforms and their recommender systems that curate and ultimately present items from catalogs such as the ones we examined, highlighting the potential negative impact of such lyrics on their behavior and personality by promoting harmful language or biases. Informed by our findings, we outline research directions for the information retrieval community to consider when designing, evaluating, and deploying algorithms that serve diverse audiences. ...

A Reflection on Human-Centred Evaluation in Children Information Retrieval

Conference paper (2026) - Hrishita Chakrabarti, Diletta Micol Tobia, Garrett Allen, Monica Landoni, Maria Soledad Pera
The traditional Information Retrieval (IR) evaluation framework anchored in topical relevance and relevance-based metrics reflects a system-centred perspective. Yet for specific user groups, relevance alone is insufficient; benchmarking that relies exclusively on conventional metrics overlooks qualities intrinsic to the users IR approaches are meant to serve. Here, we draw attention to Children IR and examine the value of extending traditional evaluation with a human-centred perspective that accounts for how children interpret and evaluate information to more authentically capture performance and better reflect how well an approach truly meets children's needs. Our empirical exploration using a child-focused dataset, multiple ranking strategies, and traditional and extended frameworks reveals not only the limitations of relevance-based assessments but also the advantages of employing frameworks that are tailored to reflect the needs of child users, paving the way for more inclusive and effective evaluation frameworks. ...
Journal article (2026) - R. Ungruh, Murtadha Al Nahadi, M.S. Pera
Children form stereotypes by observing stereotypical expressions during childhood, influencing their future beliefs, attitudes, and behavior. These perceptions, often negative, can surface across the many online media platforms that children access, like streaming services and social media. Given that many of the items displayed on these platforms are commonly selected by recommendation algorithms (RAs), it becomes critical to investigate their role in suggesting items that could negatively impact this vulnerable population. We address this concern by conducting an empirical evaluation to gauge the presence of Gender, Race, and Religion stereotypes among the top-10 recommendations generated by a wide range of RAs across two well-known datasets in different domains: Movielens (movies) and GoodReads (books). Results analyses reveal that all RAs frequently recommend stereotypical items. Gender stereotypes are particularly prevalent, appearing in almost every recommendation list and emerging as the most common stereotype. Our results indicate that no algorithm has a consistent tendency towards recommending more stereotypical content; instead, high stereotype presence can be found across recommendation strategies. Outcomes from this work underscore the potential risks that RAs pose to children in perpetuating and reinforcing harmful stereotypes—this prompts reflections on their implications for the design and evaluation of recommender systems ...
Conference paper (2026) - Hrishita Chakrabarti, Maria Soledad Pera
Agents based on Large Language Models (LLM) have introduced a new way of information seeking that could simplify the search process to suit children’s cognitive skills, as these agents often respond to natural language inquiries with easy-to-read and plausible answers. Still, with emotions playing a crucial role in children’s information seeking and consumption behaviours, it is important to consider whether these agents suit children’s emotional intelligence. With that in mind, in this work, we examine the emotional undertones of LLM agent responses for children’s inquiries. Considering the known impact of prompt engineering on an agent’s response, we investigate whether explicitly informing an agent that the user is a child influences the emotions conveyed in its response. Outcomes from this empirical study reveal the limitations of LLM agents to fit children’s emotional intelligence, with agents tending to over-amplify any underlying emotion in a child’s inquiry. With our findings, we advance knowledge in the role of emotions in children’s online search and offer insights that could be used to improve children’s online information access. ...

A human-centred vision for information retrieval systems that serve all users

Journal article (2026) - Angelo Geninatti Cossatin, H. Chakrabarti, Emiliana Murgia, Simone Ooms, Diletta Micol Tobia, R. Ungruh, Federica Cena, Stephane Aline Chaudron, Maria Soledad Pera, More Authors
Information retrieval (IR) systems have predominantly been designed for and evaluated in mainstream user populations, creating a self-reinforcing cycle of exclusion for underserved groups, e.g. differently-abled individuals, cultural minorities, those facing economic constraints, experiencing digital divides, language barriers, or those at age extremes. This opinion paper presents findings from a collaborative brainstorming session on underrepresented users in IR, identifying key challenges and pathways toward more inclusive design. Our analysis reveals a critical loop: lack of access leads to underrepresentation in datasets, which in turn leads to inadequate consideration in system design, perpetuating exclusion. We present guidelines for breaking this cycle through four interconnected dimensions: interface design grounded in participatory methods and universal accessibility, adaptive algorithms that respond to diverse capabilities and contexts, evaluation methodologies that position underserved users as active collaborators rather than passive subjects, and responsible AI integration guided by user-centred principles. ...
Conference paper (2026) - Hrishita Chakrabarti, Maria Soledad Pera
Query performance prediction (QPP) methods have primarily been tailored to mainstream users, thus relying on the traditional concept of relevance. In the case of children, however, relevance goes beyond content-based resource-query matching, which is why we gauge the performance of existing QPP methods in estimating the fit of resources retrieved in response to child-formulated queries. Outcomes from our empirical exploration of various QPP methods using a traditional and a child-focused definition of relevance on 2 datasets reveal the limitations in the adaptability of existing methods to the context of child information retrieval. ...
Conference paper (2026) - Diletta Micol Tobia, Isabella Possaghi, H. Chakrabarti, Maria Soledad Pera, Monica Landoni
Children regularly engage with online information access systems, yet much of our understanding of how they search has not been revisited in recent years. Further, the reasons children avoid certain search practices remain largely unexamined. To address these gaps, we introduce a tangible cardĝ€'based activity designed to elicit and make visible children's reasoning during search. Building on prior literature, we examine whether previously documented practices remain relevant for the current generation of young searchers. We, then, investigate children's explanations for avoiding particular practices, revealing insights into their understanding of the information-seeking process. Overall, this work contributes to a better understanding of children's decisionĝ€'making processes when conducting online searches in school contexts, shedding light on both rationally adopted and discarded online search practices in the classroom setting. ...
Conference paper (2026) - Robin Ungruh, Maria Soledad Pera
Recommender systems increasingly shape children's online experiences, yet the risks they might pose remain poorly understood. Formal risk assessments are rare, overlook children's experiences, treat them as a homogeneous group, and often consider risks on a population-wide level. To provide a more nuanced child-centered perspective on risks associated with recommenders, we conduct a comprehensive risk assessment that examines multiple risks simultaneously and captures individual-level exposure rather than solely aggregated metrics. We also explore behavioral characteristics that make some children more susceptible to risk exposure to grasp how individual differences shape the manifestation of risks. Our results highlight the need for risk assessments that recognize heterogeneity among children and understand when risks become systemic' through individualized recommendation patterns. These insights spark the discussion about child-aware recommenders and ongoing regulatory efforts for evidence-based accountability. ...

Revisiting Children’s Concept of Relevance in Primary School Context

Conference paper (2026) - Diletta Micol Tobia, Hrishita Chakrabarti, Maria Soledad Pera, Monica Landoni
The concept of relevance in Information Retrieval (IR) has been extensively studied. However, most mainstream IR models have been developed with adult users in mind, assuming cognitive maturity and autonomous interaction. Younger searchers, who increasingly integrate IR systems into their information-seeking practices, differ in cognitive abilities, information needs, and limited digital knowledge, which shape how they judge relevance, often diverging from traditional definitions assumed to work for adults. This calls for a deeper understanding of how this underrepresented group judges online content. In this study, we explore how children interpret and determine relevance when searching for information online in primary school classrooms. As information-seeking in this context is often guided by teachers, we also probe their criteria for relevance. By comparing both perspectives, we uncover points of alignment and divergence. These findings contribute to revisiting the concept of relevance for the primary school context and, more broadly, to the design and evaluation of equitable, context-aware IR systems that support responsible and inclusive information seeking practices. ...
Journal article (2026) - Claudio Pomo, Antonio Ferrara, Bart Knijnenburg, Fedelucio Narducci, M.S. Pera, Li Chen
Recommender systems increasingly shape what people watch, read, buy, and learn, yet their success has too often been assessed through system-centric objectives and proxy metrics. In this editorial introduction to the Special Issue on “Re-centering the User in Recommender System Research,” we argue for a sustained shift toward user-centered, value-sensitive recommender research that foregrounds user agency, transparency, fairness, privacy, and long-term welfare, while acknowledging the multi-stakeholder nature of many recommendation ecosystems. Building on perspectives from recommender systems, human–computer interaction, behavioral science, and responsible AI, we first synthesize key conceptual and methodological developments that motivate placing users at the core of design and evaluation. We then introduce the papers collected in this issue, which collectively examine the benefits and risks of persuasive explanations, frameworks for designing effective explanatory interfaces, user-calibrated approaches to mitigating popularity bias, preference conceptualization and modeling in specific domains, user experience in conversational recommenders powered by large language models, and methodological lessons for evaluating group recommenders. We conclude by outlining open challenges–including measuring long-term outcomes, balancing personalization with risks of manipulation, and developing ecologically valid, stakeholder-aware evaluation protocols–and by pointing to promising directions for future research. ...

Recommender Systems, Fifteen Years Later

Conference paper (2025) - Alan Said, Maria Soledad Pera, Michael D. Ekstrand
In 2011, Xavier Amatriain sounded the alarm: recommender systems research was “doing it all wrong” [1]. His critique, rooted in statistical misinterpretation and methodological shortcuts, remains as relevant today as it was then. But rather than correcting course, we added new layers of sophistication on top of the same broken foundations. This paper revisits Amatriain’s diagnosis and argues that many of the conceptual, epistemological, and infrastructural failures he identified still persist, in more subtle or systemic forms. Drawing on recent work in reproducibility, evaluation methodology, environmental impact, and participatory design, we showcase how the field’s accelerating complexity has outpaced its introspection. We highlight ongoing community-led initiatives that attempt to shift the paradigm, including workshops, evaluation frameworks, and calls for value-sensitive and participatory research. At the same time, we contend that meaningful change will require not only new metrics or better tooling, but a fundamental reframing of what recommender systems research is for, who it serves, and how knowledge is produced and validated. Our call is not just for technical reform, but for a recommender systems research agenda grounded in epistemic humility, human impact, and sustainable practice. ...
Conference paper (2025) - Robin Ungruh, Alejandro Bellogín, Dominik Kowald, Maria Soledad Pera
Recommender systems research seldom considers children as a user group, and when it does, it is anchored on datasets where children are underrepresented, risking overlooking their interests, favoring those of the majority, i.e., mainstream users. Recently, Ungruh et al. demonstrated that children’s consumption patterns and preferences differ from those of mainstream users, resulting in inconsistent recommendation algorithm performance and behavior for this user group. These findings, however, are based on two datasets with a limited child user sample. We reproduce and replicate this study on a wider range of datasets in the movie, music, and book domains, uncovering interaction patterns and aspects of child-recommender interactions consistent across domains, as well as those specific to some user samples in the data. We also extend insights from the original study with popularity bias metrics, given the interpretation of results from the original study. With this reproduction and extension, we uncover consumption patterns and differences between age groups stemming from intrinsic differences between children and others, and those unique to specific datasets or domains. ...
Conference paper (2025) - Robin Ungruh, Alejandro Bellogín, Maria Soledad Pera
Simulation is widely used in recommender systems research to study algorithm behavior and its impact on users. A common strategy involves adopting a universal choice model to represent users, assuming all follow the same consumption patterns. This one-size-fits-all approach overlooks the diversity in user preferences and decision-making patterns. In this work, we scrutinize whether this universal view fails to account for unique user behavior, thus harming realism and reliability of simulation outcomes. We conduct multiple simulations with various recommendation algorithms and choice models in the movie domain, comparing outcomes to users’ organic consumption patterns. Further, we evaluate whether a holistic model that captures users’ differences in behavior would better reflect a wide user base. Our findings highlight the limitations of using a naive, universal choice model and emphasize the need for more nuanced, user-specific approaches to make contributions from simulation studies more reflective of real-world effects. ...
Conference paper (2025) - Maria Soledad Pera, Theo Huibers, Emiliana Murgia, Monica Landoni
There is a lack of a steady and solid influx of information retrieval (IR) research that has children (as the user group) as the protagonist. Existing work is scattered, conducted by only a few research groups, and often based on small-scale user studies or data that cannot be widely shared. Moreover, much of the current research focuses on specific age ranges and abilities, neglecting the broader spectrum of children's needs. Consequently, the paucity of IR research on how search and recommender systems serve and/or ultimately affect children translates into one of many 'Low-resource environments' in IR. Drawing from the literature and our experience in this area, we highlight key challenges and encourage greater attention from the IR community to address this critical gap. ...

Multistakeholder evaluation of recommender systems

Journal article (2025) - Robin Burke, Gediminas Adomavicius, Toine Bogers, Tommaso Di Noia, Dominik Kowald, Julia Neidhardt, Özlem Özgöbek, Maria Soledad Pera, Nava Tintarev, Jürgen Ziegler
Multistakeholder recommender systems are those that account for the impacts and preferences of multiple groups of individuals, not just the end users receiving recommendations. Due to their complexity, these systems cannot be evaluated strictly by the overall utility of a single stakeholder, as is often the case of more mainstream recommender system applications. In this article, we focus our discussion on the challenges of multistakeholder evaluation of recommender systems. We bring attention to the different aspects involved—from the range of stakeholders involved (including but not limited to providers and consumers) to the values and specific goals of each relevant stakeholder. We discuss how to move from theoretical principles to practical implementation, providing specific use case examples. Finally, we outline open research directions for the RecSys community to explore. We aim to provide guidance to researchers and practitioners about incorporating these complex and domain-dependent issues of evaluation in the course of designing, developing, and researching applications with multistakeholder aspects. ...