HC

H. Chakrabarti

info

Please Note

8 records found

A Reflection on Human-Centred Evaluation in Children Information Retrieval

Conference paper (2026) - Hrishita Chakrabarti, Diletta Micol Tobia, Garrett Allen, Monica Landoni, Maria Soledad Pera
The traditional Information Retrieval (IR) evaluation framework anchored in topical relevance and relevance-based metrics reflects a system-centred perspective. Yet for specific user groups, relevance alone is insufficient; benchmarking that relies exclusively on conventional metrics overlooks qualities intrinsic to the users IR approaches are meant to serve. Here, we draw attention to Children IR and examine the value of extending traditional evaluation with a human-centred perspective that accounts for how children interpret and evaluate information to more authentically capture performance and better reflect how well an approach truly meets children's needs. Our empirical exploration using a child-focused dataset, multiple ranking strategies, and traditional and extended frameworks reveals not only the limitations of relevance-based assessments but also the advantages of employing frameworks that are tailored to reflect the needs of child users, paving the way for more inclusive and effective evaluation frameworks. ...
Conference paper (2026) - Diletta Micol Tobia, Isabella Possaghi, H. Chakrabarti, Maria Soledad Pera, Monica Landoni
Children regularly engage with online information access systems, yet much of our understanding of how they search has not been revisited in recent years. Further, the reasons children avoid certain search practices remain largely unexamined. To address these gaps, we introduce a tangible cardĝ€'based activity designed to elicit and make visible children's reasoning during search. Building on prior literature, we examine whether previously documented practices remain relevant for the current generation of young searchers. We, then, investigate children's explanations for avoiding particular practices, revealing insights into their understanding of the information-seeking process. Overall, this work contributes to a better understanding of children's decisionĝ€'making processes when conducting online searches in school contexts, shedding light on both rationally adopted and discarded online search practices in the classroom setting. ...
Conference paper (2026) - Hrishita Chakrabarti, Maria Soledad Pera
Agents based on Large Language Models (LLM) have introduced a new way of information seeking that could simplify the search process to suit children’s cognitive skills, as these agents often respond to natural language inquiries with easy-to-read and plausible answers. Still, with emotions playing a crucial role in children’s information seeking and consumption behaviours, it is important to consider whether these agents suit children’s emotional intelligence. With that in mind, in this work, we examine the emotional undertones of LLM agent responses for children’s inquiries. Considering the known impact of prompt engineering on an agent’s response, we investigate whether explicitly informing an agent that the user is a child influences the emotions conveyed in its response. Outcomes from this empirical study reveal the limitations of LLM agents to fit children’s emotional intelligence, with agents tending to over-amplify any underlying emotion in a child’s inquiry. With our findings, we advance knowledge in the role of emotions in children’s online search and offer insights that could be used to improve children’s online information access. ...
Conference paper (2026) - Hrishita Chakrabarti, Maria Soledad Pera
Query performance prediction (QPP) methods have primarily been tailored to mainstream users, thus relying on the traditional concept of relevance. In the case of children, however, relevance goes beyond content-based resource-query matching, which is why we gauge the performance of existing QPP methods in estimating the fit of resources retrieved in response to child-formulated queries. Outcomes from our empirical exploration of various QPP methods using a traditional and a child-focused definition of relevance on 2 datasets reveal the limitations in the adaptability of existing methods to the context of child information retrieval. ...

How to Represent User-System Mismatches

Conference paper (2026) - Diletta Micol Tobia, Hrishita Chakrabarti, Maria Soledad Pera, Monica Landoni
User models, which represent the needs of users an online information access system is meant to serve, can facilitate the design and evaluation of the system. However, these models typically rely on assumptions drawn from adult users, such as advanced literacy levels or the ability to evaluate retrieved content critically. Hence, they often overlook the distinct needs and search habits of children, despite the growing prevalence of information access systems among youngsters. In this work, we introduce a set of child anti-personas, user models representing classes of users for whom the system is not designed. To substantiate these mismatches, we investigate how primary school children's behaviors when interacting with different search tools diverge from the assumptions of typical user models. Thereafter, we identify recurring patterns of misalignment between children's behavior and system expectations and link these patterns to the risks identified by adult stakeholders involved in children's online searching. By representing children as anti-personas of contemporary search tools, this work contributes to the quest for more informed and less stereotypical user modeling when it comes to information access for underrepresented groups, such as children. ...

Revisiting Children’s Concept of Relevance in Primary School Context

Conference paper (2026) - Diletta Micol Tobia, Hrishita Chakrabarti, Maria Soledad Pera, Monica Landoni
The concept of relevance in Information Retrieval (IR) has been extensively studied. However, most mainstream IR models have been developed with adult users in mind, assuming cognitive maturity and autonomous interaction. Younger searchers, who increasingly integrate IR systems into their information-seeking practices, differ in cognitive abilities, information needs, and limited digital knowledge, which shape how they judge relevance, often diverging from traditional definitions assumed to work for adults. This calls for a deeper understanding of how this underrepresented group judges online content. In this study, we explore how children interpret and determine relevance when searching for information online in primary school classrooms. As information-seeking in this context is often guided by teachers, we also probe their criteria for relevance. By comparing both perspectives, we uncover points of alignment and divergence. These findings contribute to revisiting the concept of relevance for the primary school context and, more broadly, to the design and evaluation of equitable, context-aware IR systems that support responsible and inclusive information seeking practices. ...
Conference paper (2025) - Hrishita Chakrabarti, Diletta Micol Tobia, Monica Landoni, Maria Soledad Pera
The rise of digital platforms for accessing online content-from popular search engines to social media sites- has contributed to the (un)intentional propagation of misleading information. This phenomenon, known as Information Disorder, affects individuals and society. Extensive research has been conducted to study and address Information Disorder as it pertains to the general population. Yet, little is known about how children, who have specific needs and behaviours when interacting with digital content, deal with misleading information and how the algorithms, that underlay the information access tools they use, mitigate or exacerbate the issue. Through a systematic literature review, we present research efforts that address or discuss the impact of Information Disorder on children and their overall information-seeking experience. We analyse the literature from various perspectives, including children's behaviour across platforms and the solutions developed to mitigate misleading information. Inspired by the knowledge distilled and gaps identified in our review, we discuss research directions that tackle both technological and human-centred challenges children face when dealing with misleading information, seeking to establish a foundation to mitigate the effects of Information Disorder among children. ...
Conference paper (2025) - Hrishita Chakrabarti, Diletta Micol Tobia, Monica Landoni, Maria Soledad Pera
In an existing study, the InsideOut Framework is used to produce and explore the emotional profiles of search engines (SE) in response to queries formulated by children aged 9 to 11 in the classroom context, revealing the emotional diversity of SE responses. Since then, there have been significant technological advances in emotion detection and information access. In this work, we conduct a comprehensive reproducibility study where we probe today's emotional profile of SE using both a lexicon-based and a language-model based approach tailored to the Italian language, thus addressing an acknowledged limitation of the original study. Additionally, considering the prevalence of agents based on Large Language Models (LLM) as information access systems among children, we extend the analysis to capture the emotional undertones of LLM responses and juxtapose them to those of SE. Our findings emphasize the importance of leveraging the appropriate emotion detection technique to produce and explore emotional profiles and lead us to reflect on the interplay of emotions on children's search-as-learning experience. ...