Perspective: Leveraging Human Understanding for Identifying and Characterizing Image Atypicality

High-quality data plays a vital role in developing reliable image classification models. Despite that, what makes an image difficult to classify remains an unstudied topic. This paper provides a first-of-its-kind, model-agnostic characterization of image atypicality based on human understanding. We consider the setting of image classification...

Editorial: Human-centered AI: Crowd computing

What Should You Know? A Human-In-the-Loop Approach to Unknown Unknowns Characterization in Image Recognition

Unknown unknowns represent a major challenge in reliable image recognition. Existing methods mainly focus on unknown unknowns identification, leveraging human intelligence to gather images that are potentially difficult for the machine. To drive a deeper understanding of unknown unknowns and more effective identification and treatment, this...

Towards a human in the loop approach to preserve privacy in images

Current artificial intelligence and information retrieval systems need to be trained with a large amount of data to achieve satisfying performance. A popular solution to create such datasets is to employ crowdsourcing; however, the content to be annotated may contain private or sensitive information that can be extracted by workers, limiting...

CaptureBias: Supporting Media Scholars with Ambiguity-Aware Bias Representation for News Videos

In this project we explore the presence of ambiguity in textual and visual media and its influence on accurately understanding and<br/>capturing bias in news. We study this topic in the context of supporting<br/>media scholars and social scientists in their media analysis. Our focus<br/>lies on racial and gender bias as well as framing and the...

A Human in the Loop Approach to Capture Bias and Support Media Scientists in News Video Analysis

Bias is inevitable and inherent in any form of communication. News often appear biased to citizens with dierent political orientations, and understood dierently by news media scholars and the broader public. In this paper we advocate the need for accurate methods for bias identication in video news item, to enable rich analytics capabilities in...