- document
-
Balayn, A.M.A. (author), Rikalo, N. (author), Lofi, C. (author), Yang, J. (author), Bozzon, A. (author)Deep learning models for image classification suffer from dangerous issues often discovered after deployment. The process of identifying bugs that cause these issues remains limited and understudied. Especially, explainability methods are often presented as obvious tools for bug identification. Yet, the current practice lacks an understanding...conference paper 2022
- document
-
Sharifi Noorian, S. (author), Qiu, S. (author), Gadiraju, Ujwal (author), Yang, J. (author), Bozzon, A. (author)Unknown unknowns represent a major challenge in reliable image recognition. Existing methods mainly focus on unknown unknowns identification, leveraging human intelligence to gather images that are potentially difficult for the machine. To drive a deeper understanding of unknown unknowns and more effective identification and treatment, this...conference paper 2022
- document
-
Samiotis, I.P. (author), Lofi, C. (author), Bozzon, A. (author)Automated methods and human annotation are being extensively utilized to scale up modern classification systems. Processes though such as music transcription, oppose certain challenges due to the complexity of the domain and the expertise needed to read and process music scores. In this work, we examine how music transcription could benefit from...conference paper 2021
- document
-
Draws, T.A. (author), Tintarev, N. (author), Gadiraju, Ujwal (author), Bozzon, A. (author), Timmermans, Benjamin (author)The way pages are ranked in search results influences whether the users of search engines are exposed to more homogeneous, or rather to more diverse viewpoints. However, this viewpoint diversity is not trivial to assess. In this paper we use existing and novel ranking fairness metrics to evaluate viewpoint diversity in search result rankings. We...conference paper 2021
- document
-
Draws, T.A. (author), Tintarev, N. (author), Gadiraju, Ujwal (author), Bozzon, A. (author), Timmermans, B. (author)In web search on debated topics, algorithmic and cognitive biases strongly influence how users consume and process information. Recent research has shown that this can lead to a search engine manipulation effect (SEME): when search result rankings are biased towards a particular viewpoint, users tend to adopt this favored viewpoint. To better...conference paper 2021
- document
-
Mauri, A. (author), Psyllidis, A. (author), Bozzon, A. (author), Lee, J.S. (author), Pridmore, Jason (author), Van Zoonen, Liesbet (author), Giest, Sarah (author)Social web data increasingly complement studies of various social phenomena, especially when the availability of traditional data is limited. One such case is that of vulnerable young populations that are disengaged from employment, education, or training; usually referred to as NEETs. This paper explores the extent to which social media data...conference paper 2021
- document
-
Balayn, A.M.A. (author), SOILIS, P. (author), Lofi, C. (author), Yang, J. (author), Bozzon, A. (author)Global interpretability is a vital requirement for image classification applications. Existing interpretability methods mainly explain a model behavior by identifying salient image patches, which require manual efforts from users to make sense of, and also do not typically support model validation with questions that investigate multiple...conference paper 2021
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Due to the coronavirus pandemic, remote work from home has rapidly become a necessity around the world, drastically changing the potential landscape for the future of work. Over the last couple of decades, microtask crowdsourcing has emerged as a viable means of carrying out remote online work to earn one’s living — an alternative to traditional...conference paper 2020
- document
-
van Alphen, G.A. (author), Qiu, S. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)In online crowd mapping, crowd workers recruited through crowdsourcing marketplaces collect geographic data. Compared to traditional mapping methods, where workers physically explore the area, the benefit of using online crowd mapping is the potential to be cost-effective and time-efficient. Previous studies have focused on mapping urban objects...conference paper 2020
- document
-
Samiotis, I.P. (author), Qiu, S. (author), Mauri, A. (author), Liem, C.C.S. (author), Lofi, C. (author), Bozzon, A. (author)Human annotation is still an essential part of modern transcription workflows for digitizing music scores, either as a standalone approach where a single expert annotator transcribes a complete score, or for supporting an automated Optical Music Recognition (OMR) system. Research on human computation has shown the effectiveness of crowdsourcing...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)The rise in popularity of conversational agents has enabled humans to interact with machines more naturally. Recent work has shown that crowd workers in microtask marketplaces can complete a variety of human intelligence tasks (HITs) using conversational interfaces with similar output quality compared to the traditional Web interfaces. In...conference paper 2020
- document
-
Sharifi Noorian, S. (author), Qiu, S. (author), Psyllidis, A. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)Up-to-date listings of retail stores and related building functions are challenging and costly to maintain. We introduce a novel method for automatically detecting, geo-locating, and classifying retail stores and related commercial functions, on the basis of storefronts extracted from street-level imagery. Specifically, we present a deep...conference paper 2020
- document
-
Qiu, S. (author), Bozzon, A. (author), Gadiraju, Ujwal (author)Searching the web to learn new things or gain knowledge has become a common activity. Recent advances in conversational user interfaces have led to a new research opportunity - that of analyzing the potential of conversational interfaces in improving the effectiveness of search as learning (SAL). Addressing this knowledge gap, in this...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Information overload is a problem many of us can relate to nowadays. The deluge of user generated content on the Internet, and the easy accessibility to a vast amount of data compounds the problem of remembering and retaining information that is consumed. To make information consumed more memorable, strategies such as note-taking have been found...conference paper 2020
- document
-
Qiu, S. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)This demo presents VirtualCrowd, a simulation platform for crowdsourcing campaigns. The platform allows the design, configuration, step-by-step execution, and analysis of customized tasks, worker profiles, and crowdsourcing strategies. The platform will be demonstrated through a crowd-mapping example in two cities, which will highlight the...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)This demo presents TickTalkTurk, a tool that can assist task requesters in quickly deploying crowdsourcing tasks in a customizable conversational worker interface. The conversational worker interface can convey task instructions, deploy microtasks, and gather worker input in a dialogue-based workflow. The interface is implemented as a Web...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author), Houben, G.J.P.M. (author)The trend of remote work leads to the prosperity of crowdsourcing marketplaces. In crowdsourcing marketplaces, online workers can select their preferable tasks and then complete them to get paid, while requesters design and publish tasks to acquire their desirable data. The standard user interface of the crowdsourcing task is the web page,...conference paper 2020
- document
-
Qiu, S. (author), Gadiraju, Ujwal (author), Bozzon, A. (author)Conversational agents are playing an increasingly important role in providing users with natural communication environments, improving outcomes in a variety of domains in human-computer interaction. Crowdsourcing marketplaces are simultaneously flourishing, and it has never been easier to acquire large-scale human input from online workers....conference paper 2020
- document
-
Mesbah, S. (author), Yang, J. (author), Sips, R.H.J. (author), Valle Torre, M. (author), Lofi, C. (author), Bozzon, A. (author), Houben, G.J.P.M. (author)Social media provides a timely yet challenging data source for adverse drug reaction (ADR) detection. Existing dictionary-based, semi-supervised learning approaches are intrinsically limited by the coverage and maintainability of laymen health vocabularies. In this paper, we introduce a data augmentation approach that leverages variational...conference paper 2019
- document
-
Sharifi Noorian, S. (author), Psyllidis, A. (author), Bozzon, A. (author)Street-level imagery contains a variety of visual information about the facades of Points of Interest (POIs). In addition to general mor- phological features, signs on the facades of, primarily, business-related POIs could be a valuable source of information about the type and iden- tity of a POI. Recent advancements in computer vision could...conference paper 2019