A Survey of Crowdsourcing Methods for Commonsense Knowledge Collection

Commonsense knowledge is information that all humans own and use to interpret common situations and react to them accordingly. This kind of information is necessary for the training of artificial intelligence models to reach a performance as close as possible to human performance. Researchers have developed methods that use crowdsourcing to...

Swipe for Science: a single-player game designed for collecting discriminative evidence

We introduce Swipe for Science, a single-player mobile game designed for collecting discriminative evidence from crowds. When people play this game, we collect data about how certain concepts are associated with different contexts, which is valuable knowledge for machine learning systems. The main gameplay loop consists of swiping concepts up,...

FindItOut: a Crowdsourcing Discriminative Tacit Knowledge Elicitation Multiplayer Game using Pictures

Despite the ever-growing advances in artificial intelligence (AI), common sense acquisition and reasoning is still comparingly in their early stages to other fields in AI. To further advance this field, it is necessary to collect large amounts of common sense facts or tacit knowledge to train such AI models. One effective way is to use...

Designing a single player textual GWAP for validating tacit knowledge elicitation from crowds

Machine learning can still make harmful mistakes. A solution would be tacit knowledge. Machine learning needs this type of knowledge to improve. An example of such knowledge that can help make the system draw better logical conclusions would be: if presented with an open fridge, then it could deduct that the food will go bad. Tacit knowledge or...