Natural Language Processing and Reinforcement Learning to Generate Morally: What is the optimal weight w to win the games while playing morally?

In our everyday life, people interact more and more with agents. However these agents often lack a moral sense and prioritize the accomplishment of the given task. In consequence, agents may unknowingly act immorally. Little research or progress has been done to endow agents with human morality and an internal sense of right and wrong. As of...

A systematic comparison of commonsense knowledge usages between natural language processing (NLP) and computer vision (CV)

Commonsense knowledge is the key of human intelligence in generalizing their knowledge to deal with complex tasks. Over the past years, a lot of research has been done in both natural language processing (NLP) and computer vision (CV) on leveraging commonsense knowledge to improve AI models. However, no systematic comparisons of existing work...

Loss functions and neural networks: Comparing different loss functions for NLP neural networks

Neural network is an active research field which involves many different (unsolved) issues, for example, different types of configuration of the network architectures, training strategies, etc. Amongst these active issues, the choice of loss (or cost) functions plays an important role in how a neural network model is to be optimized (trained)...

NLP and reinforcement learning to generate morally aligned text: How does explainable models perform compared to black-box models

<br/>This paper evaluates the performance of an automated explainable model, Moral- Strength, to predict morality, or more pre- cisely Moral Foundations Theory (MFT) traits. MFT is a way to represent and divide morality into precise and detailed traits. This evaluation happens in the Jiminy Cricket environment, an environ- ment composed of 25...

Tackling the Headline Incongruity Problem using Stance Detection

The increasing amount of untrusted content on the internet is a worrisome trend. The headline of an article can be adjusted to influence a potential readers attention and click-through rate. This clickbait or sensationalism can mislead the reader as the headline does not accurately represent the information in the corresponding article body....

DilBERT^2: Humor Detection and Sentiment Analysis of Comic Texts Using Fine-Tuned BERT Models

The field of Natural Language Processing (NLP) techniques has progressed rapidly over the recent years. With new advancements in transfer learning and the creation of open-source projects like BERT, solutions and research projects emerged implementing new ideas in a variety of domains, for tasks including text classification or question...

Distil-CodeGPT, Distilling Code-Generation Models for Local Use

The application of large language models (LLMs) for programming tasks, such as automatic code completion, has seen a significant upswing in recent years. However, due to their computational demands, they have to operate on servers. This both requires users to have a steady internet connection and raises potential privacy concerns. Therefore,...

Performance analysis of the state-of-the-art NLP models for predicting moral values

Moral values are instrumental in understanding people's beliefs and behaviors. Estimating such values from text would facilitate the interaction between humans and computers. To date, no comparison between NLP models for predicting moral values from text exists. This paper addresses this by comparing LSTM and more novel models such as BERT and...

Are BERT-based fact-checking models robust against adversarial attack?

We seek to examine the vulnerability of BERT-based fact-checking. We implement a gradient based, adversarial attack strategy, based on Hotflip swapping individual tokens from the input. We use this on a pre-trained ExPred model for fact-checking. We find that gradient based adversarial attacks are ineffective against ExPred. Uncertainties about...