In this article we introduce Mementos: the first multimodal corpus for computational modeling of affect and memory processing in response to video content. It was collected online via crowdsourcing and captures 1995 individual responses collected from 297 unique viewers responding to 42 different segments of music videos. Apart from webcam recordings of their upper-body behavior (totaling 2012 minutes) and self-reports of their emotional experience, it contains detailed descriptions of the occurrence and content of 989 personal memories triggered by the video content. Finally, the dataset includes self-report measures related to individual differences in participants' background and situation (Demographics, Personality, and Mood), thereby facilitating the exploration of important contextual factors in research using the dataset. We describe 1) the construction and contents of the corpus itself, 2) analyse the validity of its content by investigating biases and consistency with existing research on affect and memory processing, 3) review previously published work that demonstrates the usefulness of the multimodal data in the corpus for research on automated detection and prediction tasks, and 4) provide suggestions for how the dataset can be used in future research on modeling Video-Induced Emotions, Memory-Associated Affect, and Memory Evocation.

Objectives: Children with cancer often experience sleep problems, which are associated with many negative physical and psychological health outcomes, as well as with a lower quality of life. Therefore, interventions are strongly required to improve sleep in this population. We evaluated interactive education with respect to sleep hygiene with a social robot at a pediatric oncology outpatient clinic regarding the feasibility, experiences, and preliminary effectiveness. Methods: Researchers approached children (8 to 12 years old) who were receiving anticancer treatment and who were visiting the outpatient clinic with their parents during the two-week study period. The researchers completed observation forms regarding feasibility, and parents completed the Children’s Sleep Hygiene Scale before and two weeks after the educational regimen. The experiences of children and parents were evaluated in semi-structured interviews. We analyzed open answers by labeling each answer with a topic reflecting the content and collapsed these topics into categories. We used descriptive statistics to describe the feasibility and experiences, and a dependent-samples t-test to evaluate the preliminary effectiveness. Results: Twenty-eight families participated (58% response rate) and all interactions with the robot were completed. The children and parents reported that they learned something new (75% and 50%, respectively), that they wanted to learn from the robot more often (83% and 75%, respectively), and that they applied the sleeping tips from the robot afterwards at home (54%). Regarding the preliminary effectiveness, children showed a statistically significant improvement in their sleep hygiene (p = 0.047, d = 0.39). Conclusions: Providing an educational regimen on sleep hygiene in a novel, interactive way by using a social robot at the outpatient clinic seemed feasible, and the children and parents mostly exhibited positive reactions. We found preliminary evidence that the sleep hygiene of children with cancer improved.

Becoming a well-functioning team requires continuous collaborative learning by all team members. This is called co-learning, conceptualized in this paper as comprising two alternating iterative stages: partners adapting their behavior to the task and to each other (co-adaptation), and partners sustaining successful behavior through communication. This paper focuses on the first stage in human-robot teams, aiming at a method for the identification of recurring behaviors that indicate co-learning. Studying this requires a task context that allows for behavioral adaptation to emerge from the interactions between human and robot. We address the requirements for conducting research into co-adaptation by a human-robot team, and designed a simplified computer simulation of an urban search and rescue task accordingly. A human participant and a virtual robot were instructed to discover how to collaboratively free victims from the rubbles of an earthquake. The virtual robot was designed to be able to real-time learn which actions best contributed to good team performance. The interactions between human participants and robots were recorded. The observations revealed patterns of interaction used by human and robot in order to adapt their behavior to the task and to one another. Results therefore show that our task environment enables us to study co-learning, and suggest that more participant adaptation improved robot learning and thus team level learning. The identified interaction patterns can emerge in similar task contexts, forming a first description and analysis method for co-learning. Moreover, the identification of interaction patterns support awareness among team members, providing the foundation for human-robot communication about the co-adaptation (i.e., the second stage of co-learning). Future research will focus on these human-robot communication processes for co-learning.

Current developments in Artificial Intelligence (AI) led to a resurgence of Explainable AI (XAI). New methods are being researched to obtain information from AI systems in order to generate explanations for their output. However, there is an overall lack of valid and reliable evaluations of the effects on users' experience of, and behavior in response to explanations. New XAI methods are often based on an intuitive notion what an effective explanation should be. Rule- and example-based contrastive explanations are two exemplary explanation styles. In this study we evaluate the effects of these two explanation styles on system understanding, persuasive power and task performance in the context of decision support in diabetes self-management. Furthermore, we provide three sets of recommendations based on our experience designing this evaluation to help improve future evaluations. Our results show that rule-based explanations have a small positive effect on system understanding, whereas both rule- and example-based explanations seem to persuade users in following the advice even when incorrect. Neither explanation improves task performance compared to no explanation. This can be explained by the fact that both explanation styles only provide details relevant for a single decision, not the underlying rational or causality. These results show the importance of user evaluations in assessing the current assumptions and intuitions on effective explanations.

Increasing automation in the healthcare sector calls for a Hybrid Intelligence (HI) approach to closely study and design the collaboration of humans and autonomous machines. Ensuring that medical HI systems' decision-making is ethical is key. The use of Team Design Patterns (TDPs) can advance this goal by describing successful and reusable configurations of design problems in which decisions have a moral component and facilitating communication in multidisciplinary teams designing HI systems. For this research, TDPs were developed describing a set of solutions for a design problem in a medical HI system: mitigating harmful biases in machine learning algorithms. The Socio-Cognitive Engineering (SCE) methodology was employed, integrating operational demands, human factors knowledge, and a technological analysis into a set of TDPs. A survey was created to assess the usability of the patterns with regards to their understandability, effectiveness, and generalizability. Results showed that TDPs are a useful method to unambiguously describe solutions for diverse HI design problems with a moral component on varying abstraction levels, usable by a heterogeneous group of multidisciplinary researchers. Additionally, results indicated that the SCE approach and the developed questionnaire are suitable methods for creating and assessing TDPs.

The fields of music, health, and technology have seen significant interactions in recent years in developing music technology for health care and well-being. In an effort to strengthen the collaboration between the involved disciplines, the workshop “Music, Computing, and Health” was held to discuss best practices and state-of-the-art at the intersection of these areas with researchers from music psychology and neuroscience, music therapy, music information retrieval, music technology, medical technology (medtech), and robotics. Following the discussions at the workshop, this article provides an overview of the different methods of the involved disciplines and their potential contributions to developing music technology for health and well-being. Furthermore, the article summarizes the state of the art in music technology that can be applied in various health scenarios and provides a perspective on challenges and opportunities for developing music technology that (1) supports person-centered care and evidence-based treatments, and (2) contributes to developing standardized, large-scale research on music-based interventions in an interdisciplinary manner. The article provides a resource for those seeking to engage in interdisciplinary research using music-based computational methods to develop technology for health care, and aims to inspire future research directions by evaluating the state of the art with respect to the challenges facing each field.

BACKGROUND: Electronic mental (e-mental) health care for depression aims to overcome barriers to and limitations of face-to-face treatment. Owing to the high and growing demand for mental health care, a large number of such information and communication technology systems have been developed in recent years. Consequently, a diverse system landscape formed. OBJECTIVE: This literature review aims to give an overview of this landscape of e-mental health systems for the prevention and treatment of major depressive disorder, focusing on three main research questions: (1) What types of systems exist? (2) How technologically advanced are these systems? (3) How has the system landscape evolved between 2000 and 2017? METHODS: Publications eligible for inclusion described e-mental health software for the prevention or treatment of major depressive disorder. Additionally, the software had to have been evaluated with end users and developed since 2000. After screening, 270 records remained for inclusion. We constructed a taxonomy concerning software systems, their functions, how technologized these were in their realization, and how systems were evaluated, and then, we extracted this information from the included records. We define here as functions any component of the system that delivers either treatment or adherence support to the user. For this coding process, an elaborate classification hierarchy for functions was developed yielding a total of 133 systems with 2163 functions. The systems and their functions were analyzed quantitatively, with a focus on technological realization. RESULTS: There are various types of systems. However, most are delivered on the World Wide Web (76%), and most implement cognitive behavioral therapy techniques (85%). In terms of content, systems contain twice as many treatment functions as adherence support functions, on average. Furthermore, autonomous systems, those not including human guidance, are equally as technologized and have one-third less functions than guided ones. Therefore, lack of guidance is neither compensated with additional functions nor compensated by technologizing functions to a greater degree. Although several high-tech solutions could be found, the average system falls between a purely informational system and one that allows for data entry but without automatically processing these data. Moreover, no clear increase in the technological capabilities of systems showed in the field, between 2000 and 2017, despite a marked growth in system quantity. Finally, more sophisticated systems were evaluated less often in comparative trials than less sophisticated ones (OR 0.59). CONCLUSIONS: The findings indicate that when developers create systems, there is a greater focus on implementing therapeutic treatment than adherence support. Although the field is very active, as evidenced by the growing number of systems developed per year, the technological possibilities explored are limited. In addition to allowing developers to compare their system with others, we anticipate that this review will help researchers identify opportunities in the field.

Artificially intelligent agents will deal with more morally sensitive situations as the field of AI progresses. Research efforts are made to regulate, design and build Artificial Moral Agents (AMAs) capable of making moral decisions. This research is highly multidisciplinary with each their own jargon and vision, and so far it is unclear whether a fully autonomous AMA can be achieved. To specify currently available solutions and structure an accessible discussion around them, we propose to apply Team Design Patterns (TDPs). The language of TDPs describe (visually, textually and formally) a dynamic allocation of tasks for moral decision making in a human-agent team context. A task decomposition is proposed on moral decision-making and AMA capabilities to help define such TDPs. Four TDPs are given as examples to illustrate the versatility of the approach. Two problem scenarios (surgical robots and drone surveillance) are used to illustrate these patterns. Finally, we discuss in detail the advantages and disadvantages of a TDP approach to moral decision making.

Post-traumatic stress affects millions of people worldwide. Appraisal training is an intervention that has been used to decrease the negative effects of a traumatic event. In two studies, the acceptance and effects of technology in supporting appraisal was studied. Study 1, a descriptive study, examined the response to and acceptance of a workshop on perspective broadening with technological support among soldiers and firefighters. Results revealed that both groups evaluated the training as useful and feasible, and both favoured the full version of the tool. Study 2 investigated the effect of the support tool among a student sample in comparison to the paper-based training. Participants followed the training individually. Comparisons between the two groups revealed no significant differences on multiple outcome measures. Behaviour observed during the training suggests that shorter sessions might prove more effective. The findings indicate acceptance of the technology supported training but gives no indication that the effects of the training are improved by technological support.

Mobile location-sharing technology is increasingly being used by parents to locate their children. Research shows that these technologies may pose risks to important user values such as privacy and responsibility, while they aim to promote others such as family security. As a solution, we proposed the use of Social Commitment (SC) models for governing the sharing and receiving of data. A social commitment represents an agreement between two people about which data should (not) be shared and received in which situation. We hypothesize that the use of SCs in mobile location sharing applications provides improved support for user values since it allows for a more flexible, context-aware location sharing. In this paper, we present a user study to test this hypothesis. The study focuses on primary school children ([Formula presented]) as the main target group, who's values may be demoted through the use of location-sharing technology. Children were provided with two versions of a mobile location sharing app: one with basic check-in functionality –the basic app –and one augmented with an SC model, which we call a Socially Adaptive Electronic Partner (SAEP). Our findings suggest, among other things that the SAEP would provide improved support for children's values compared to the basic app.

Background: The high frequency of outpatient visits after kidney transplantation is burdensome to both the recovering patient and health care capacity. Self-monitoring kidney function offers a promising strategy to reduce the number of these outpatient visits. Objective: The objective of this study was to investigate whether it is safe to rely on patients’ self-measurements of creatinine and blood pressure, using data from a self-management randomized controlled trial. Methods: For self-monitoring creatinine, each participant received a StatSensor Xpress-i Creatinine Meter and related test material. For self-monitoring blood pressure, each participant received a Microlife WatchBP Home, an oscillometric device for blood pressure self-measurement on the upper arm. Both devices had a memory function and the option to download stored values to a computer. During the first year post transplantation, 54 patients registered their self-measured creatinine values in a Web-based Self-Management Support System (SMSS) which provided automatic feedback on the registered values (eg, seek contact with hospital). Values registered in the SMSS were compared with those logged automatically in the creatinine device to study reliability of registered data. Adherence to measurement frequency was determined by comparing the number of requested with the number of performed measurements. To study adherence to provided feedback, SMSS-logged feedback and information from the electronic hospital files were analyzed. Results: Level of adherence was highest during months 2-4 post transplantation with over 90% (42/47) of patients performing at least 75% of the requested measurements. Overall, 87.00% (3448/3963) of all registered creatinine values were entered correctly, although values were often registered several days later. If (the number of) measured and registered values deviated, the mean of registered creatinine values was significantly lower than what was measured, suggesting active selection of lower creatinine values. Adherence to SMSS feedback ranged from 53% (14/24) to 85% (33/39), depending on the specific feedback. Conclusions: Patients’ tendency to postpone registration and to select lower creatinine values for registration and the suboptimal adherence to the feedback provided by the SMSS might challenge safety. This should be well considered when designing self-monitoring care systems, for example by ensuring that self-measured data are transferred automatically to an SMSS.