Specialized learning support software can address the low societal participation of low-literate Dutch citizens. We use the situated Cognitive Engineering method to iteratively create a design specification for the envisioned system VESSEL: a Virtual Environment to Support the Societal participation Education of Low-literates. An initial high-level specification for this system is refined by incorporating the societal participation experiences of low-literate citizens into the design. In two series of user studies, the participant workshop and cultural probe methods were used with 23 low-literate participants. The Grounded Theory method was used to process the rich user data from these studies into the Societal Participation Experience of Low-Literates (SPELL) model. Using this experience model, the existing VESSEL specification was refined: requirements were empirically situated in the daily practice of low-literate societal participation, and new claims were written to explicate the learning effectiveness of the proposed VESSEL system. In conclusion, this study provides a comprehensive, theoretically and empirically grounded set of requirements and claims for the proposed VESSEL system, as well as the underlying SPELL model, which captures the societal participation experiences of low-literates citizens. The research methods used in this study are shown to be effective for requirements engineering with low-literate users.@en

People of low literacy could benefit from automated support when learning about societal participation. We design an Embodied Conversational Agent (ECA) ‘coach’ that can provide effective learning support to low-literate learners, develop a prototype virtual learning environment, and evaluate this prototype with low-literate end users. First, we inventory the learning support benefits of ECA coaching. Second, we update existing requirements to better specify functional demands for the coach ECA. Third, we write use cases and develop the prototype. Finally, we evaluate the prototype with low-literate users in a mixed-method within-subjects experiment. Results show that the coach influences the subjective learning experience: Participants report higher positive affect, higher user-system engagement, and increased self-efficacy regarding online banking. These results particularly apply to the domain of challenging information skills exercises. Caveats apply: One of four exercises was significantly more difficult than the other three; and coach support rules were not clearly formalized.@en

This thesis presents the research, design, and evaluation of the learning support system VESSEL: Virtual Environment to Support the Societal participation Education of Low-literates. The project was started from the premise that people of low literacy in the Netherlands participate in society less often and less effectively than literate people do: Their lower ability to read, write, speak, and understand the Dutch language hampers their ability to independently be part of society. Our goal was to create learning support prototypes with a re-usable design rationale, aimed at helping these people of low literacy learn to improve their societal participation. To achieve this, low-literate learners participated throughout the entire design process, ensuring that we addressed their wants and needs with regard to learning and the perceived shortcomings of existing learning materials and kept in mind their skills and capabilities in order to ensure effective learning. Particularly, we investigated the possible ways that digital learning, Virtual Learning Environments (VLE), and Embodied Conversational Agents (ECA) could help fulfill the societal participation needs of this target group. We used the Socio-Cognitive Engineering (SCE) methodology to organize and structure this research, distinguishing the foundation, specification and evaluation of the VESSEL design. Two studies provided a grounded foundation for VESSEL, which was refined and worked out into three subsequent studies that provided the consequential design specifications and prototype evaluations (all prototypes have been tested with a human ’Wizard of Oz’ simulating VESSEL functionality). @en

People of low literacy experience difficulties while participating in society. Learning support software could help alleviate these difficulties. However, there is currently no overview of theoretically and empirically sound requirements for this kind of support. This paper uses the situated cognitive engineering method to create a requirements baseline for a virtual environment to support the societal participation education of low-literates (VESSEL), based on an analysis of the domain, human factors, and current applications. Four major outcomes are presented. First, a comprehensive overview is collected of the operational demands and human factors knowledge relevant to societal participation learning for low-literate citizens. Second, this overview is translated into a list of eight functional requirements: focused on low-literate learners, set in the context of societal participation, and supported by claims of cognitive, affective, and social benefits to learning. Third, a sample of Dutch societal participation learning support programs is assessed using these requirements, to highlight both current technology best practices and discrepancies between theory and practice. Fourth, virtual learning environment technology is suggested as an ‘enabling’ technology; an overview is shown of how virtual environments, actors, and objects can beneficially enable meeting the requirements baseline. Finally, directions for future study are discussed.@en

In this study, we attempt to specify the cognitive support behavior of a previously designed embodied conversational agent coach that provides learning support to low-literates. Three knowledge gaps are identified in the existing work: an incomplete specification of the behaviors that make up ‘support,’ an incomplete specification of how this support can be personalized, and unclear speech recognition rules. We use the socio-cognitive engineering method to update our foundation of knowledge with new online banking exercises, low-level scaffolding and user modeling theory, and speech recognition. We then refine the design of our coach agent by creating comprehensive cognitive support rules that adapt support based on learner needs (the ‘Generalized’ approach) and attune the coach’s support delay to user performance in previous exercises (the ‘Individualized’ approach). A prototype is evaluated in a 3-week within- and between-subjects experiment. Results show that the specified cognitive support is effective: Learners complete all exercises, interact meaningfully with the coach, and improve their online banking self-efficacy. Counter to hypotheses, the Individualized approach does not improve on the Generalized approach. Whether this indicates suboptimal operationalization or a deeper problem with the Individualized approach remains as future work.@en

In this study, we investigate if a digital coach for low-literate learners that provides cognitive learning support based on scaffolding can be improved by adding affective learning support based on motivational interviewing, and social learning support based on small talk. Several knowledge gaps are identified: motivational interviewing and small talk must be translated to control rules for this coach, a formal model of participant emotional states is needed to allow the coach to parse the learner’s emotional state, and various sensors must be used to let the coach detect and act on this state. We use the situated Cognitive Engineering (sCE) method to update an existing foundation of knowledge with emotional models, motivational interviewing and small talk theory, technology, and a new exercise in the volunteer work domain. We use this foundation to create a design specification for an Embodied Conversational Agent (ECA) coach that provides cognitive, affective, and social learning support for this exercise. A prototype is created, and compared to a prototype that only provides cognitive support in a within- and between-subjects experiment. Results show that both prototypes work as expected: learners interact with the coach and complete all exercises. Almost no significant differences are found between the two prototypes, indicating that the affective and social support were not effective as designed. Potential improvements are provided for future work. Results also show significant differences between two subgroups of low-literate participants, and between men and women, reinforcing the importance of using individualized support measures with this demographic.@en