The rise of urbanization, overpopulation, and resource depletion in recent years has triggered interest in developing more efficient solutions that could offer sustainable development and improve the quality of life in cities. The increasingly wider and more advanced availability of computational power throughout the anthropic space—which saw the emergence of the so-called “ubiquitous computing” paradigm—has opened new possibilities for the design of smart cities. In particular, the emergence of Extended Reality technologies (XR), such as Virtual Reality and Augmented Reality, has provided a new interface to bridge the gap between the physical and digital realms, enabling immersive experiences and interactions within Smart City environments. This paper, based on three case studies at different scales of smart environments, explores the current and prospected relevance of XR to both design and experience spaces enriched and characterized by layers of digital information and sensorial interactions.

Understanding humans are the key to developing optimal design solutions for product-service systems. In this sense, the experiential approach is in line but might go beyond typical Human Centered Design (HCD) methods in that it focuses on generating positive experiences that contribute directly to human well-being. Extended Reality (XR) showed the potential to replicate or simulate experience as a whole and gained attention from design communities. XR platforms confused design practitioners due to their fast-advancing amounts and relevant experiences. Hence, this study introduced two surveys on XR platforms to clarify which experiences they could provide and when to implement them into HCD processes. Survey 1 categorized XR platforms according to their key attributes and mapped them into the Experience Matrix. Survey 2 invented two designer personas and a fictional project to analyze barriers and strategies to implement XR platforms into design processes. Eighty-eight XR platforms were categorized into nineteen clusters, where creation and simulation had the highest numbers. Regarding implementing XR in design practices, the cost is still the key concern and there's a trade-off between software cost and assets purchased for different types of designers.

For designing large-scale products like an airplane, engaging end-users in the concept phase is difficult. However, early user evaluation is important to choose the path which fits the user’s needs best. In particular, comfort-related assessments are difficult to conduct with digital models that are shown on a desktop PC application. Digital Human Modelling (DHM) plays a role in postural comfort analysis, while the subjective comfort feedback still largely relied on consulting with end-users. This paper applies a human-centered design process and analyses the advantages and disadvantages of using VR prototypes for involving users during concept design. This study focused on using VR prototypes for concept selection and verification based on comfort assessment with potential end-users. The design process started with an online questionnaire for identifying the quality of the design elements (Step 1 online study). Then, alternative concepts were implemented in VR, and users evaluated these concepts via a VR headset (Step 2 Selection study). Finally, the research team redesigned the final concept and assessed it with potential users via a VR headset (Step 3 Experience study). Every design element contributed positively to the long-haul flight comfort, especially tap-basin height, storage, and facilities. The male and female participants had different preferences on posture, lighting, storage, and facilities. The final prototype showed a significantly higher comfort rate than the original prototypes. The first-person immersion in VR headsets helps to identify the nuances between concepts, thus supports better decision-making via collecting richer and more reliable user feedback to make faster and more satisfying improvements.

Ensuring surgeons are well-trained in various skills is of paramount importance to patient safety. Surgical simulators were introduced to laparoscopy training during the last 2 decades for basic skills training. The main drawback of current simulation-based laparoscopy training is their lack of true representation of the intro-operative experience. To create a complete surgical surrounding, the required amount of resources is demanding. Moreover, organizing immersive training with surgical teams burdens daily clinical routines. High-end virtual reality (VR) headsets bring an opportunity to generate an immersive virtual OR with accessible and affordable expenses. Pilot studies reveal that personalization and localization are key needs of the virtual operating room (VOR). They are therefore key in this study. The focus of this study was to explore the effect of different human factors, such as domain knowledge, culture, and familiarity of VR technologies, on the perception of VOR experience. A human-centered design approach was applied to investigate the presence and usability of a VOR. Sixty-four surgical practitioners joined the study in the Netherlands and India. The surgeons were referred to as “experts” and surgical trainees as “novices.” The VOR system we used is composed of a laparoscopic simulator, a graphic virtual OR surrounding, and an Oculus Rift VR headset. Participants conducted the “complete Lapchol” task with the VOR. Afterward, four questionnaires were used to collect subjective ratings on presence and usability. Participant’s qualitative feedback was collected using a semi-structural interview as the final stage. Results showed the surgical knowledge only affected perceived mental demand when using a VOR. The cultural difference would alter the rating on the majority of items in these questionnaires. VR experience mainly affected the judgment on presence including “quality of interface” and “reversible actions.” The interaction effects between surgical knowledge either with culture difference or with VR experience were obvious. This study demonstrated the influences of cultural differences on the perception of immersion and usability. Integrating immersive technologies such as virtual reality and augmented reality to human-centered design opens a brand new horizon for health care and similar professional training.

The usability now serves as a fundamental quality of a computational device, e.g. smartphone. Moreover, the smartphone has firmly embedded into our daily life as an indispensable part, so the context and style that user may interact with them are largely different from a decade ago. Nowadays, testing usability with end user has become a common sense. Thus, how valid a usability evaluation method could assess the ‘extent to which a product can be used by specified users’ (ISO 9241-11) to facilitate software design becomes an interesting question to explore. In this research, three usability evaluation methods are compared. Among these methods, IsoMetrics is a standard questionnaire aiming at offer usability data for summative and formative evaluation; SUMI aims to assess quality of software product from end users perspective; User Model Checklist is a method based on user’s cognition-motor chain in specific tasks. The coverage and amount of usability issues, user’s effort of evaluation and software developer’s feedback on evaluation result are compared under a simulated usability test on SMS function with a smartphone. The result indicate that User Model Checklist could cover 90.4% of the usability issues found by IsoMetrics and SUMI, while 26.3% usability issues found by User Model Checklist could not be covered by IsoMetrics and SUMI. Users put highest effort on accomplish IsoMetrics and lowest effort on User Model Checklist. Moreover, the feedbacks from the developers show that the User Model Checklist requires lower usability knowledge, offers clearer improvement points and supports detailed design better.

The study investigated the extent to which electronic voting is accessible to Dutch voters, especially the visually impaired, those with low literacy, and the elderly. Together with the different user groups, a series of electronic interfaces were developed and simulations of a vote-printer were built to run tests on large numbers of participants. The interface consisted of a card reader, a touchscreen and a printer; audio support was available via a headset. For participants with disabilities, the independent variables were visual impairment and low literacy. For elderly participants, the independent variable was age. All participants were asked to make specific choices on the screen and to check the printed result for their choice. As reference, they were asked to vote using the current Dutch ballot paper/red pencil system. The criteria used to determine the accessibility of both systems was: does the printed ballot match the intended vote? The vote-printer significantly increased independent voting by the visually impaired, however this was not seen for the low-literacy group. For the elderly, the use of a vote-printer with electronic interface is equally as accessible as the current paper ballot. All three groups reported using a vote-printer with electronic interface to be easier than the current paper ballot. The study confirmed that co-creating with intended users in the early conceptualization phase is key.