Large Language Model-powered conversational agents (CAs) are increasingly capable of projecting sophisticated personalities through language, but how these projections affect users is unclear. We thus examine how CA personalities expressed linguistically affect user decisions and perceptions in the context of charitable giving. In a crowdsourced study, 360 participants interacted with one of eight CAs, each projecting a personality composed of three linguistic aspects: attitude (optimistic/pessimistic), authority (authoritative/submissive), and reasoning (emotional/rational). While the CA's composite personality did not affect participants' decisions, it did affect their perceptions and emotional responses. Particularly, participants interacting with pessimistic CAs felt lower emotional state and lower affinity towards the cause, perceived the CA as less trustworthy and less competent, and yet tended to donate more toward the charity. Perceptions of trust, competence, and situational empathy significantly predicted donation decisions. Our findings emphasize the risks CAs pose as instruments of manipulation, subtly influencing user perceptions and decisions.

The growing sophistication of Large Language Models allows conversational agents (CAs) to engage users in increasingly personalized and targeted conversations. While users may vary in their receptiveness to CA persuasion, stylistic elements and agent personalities can be adjusted on the fly. Combined with image generation models that create context-specific realistic visuals, CAs have the potential to influence user behavior and decision making. We investigate the effects of linguistic and visual elements used by CAs on user perception and decision making in a charitable donation context with an online experiment (n=344). We find that while CA attitude influenced trust, it did not affect donation behavior. Visual primes played no role in shaping trust, though their absence resulted in higher donations and situational empathy. Perceptions of competence and situational empathy were potential predictors of donation amounts. We discuss the complex interplay of user and CA characteristics and the fine line between benign behavior signaling and manipulation.

Data Humanism has gained prominence in personal visualization and Personal Informatics, advocating for a subjective and slow approach to engage with personal data. Collaborative sensemaking has great potential for aiding the understanding of personal data, yet little is known about addressing requirements of structure and coordination when integrating Data Humanism into collaborative visualization. In this paper, we propose design principles for creating both subjective and effective collaborative visualizations, while coordinating the slow sensemaking process and promoting data awareness and communication. We operationalize these principles into a personal visualization toolkit, which we evaluate with an observational study involving 16 university students (8 pairs) analyzing each other's screen-time data. Our findings reveal that implementing the proposed design principles: (1) facilitated data comparison from shared subjective perspectives, (2) helped coordinate sensemaking while allowing time for understanding personal data, and (3) helped the contextualization of data patterns, in turn aiding self-reflection.

Analysing transcripts of design activity typically involve either close reading or manual coding of data, which limits the amount of data that can be analysed. In contrast, we explore a machine-learning based linguistic analysis tool called Empath to identify patterns of reasoning in design talk. The data we use derives from the Design Thinking Research Symposium (DTRS) shared-data workshops which we analyse to look at two contrasting aspects of design talk: the expression of tentativeness, characterising designers' generative thinking; and the articulation of explanations, characterising their deductive or analytical thinking. We show, at the level of speech turns, how tentativeness and explanation relate to, and overlap, each other. Finally, we discuss the limitations of this ‘linguistic analysis at scale’ approach.

With the most advanced natural language processing and artificial intelligence approaches, effective summarization of long and multi-topic documents - such as academic papers - for readers from different domains still remains a challenge. To address this, we introduce ConceptEVA, a mixed-initiative approach to generate, evaluate, and customize summaries for long and multi-topic documents. ConceptEVA incorporates a custom multi-task longformer encoder decoder to summarize longer documents. Interactive visualizations of document concepts as a network reflecting both semantic relatedness and co-occurrence help users focus on concepts of interest. The user can select these concepts and automatically update the summary to emphasize them. We present two iterations of ConceptEVA evaluated through an expert review and a within-subjects study. We find that participants' satisfaction with customized summaries through ConceptEVA is higher than their own manually-generated summary, while incorporating critique into the summaries proved challenging. Based on our findings, we make recommendations for designing summarization systems incorporating mixed-initiative interactions.

Visual data storytelling is gaining importance as a means of presenting data-driven information or analysis results, especially to the general public. This has resulted in design principles being proposed for data-driven storytelling, and new authoring tools being created to aid such storytelling. However, data analysts typically lack sufficient background in design and storytelling to make effective use of these principles and authoring tools. To assist this process, we present ChartStory for crafting data stories from a collection of user-created charts, using a style akin to comic panels to imply the underlying sequence and logic of data-driven narratives. Our approach is to operationalize established design principles into an advanced pipeline that characterizes charts by their properties and similarities to each other, and recommends ways to partition, layout, and caption story pieces to serve a narrative. ChartStory also augments this pipeline with intuitive user interactions for visual refinement of generated data comics. We extensively and holistically evaluate ChartStory via a trio of studies. We first assess how the tool supports data comic creation in comparison to a manual baseline tool. Data comics from this study are subsequently compared and evaluated to ChartStory's automated recommendations by a team of narrative visualization practitioners. This is followed by a pair of interview studies with data scientists using their own datasets and charts who provide an additional assessment of the system. We find that ChartStory provides cogent recommendations for narrative generation, resulting in data comics that compare favorably to manually-created ones.

Creative conversation among designers and stakeholders in a design project enables new ideas to naturally originate and evolve. Language allows for the exchange of values, priorities, and past experience whilst keeping solution forms usefully ambiguous. Yet there is a danger that only the language of people directly involved in the design process gets to be heard, limiting how inclusively the problems are interpreted, which in turn can impede how complex design problems are addressed. Recent advances in artificial intelligence (AI) have shown the exclusionary spaces that are often inhabited by designers, engineers, and developers of new artefacts and technologies. On the other hand, text data used to train language models for machine learning applications have the potential to highlight societal biases in ways that designers can utilise. In this paper, we report the results of an exploratory study using AI text generation to synthesize and narrate opinions and experiences that may be unfamiliar to designers. Three pairs of designers were given a complex socio-technical problem to solve. Of these, two pairs interacted with an AI text generator during the task, while one pair acted as a baseline condition. Analysing the conversational exchanges between the designers and the designers & AI, we observe how the use of AI leads to prompting nuanced interpretations of problems and ideas, opening up the objective problem and design lenses and interpretations. Finally, we discuss how the designers (re)assign different roles to the AI to suit their creative purposes.

Multidimensional data is often visualized using coordinated multiple views in an interactive dashboard. However, unlike in infographics where text is often a central part of the presentation, there is currently little knowledge of how to best integrate text and annotations in a visualization dashboard. In this paper, we explore a technique called FacetNotes for presenting these textual annotations on top of any visualization within a dashboard irrespective of the scale of data shown or the design of visual representation itself. FacetNotes does so by grouping and ordering the textual annotations based on properties of (1) the individual data points associated with the annotations, and (2) the target visual representation on which they should be shown. We present this technique along with a set of user interface features and guidelines to apply it to visualization interfaces. We also demonstrate FacetNotes in a custom visual dashboard interface. Finally, results from a user study of FacetNotes show that the technique improves the scope and complexity of insights developed during visual exploration.

In today’s world, the advantages of data-enabled design are undeniable, increasing the performance of organisations drastically by informing and inspiring the design process. While organisations seem to be more experienced with quantitative data for evaluative purposes, they do struggle to use data as creative material to inspire the design process. Choosing the right type of data representation is critical for using data for creative purposes. Data visualization has proven to be highly effective in increasing understanding of data, as it is fast, accurate and flexible. Data physicalization, on the other hand, remains unexplored in comparison, especially its effect on creativity. This paper presents the results of two studies (one preliminary and one follow-up study), which explored the use of data physicalization in creative settings. The preliminary study enabled to collect initial requirements for the development of a physicalization toolkit, while the follow-up study investigated its impact on the design process, in comparison to data visualization. From the studies, we developed Concreate, a collaborative data physicalization toolkit designed to lead to creative insights from quantitative data. Our results show that Concreate can potentially stimulate creative thinking, by encouraging intense, tangible interaction with data leading to increased reflection-in-action and a deeper understanding of data. The two studies and toolkit development were carried out at a multinational automotive company, interested in innovating by incorporating data as creative material. Besides the immediate practical implications, we conclude this paper with a discussion on future recommendations for using data physicalization in the design process.

Dynamic networks-networks that change over time-can be categorized into two types: offline dynamic networks, where all states of the network are known, and online dynamic networks, where only the past states of the network are known. Research on staging animated transitions in dynamic networks has focused more on offline data, where rendering strategies can take into account past and future states of the network. Rendering online dynamic networks is a more challenging problem since it requires a balance between timeliness for monitoring tasks-so that the animations do not lag too far behind the events-and clarity for comprehension tasks-to minimize simultaneous changes that may be difficult to follow. To illustrate the challenges placed by these requirements, we explore three strategies to stage animations for online dynamic networks: time-based, event-based, and a new hybrid approach that we introduce by combining the advantages of the first two. We illustrate the advantages and disadvantages of each strategy in representing low- and high-throughput data and conduct a user study involving monitoring and comprehension of dynamic networks. We also conduct a follow-up, think-aloud study combining monitoring and comprehension with experts in dynamic network visualization. Our findings show that animation staging strategies that emphasize comprehension do better for participant response times and accuracy. However, the notion of 'comprehension' is not always clear when it comes to complex changes in highly dynamic networks, requiring some iteration in staging that the hybrid approach affords. Based on our results, we make recommendations for balancing event-based and time-based parameters for our hybrid approach.

Creating Spatial Computing (SComp) artifacts (including Virtual Reality, Augmented Reality, Mixed Reality, and Ambient Intelligent artifacts) is a rapidly-emerging domain in need of new design methodologies. In this paper, we examine whether and how ethics are procedurally integrated into the creations of SComp artifacts. After an introduction to terminology—including a re-framed definition of Spatial Computing—findings of interviews with Spatial Computing practitioners are shared. The interviews indicated an awareness among professionals about the inordinate vulnerability of SComp artifacts, and about the need for—and the lack thereof—processes and tests to mitigate negative effects of SComp artifacts. Results from the domain expert interviews are integrated into a proposed framework: The Framework for Ethical Spatial Computing Design Engineering. Our framework serves to support researchers and practitioners in devising new methodologies unique to Spatial Computing by highlighting considerations central to the creation of ethical artifacts. The framework integrates the findings from the in-depth interview study and builds on existing models in Design Process, Methods, and Human-Computer Interaction (HCI) Research that highlight important barriers and opportunities between research and practice. It maps the three-phases journey consisted of (1) Enablers, (2) Synthesizers, and (3) SComp Artifacts. We trust that our work sheds light on considerations necessary to the creation of ethical Spatial Computing artifacts.