T. He
Please Note
8 records found
1
"A Great Start, But..."
Evaluating LLM-Generated Mind Maps for Information Mapping in Video-Based Design
Extracting concepts and understanding relationships from videos is essential in Video-Based Design (VBD), where videos serve as a primary medium for exploration but require significant effort in managing meta-information. Mind maps, with their ability to visually organize complex data, offer a promising approach for structuring and analysing video content. Recent advancements in Large Language Models (LLMs) provide new opportunities for meta-information processing and visual understanding in VBD, yet their application remains underexplored. This study recruited 28 VBD practitioners to investigate the use of prompt-tuned LLMs for generating mind maps from ethnographic videos. Comparing LLM-generated mind maps with those created by professional designers, we evaluated rated scores, design effectiveness, and user experience across two contexts. Findings reveal that LLMs effectively capture central concepts but struggle with hierarchical organization and contextual grounding. We discuss trust, customization, and workflow integration as key factors to guide future research on LLM-supported information mapping in VBD.
Factory Operators' Perspectives on Cognitive Assistants for Knowledge Sharing
Challenges, Risks, and Impact on Work
Our results indicate that while CAs have the potential to significantly improve efficiency through knowledge sharing and quicker resolution of production issues, they also introduce concerns around workplace surveillance, the types of knowledge that can be shared, and shortcomings compared to human-to-human knowledge sharing. Additionally, our findings stress the importance of addressing privacy, knowledge contribution burdens, and tensions between factory operators and their managers. ...
Our results indicate that while CAs have the potential to significantly improve efficiency through knowledge sharing and quicker resolution of production issues, they also introduce concerns around workplace surveillance, the types of knowledge that can be shared, and shortcomings compared to human-to-human knowledge sharing. Additionally, our findings stress the importance of addressing privacy, knowledge contribution burdens, and tensions between factory operators and their managers.
MarkupLens
An AI-Powered Tool to Support Designers in Video-Based Analysis at Scale
Democratizing EEG
Embedding Electroencephalography in a Head-Mounted Display for Ubiquitous Brain-Computer Interfacing
Open hardware and the need for ecologically valid measurements drive the Electroencephalography (EEG) democratization movement—EEG has been steadily transcending the boundaries of clinical research, making its way into interdisciplinary fields. In Human-Computer Interaction (HCI), EEG is used to measure cognitive workload and infer cognitive processes for building cognition-aware systems. We describe and evaluate our BCIglass prototype where EEG electrodes are embedded in the frame of a mainstream Head-Mounted Display (HMD) to create a skull-peripheral topology. We devised a lab study with 34 participants who completed seven established cognitive tasks. Then, we conducted a pilot field study with one participant to test BCIglass in everyday-life settings. Our findings demonstrate that BCIglass captures EEG activity in a manner comparable to a research-grade EEG-cap system. Our topology infers the cognitive task at hand, and the underlying cognitive process(es) by proxy, with an accuracy of ∼80% and only three electrodes at the skull periphery. Embedding EEG electrodes in lightweight HMDs represents a promising approach in the quest to achieve ubiquitous brain-computer interfacing in real-world settings.
DesignMinds
Enhancing Video-Based Design Ideation with Vision-Language Model and Context-Injected Large Language Model
Intelligent algorithm acts as one of the most important solutions to path planning problem. In order to solve the problems of poor real-time and low accuracy of the heuristic optimization algorithm in 3D path planning, this paper proposes a novel heuristic intelligent algorithm derived from the Beetle Antennae Search (BAS) algorithm. The algorithm proposed in this paper has the advantages of wide search range and high search accuracy, and can still maintain a low time complexity when multiple mechanisms are introduced. This paper combines the BAS algorithm with three non-trivial mechanisms proposed to solve the problems of low search efficiency and poor convergence accuracy in 3D path planning. The algorithm contains three non-trivial mechanisms, including local fast search, aco initial path generation, and searching information orientation. At first, local fast search mechanism presents a specific bounded area and add fast iterative exploration to speed up the convergence of path finding. Then aco initial path generation mechanism is initialized by Ant Colony Optimization (ACO) as a pruning basis. The initialization of the ACO algorithm can quickly obtain an effective path. Using the exploration trend of this path, the algorithm can quickly obtain a locally optimal path. Thirdly, searching information orientation mechanism is employed for BAS algorithm to guarantee the stability of the path finding, thereby avoiding blind exploration and reducing wasted computing resources. Simulation results show that the algorithm proposed in this paper has higher search accuracy and exploration speed than other intelligent algorithms, and improves the adaptability of the path planning algorithms in different environments. The effectiveness of the proposed algorithm is verified in simulation.