The recent emergence of LLM-based code generation models can potentially transform programming education. To pinpoint the current state of research on using LLM-based code generators to support the teaching and learning of programming, we conducted a systematic literature review of 21 papers published since 2018. The review focuses on (1) the teaching and learning practices in programming education that utilized LLM-based code generation models, (2) characteristics and (3) performance indicators of the models, and (4) aspects to consider when utilizing the models in programming education, including the risks and challenges. We found that the most commonly reported uses of LLM-based code generation models for teachers are generating assignments and evaluating student work, while for students, the models function as virtual tutors. We identified that the models exhibit accuracy limitations; generated content often contains minor errors that are manageable by instructors but pose risks for novice learners. Moreover, risks such as academic misconduct and over-reliance on the models are critical when considering integrating these models into education. Overall, LLM-based code generation models can be an assistive tool for both learners and instructors if the risks are mitigated.@en

There is an urgent need for educating the next generation of learners with digital tools and making use of digital practices and skills. Education on computational thinking (CT) is widespread around the world with a dominant focus on K- 12. Recently also higher education has come more to the focus of CTE. However, most of the work on CT in higher education has been focused on teaching and learning programming while less attention has been paid to the underlying skills and competences of CT in different domains. In this article 11 reviews were analyzed to identify constructs being assessed, methods and their characteristics for the delivery of assessment and the context in which the assessment were conducted. The findings indicate that there is certain consensus in the field on what constructs to measure. Last but not least, it was determined from our study that there are often no standards or principles followed for the design of assessment. @en

With the vision to promote CT to a wider group of audiences, this PhD project explores the formative assessment of CT skills in Programming Education to support students to learn CT skills in Higher Education. In this project, we plan to investigate the importance of CT in the context of Higher Education, explore the relationship between CT skills and programming skills, build a model to assess learners' CT skills and develop a computer-assisted assessment system with automated components to enhance students' CT competences in Higher Education. Mixed-method research methodologies will be employed in distinct phases of the project accordingly. A system which allows formative assessment of CT skills will be iteratively designed and constructed throughout the project. The outcome of the project should support the CT learning process, make CT more visible for people from diverse backgrounds and empower them with a CT mindset to embrace the digitalization of society.@en

Our life is surrounded by digital devices. Engineering education is one of the cornerstones in higher education for future generations and computational thinking (CT) is deemed as a core component in various engineering curricula. The Delft University of Technology (TU Delft), is the largest technical university in the Netherlands and computing; computational concepts and activities have been integrated into curriculum for years at TU Delft. However, there is not a comprehensive investigation on integration of CT into Engineering Curriculum, this paper presents a case study of Master’s level engineering curricula investigating: 1) to what extend CT components are integrated; 2) in what way CT is interpreted and integrated in the curriculum; 3) what educational and assessment methods have been used. The results show that CT has been largely integrated into the investigated curriculum mostly with lectures being the educational method and programming assignments as a method for the assessment. Our analysis shows that understanding the context and patterns in problems and solutions was important in different courses and engineering disciplines, indicating possible directions for integration of CT into curriculum. @en

Computational Thinking (CT) is considered a core 21st century digital skill. The aspect of assessment is crucial and knowing what, who, when, how, and where to assess is important for assessment design. In this study, we conducted an umbrella review to gain insights regarding CT assessment in higher education. In total, we analyzed 11 reviews, focusing on: (1) bibliographical and methodological characteristics of the reviews; (2) aspects relevant of assessment design, including a) assessed constructs, b) applied assessment methodologies, and c) assessment contexts. Our findings suggest an increased attention on this topic. However, hardly any reviews reasoned the selection of their review methodology, and most of the reviews did not thoroughly examine existing reviews. Regarding assessment design aspects, most reviews did not confine their scope to higher education; however, findings on interventions and educational settings show commonalities. We identified 120 unique assessed constructs and around 10 types of assessment methods. Though a combined use of distinct assessment methods is suggested in reviews, guidelines for appropriate assessment design are yet to be constructed. Based on the findings, we argue that it is necessary to explore different combinations of assessment design in various contexts to construct assessment guidelines.@en