document

Prioritizing states with action sensitive return in experience replay

Keijzer, Alexander (author)

Experience replay for off-policy reinforcement learning has been shown to improve sample efficiency and stabilize training. However, typical uniformly sampled replay includes many irrelevant samples for the agent to reach good performance. We introduce Action Sensitive Experience Replay (ASER), a method to prioritize samples in the replay buffer...

master thesis 2023

document

Single and Multi-objective Test Cases Prioritization for Self-driving Cars in Virtual Environments

Birchler, Christian (author), Khatiri, Sajad (author), Derakhshanfar, P. (author), Panichella, Sebastiano (author), Panichella, A. (author)

Testing with simulation environments helps to identify critical failing scenarios for self-driving cars (SDCs). Simulation-based tests are safer than in-field operational tests and allow detecting software defects before deployment. However, these tests are very expensive and are too many to be run frequently within limited time constraints...

journal article 2023

document

Prioritization of micropollutants based on removal effort in drinking water purification treatment

Pronk, Tessa E. (author), Fischer, A. (author), van den Berg, Annemijne E.T. (author), Hofman, Roberta C.H.M. (author)

A main focus of water managers with regard to micropollutants is the protection of aquatic ecology. However, micropollutants also have the potential to affect the production of clean drinking water. In this paper, we propose to consider the removal effort when assessing micro-pollutants with an ‘Effort Index’ (EI). Assessments using the EI...

journal article 2023

document

Advancing terrestrial biodiversity monitoring with satellite remote sensing in the context of the Kunming-Montreal global biodiversity framework

Timmermans, J. (author), Daniel Kissling, W. (author)

Satellite remote sensing (SRS) provides huge potential for tracking progress towards conservation targets and goals, but SRS products need to be tailored towards the requirements of ecological users and policymakers. In this viewpoint article, we propose to advance SRS products with a terrestrial biodiversity focus for tracking the goals and...

journal article 2023

document

Improved PER-DDPG based nonparametric modeling of ship dynamics with uncertainty

Zhu, Man (author), Tian, Kang (author), Wen, Yuan Qiao (author), Cao, Ji Ning (author), Huang, L. (author)

This study contributes to addressing the challenge of quickly obtaining an effective and accurate nonparametric model for describing ship maneuvering motion in three degrees of freedom (3-DOF). To achieve this, an intelligent ship dynamics nonparametric modeling method named improved PER-DDPG is proposed. This method leverages the deep...

journal article 2023

document

Automating cyber security advisories: Supervised machine learning for automated decision making

Weegink, Stefan (author)

There is an everlasting struggle for organisations to remediate vulnerabilities in IT systems before being the victim of an exploitation. Organisations try to reduce this struggle by turning to specialized cyber organisations, which use their expertise to recommend resolving a subset of vulnerabilities. Unfortunately, the process of recommending...

master thesis 2022

document

Predictive Test Case Selection and Prioritization at Adyen

Reurink, Andries (author)

The set of regression and integration tests at many modern software companies is huge. It is difficult to run all tests after each code change, so the tests are often run for batches of code changes by different developers, late in the release cycle. This has developers waiting for tests longer than desirable and makes it...

master thesis 2022

document

Process Design for Digital Innovation Portfolio Management: Master thesis report

Srikrishna, Pranathi (author)

This thesis focuses on designing a process for balancing and prioritizing the digital innovation project portfolio of a rental equipment company. The company operates in a traditional industry in which themes like digital transformation and digitalization are new emerging themes that are yet to be accepted by the industry. Therefore, in order to...

master thesis 2022

document

Eight grand challenges for value sensitive design from the 2016 Lorentz workshop

Friedman, Batya (author), Harbers, Maaike (author), Hendry, David G. (author), van den Hoven, M.J. (author), Jonker, C.M. (author), Logler, Nick (author)

In this article, we report on eight grand challenges for value sensitive design, which were developed at a one-week workshop, Value Sensitive Design: Charting the Next Decade, Lorentz Center, Leiden, The Netherlands, November 14–18, 2016. A grand challenge is a substantial problem, opportunity, or question that motives sustained research and...

journal article 2021

document

Why open government data initiatives fail to achieve their objectives: categorizing and prioritizing barriers through a global survey

Zuiderwijk-van Eijk, A.M.G. (author), de Reuver, G.A. (author)

Purpose: Existing overviews of barriers for openly sharing and using government data are often conceptual or based on a limited number of cases. Furthermore, it is unclear what categories of barriers are most obstructive for attaining open data objectives. This paper aims to categorize and prioritize barriers for openly sharing and using...

journal article 2021

document

Agent-based Modelling of Complex Socio-technical Operations at Airports Serving as a Humanitarian Hub

van Liere, Gaël (author)

Airports play a key role during humanitarian relief operations. It is therefore important to connect the humanitarian and aviation disciplines to find possibilities to improve these airport operations when operating during and after a humanitarian disaster. This research provides a methodology on how to model, verify, calibrate and validate the...

master thesis 2020

document

The impacts of climate change on cultural heritage in the Netherlands: A preliminary assessment of exposure

Teruel Cano, D. (author), Fatorić, Sandra (author), Manders, Martijn (author)

Cultural heritage provides a wide range of economic, socio-cultural and environmental benefits for current and future generations. Globally, scientific evidence shows that climate change is adversely affecting diverse tangible and intangible cultural heritage [1; 2]. Yet, in the Netherlands, there is a need for a greater understanding of the...

report 2020

document

Historic preservation priorities for climate adaptation

Seekamp, Erin (author), Fatorić, Sandra (author), McCreary, Allie (author)

Cultural heritage-specific research is scarce within the climate change literature and climate change policy documents, challenging climate adaptation efforts to minimize adverse impacts on cultural heritage. Engaging and assessing diverse stakeholders' values and integrating those with evidence-based knowledge is critical for timely,...

journal article 2020

document

Adaptive asset management for flood protection: The FAIR framework in action

Vonk, Bart (author), Klerk, W.J. (author), Fröhle, Peter (author), Gersonius, Berry (author), Heijer, Frank Den (author), Jordan, Philipp (author), Ciocan, Ulf Radu (author), Rijke, Jeroen (author), Sayers, Paul (author), Ashley, Richard (author)

Uncertainties about climate change consequences, changing societal requirements and system complexity require flood protection asset managers to continuously evaluate their asset management policies and practice to manage risk and improve the resilience of their assets. However, there are many challenges in doing this, with asset operators...

journal article 2020

document

Getting the perpetrator incorporated and prioritized in homicide investigations: The development and evaluation of a case-specific element library (c-sel)

Sutmuller, A.D. (author), Den Hengst, Marielle (author), Barros, Ana Isabel (author), van Gelder, P.H.A.J.M. (author)

Homicide investigators in the digital era have access to an increasing amount of data and the processing of all persons of interest and pieces of evidence has become nearly impossible. This paper describes the development and evaluation of a case-specific element library (C-SEL) that can be used to incorporate and prioritize persons of...

journal article 2020

document

Short-term forecasting of non-stationary time series using multiple feature selection methods

Özyar, Muhammed Imran (author)

Time series forecasting has been proved to be relatively easier for stationary time series, compared to non-stationary time series. This research proposes a method to partially omit the non-stationarity of the data using prioritized sampling. Using multiple feature selection methods in combination with a random forest regressor (RFR), we aim to...

bachelor thesis 2019

document

Prioritized Experience Replay based on the Wasserstein Metric in Deep Reinforcement Learning: The regularizing effect of modelling return distributions

Greevink, Thijs (author)

This thesis tests the hypothesis that distributional deep reinforcement learning (RL) algorithms get an increased performance over expectation based deep RL because of the regularizing effect of fitting a more complex model. This hypothesis was tested by comparing two variations of the distributional QR-DQN algorithm combined with prioritized...

master thesis 2019

document

Knowledge co-production in climate adaptation planning of archaeological sites

Fatorić, Sandra (author)

Climate adaptation is a process for minimizing the risks of damage or loss to coastal archaeological sites. Yet, adaptation requires identifying and prioritizing among the diverse aspects of a site’s significance, as not all sites can be simultaneously adapted due to financial and human capital constraints. Developing a measurement framework...

journal article 2019

document

Self-determined distribution of local energy resources for ensuring power supply during outages

Causevic, S. (author), Warnier, Martijn (author), Brazier, F.M. (author)

Ensuring access to reliable and sustainable power supply is becoming more and more challenging due to a combination of factors such as more frequent power grid outages caused by extreme weather events, the large-scale introduction of renewable energy resources that increases the complexity of the power system, but also aging infrastructure,...

journal article 2019

document

Airport pavement management decision making: A prioritization tool to select pavement sections requiring M&R treatments

Laguado Lancheros, Juan (author)

An increase in air traffic demand, aging pavement infrastructure, and limited funds make pavement management decision making a difficult process. Pavement management systems (PMS) are essential for pavement management. PAVER, the most common airport pavement management system (APMS) assists pavement managers by identifying the surface condition...

master thesis 2018