Background: In autumn 2023, COVID-19 vaccination invitations in the Netherlands shifted from self-scheduling to pre-booked appointments for selected groups. While defaulting to pre-booked slots may increase uptake, potential rebound effects remain unclear. We examine preferences between appointment types, their effect on vaccination intentions, and whether effects are different for individuals hesitant about this vaccination round. Methods: A mixed-methods approach was used to assess vaccination intentions for three groups (<60 with influenza vaccination indication, 60–69 and 70+ years) eligible for pre-booked appointments. In a two-phase formative evaluation study, we examined attitudes around pre-booked appointments in 15 interviews (phase 1) and experimentally tested (phase 2) perceived burden of pre-booked appointments vs self-scheduled appointments and their effect on vaccination intentions in a representative online panel (n = 1.886) and those who experience hesitancy about this vaccination. Findings: Interviews (phase 1) showed that pre-booked appointments are seen as presumptuous or inconvenient by some, but also as a useful aid in support of vaccination uptake, sometimes by the same people. Participants in the experiment (phase 2) indicated to perceive self-scheduling as less burdensome (Coefficient = −0.23) but this perception did not translate to differences in vaccination intentions (Adjusted OR = 1.11) Similar results were observed in the hesitant subgroup (Coefficient = −0.25; Adjusted OR = 0.88). Discussion: In our study pre-booked appointments do not change COVID-19 vaccination intentions. As pre-booked appointments evoked negative and positive sentiments and self-scheduling was found easier and more pleasant, we conservatively recommend its implementation for older adults who received their COVID-19 vaccination the previous year.

The authors regret an unfortunate coding error in the optimal portfolio analysis presented in Table 3 of the published paper. This was discovered while performing new analyses on the data used in this study for another study. In the optimal portfolio analysis, the estimates of the multiple discrete-continuous extreme value (MDCEV) choice model were used to calculate the expected utility of each feasible portfolio (i.e., every possible combination of policy alternatives given the budget constraint, with attribute levels averaged over the sample). The expected utility was calculated correctly, but when preparing Table 3 for the paper, the portfolios were ranked incorrectly (i.e., by portfolio costs instead of by their expected utility). As a result, the top ten portfolios presented in Table 3 in the paper were not in fact the top ten portfolios in terms of expected utility, but in terms of implied additional expenditure on long-term care. In this corrigendum, we present the correct Table 3 and discuss these findings. The authors wish to emphasize that all the other analyses and results, i.e., the descriptive results (Figures 2, 3, S1 – S3, S8 – S14), the MDCEV estimates (Tables 2, S3, and S5), and the Latent Class Cluster Analysis (Tables 4, 5, and S2 and Figures S4 – S7) stay the same. Moreover, the abstract and highlights, and thereby the main message of the paper, remain unchanged. After ranking the portfolios by their expected utility, as originally intended, Table 3 reads as follows: [Table presented] The correct top ten portfolios indicate a stronger preference for the institutional and home-based formal care policy alternatives (i.e., increasing capacity of nursing homes, nursing care and social care at home, and introducing care homes), relative to those previously presented. At the same time, they indicate a lower preference for providing respite care to informal caregivers and introducing compulsory social service for young adults. Also, increasing the use of supportive care technologies is less preferred, but remains included in most of the top-ranked portfolios. This implies that portfolios involving a moderate increase in formal care options were generally preferred. The results reinforce the paper's conclusion that respondents seemed to prefer distributing public resources towards multiple policy alternatives over investing substantially in one or two particular policy alternatives. Finally, while the ten highest-ranked portfolios do not exhaust the budget constraint entirely, like in Table 3 of the paper, most portfolios still imply an expenditure increase close to exhausting the budget constraint. Based on the above, the subsection ‘Optimal portfolio composition’ of the Results section in the paper should be as follows: “Table 3 shows the ten portfolios with the highest expected utility. For example, portfolio 10 includes an increase in the capacity of nursing homes and nursing care at home by 10,000 places each, the introduction of care homes with 20,000 places (i.e., two times 10,000 places), an increase in the capacity of social care at home by 10,000 places, and the provision of respite care to informal caregivers for a maximum of three months, while increase in use of supportive care technologies and compulsory social service for young adults are not selected. Several patterns can be observed from the top ten portfolios. For example, each of these portfolios included at least one of the policy alternatives regarding nursing care and at least one regarding social care. Besides, all portfolios contained five or six of the seven policy alternatives. Additionally, both institutional care alternatives and both home-based care alternatives were included in all of the ten highest ranked portfolios, with the increased use of supportive care technologies also included at least once in seven out of the ten highest-ranked portfolios. All ten highest-ranked portfolios resulted in substantial expenditure increases, with eight of the ten portfolios nearly exhausting the resource constraint (i.e., > €90 euros per adult per month).” The sentences related to this part of the analysis in the Conclusion and Discussion section of the paper should be as follows: “In the optimal portfolios, increased capacity of institutional and home-based care and use of supportive care technologies were often included.” “Most of the highest-ranked portfolios nearly exhausted the budget constraint.” “The policy alternatives regarding the increased capacity of institutional and home-based care and use of supportive care technologies are particularly encouraged, conditional on the policies’ effectiveness and efficiency in practice. While various forms of institutional and home-based care are more commonly adopted and arguably less challenging to implement, the use of supportive care technologies in long-term care remains relatively limited.” Finally, the optimal portfolio composition in the sensitivity analysis also changes. It is similar to what is presented in the corrected Table 3 above, but with portfolios 6 and 7 and portfolios 8 and 9, respectively, reversed. The authors would like to apologise for any inconvenience caused.

This study examines to what extent job evaluation systems align with public views on fair pay. Using a Participatory Value Evaluation, over 3,700 Dutch citizens distributed extra salary among various jobs and explained their choices. The arguments were compared to criteria used in job evaluation systems. The dimensions prioritized by participants, such as required education, job complexity, and working conditions, are already well represented in current formal job evaluation systems. However, participants also stressed aspects often absent from such systems, including a job’s societal contribution and labour market scarcity. While job evaluation systems remain broadly consistent with public reasoning, we recommend initiating broader public and institutional discussions on the evolving values that underpin fair compensation.

The goals of transportation planning have been broadened in the last decades. Scholars increasingly argue to include goals such as reducing social exclusion and providing a minimal level of accessibility to all in the appraisal of transport policies. We conducted a Participatory Value Evaluation (PVE) with 6,784 Dutch citizens to investigate how different segments of the Dutch population prioritize these goals against other goals of transportation planning. In the PVE, participants indicated for 14 accessibility and mobility goals whether they thought a goal should receive more attention or less attention, subject to a budget constraint. We find that respondents recommend the government to pay the most attention to goals related to providing a basic level of accessibility for everyone such as ‘being able to access important facilities easily’, ‘being able to reach places affordably’ and ‘accessibility for people with disabilities’. Participants think that safeguarding these accessibility standards should be a core government task. They particularly prioritize improving accessibility to healthcare facilities such as hospitals and general practitioners. Participants think that the government should give relatively little attention to other goals such as ‘reducing travel times’, ‘being able to access different jobs’, ‘more pleasant and comfortable travel’ and ‘improving connections to other countries’. Many participants do not think that achieving such goals should be a core task of the government. They believe that the responsibility for achieving these goals lies more with citizens themselves, or with the market.

Many countries face rapidly ageing populations, resulting in a rising demand for long-term care (LTC) for older people and an increased pressure on LTC systems. In responding to this development, governments face challenging trade-offs between different policy measures and their effects. To inform allocation decisions, this study elicited citizens’ policy preferences for LTC for older people in the Netherlands in 2040. We conducted a constrained portfolio choice experiment, in which 997 respondents composed a portfolio of their preferred policies, subject to a budget constraint, while being presented with the expected effects of their choices. Choices were analysed using a Multiple Discrete Continuous Extreme Value (MDCEV) choice model and a Latent Class Cluster Analysis (LCCA). The results suggest a preference for distributing resources towards multiple policies, including both nursing and social care, over investing heavily in one or two particularly. Also, most respondents chose portfolios constituting a substantial public expenditure increase, suggesting a widespread willingness to accept a tax increase to allow for this. Preferences were particularly heterogeneous with respect to expenditure levels and the adoption of supportive care technologies and compulsory social service for young adults. Policymakers may use these results to support the selection of a portfolio of LTC policies that aligns with public preferences.

Many countries use Cost-Benefit Analysis (CBA) as an ex-ante evaluation method to support transport decision-making. A critique on CBA is that it favours policies which produce easy to monetize impacts (e.g. travel time savings), whereas it disfavours policies which produce difficult to monetize impacts (e.g. minimum level of accessibility for people with a disability and environmental effects). Public willingness to pay (WTP) experiments have been introduced to value difficult to monetize policy impacts. This paper investigates how citizens of the Transport Authority Amsterdam value nine social impacts of transport policies through five Public WTP discrete choice experiments. In the experiments, respondents were asked to choose between transport policies, trading of social impacts against a uniform tax increase. We show that participants particularly value that people can reach key facilities within 15 min and assigned a relatively low value to preventing delays. This suggests that citizens prioritize accessibility over mobility. We also observe that participants assign a significant value to all the nine social impacts and identify Public WTP metrics for all the impacts. This suggests that the Public WTP approach has to potential to resolve the critique on CBA that not all impacts can be monetized.

Objective: In many countries, the incidence of skin cancer is growing rapidly, resulting in a substantive health and economic burden. While the wide range of available skin cancer prevention policies may have large individual and societal benefits, many countries still lack a policy strategy, and little is known about public preferences for collective prevention policy measures. We elicited these preferences using a discrete choice experiment (DCE) in Austria, the Netherlands, and Spain to inform policy action. Methods: Respondents were asked to choose twelve times between two packages of different prevention policies. Each package was described by its estimated effectiveness and costs. Before and after the DCE, respondents were asked for their support for any policy action. We quota-sampled adult citizens in each of the countries from an online panel (N = 2,442). The choice data were analyzed using multinomial logit (MNL) and mixed multinomial logit (MMNL) models. Results: Almost all attributes significantly influenced respondents’ choices, with the tax attribute being most influential in each country. Among the six policy measures, information campaigns and a price reduction of sunscreen were the most preferred policy measures, and the prohibition of solar bed sales and solaria the least preferred. Preference structures were largely consistent across the countries. Finally, most respondents supported policy action, particularly after the DCE. Conclusions: Citizens in the three countries recommended their governments to take policy action against the increasing incidence of skin cancer. The results provide policymakers with directions for publicly supported policy action, which should be complemented with additional information on preference heterogeneity, citizens' argumentation, and policies’ relative (cost-)effectiveness. The suggestion that preferences for policy action adapted over the course of completing the DCE survey should be further examined.

This study explores perceived accessibility specific to air transportation in the Dutch context through a focus group study. Five focus group sessions were held with a total of 24 participants with air travel experience within the past five years. Online focus groups were held during the period that the COVID-19 pandemic travel restrictions were in effect, specifically around 12 months after the travel restrictions were implemented globally. In terms of the importance of activities accessible by flight, we observe that travelers particularly attach importance to visiting family and relatives, while the importance attached to the business and recreational activities accessible by flight varies among participants. As far as the transport component of accessibility is concerned, we find that, in addition to conventional variables in air transportation research, such as cost and travel times, unconventional variables such as uncertainty during flight schedule disruptions or the mood of staff and other passengers contribute to perceived accessibility by air transportation. Based on the results, we further discuss characteristics specific to perceived accessibility by air transportation, directions for further qualitative and quantitative research regarding perceived accessibility by air transportation, and implications for policy and planning.

The importance of public participation in transport planning continues to increase. Participatory Value Evaluation (PVE) is a relatively new instrument to involve citizens in transport planning. In a PVE, citizens are put into the shoes of a policymaker and see which polices are considered, the impacts of the policies and the constraint that the policymaker faces. Subsequently, citizens are asked to advise the policymaker on which policy options should be chosen and why. So far PVE has been successfully applied in contexts in which citizens and stakeholders broadly agreed on the pursued policy goals. It is, however, unclear whether PVE is equally valuable in contexts in which stakeholders have conflicting interests. This paper investigates whether deploying PVE in an institutionalized transport conflict results in similar benefits and costs as in contexts where stakeholders pursue the same goals. We studied a PVE application in which 2466 participants provided recommendations to the government about decision-making regarding Schiphol Airport, the Netherlands. Stakeholders were involved in many phases of and decisions on the PVE design process. The aim of this research was twofold. First, to establish whether the benefits of applying PVE in an institutionalized transport conflict outweigh the costs. Second, to develop an instrument to assess the face validity of PVE as experienced by participants. We find that PVE can provide similar benefits in the context of an institutionalized conflict compared to cases in which such a conflict was absent. Citizens participated who normally do not participate and the PVE produced useful outcomes for decision-making. However, a notable difference is that the design phase of the PVE involved several feedback rounds which made it much more time-intensive than other cases. Hence, the benefit that PVE requires low time investment of civil servants that emerged in other studies was not applicable when applying PVE to an institutionalized transport conflict setting. Furthermore, stakeholders could not agree on various design choices of the PVE. To satisfy the diverging requests of stakeholders a very lengthy PVE was constructed. As a result, the satisfaction among participants about its face validity was relatively low.

Several studies examined what drives citizens’ support for COVID-19 measures, but no works have addressed how the effects of these drivers are distributed at the individual level. Yet, if significant differences in support are present but not accounted for, policymakers’ interpretations could lead to misleading decisions. In this study, we use XGBoost, a supervised machine learning model, combined with SHAP (Shapley Additive eXplanations) to identify the factors associated with differences in policy support for COVID-19 measures and how such differences are distributed across different citizens and measures. We use secondary data from a Participatory Value Evaluation (PVE) experiment, in which 1,888 Dutch citizens answered which COVID-19 measures should be imposed under four risk scenarios. We identified considerable heterogeneity in citizens’ support for different COVID-19 measures regarding different age groups, the weight given to citizens’ opinions and the perceived risk of getting sick of COVID-19. Data analysis methods employed in previous studies do not reveal such heterogeneity of policy support. Policymakers can use our results to tailor measures further to increase support for specific citizens/measures.

Background: The outbreak of COVID-19 was followed by an unprecedented package of measures to protect public health. Over 150 countries mandated school closures to reduce the risk of transmission. Decisions on whether to close schools involve trade-offs between important effects on public health, learning outcomes, well-being of children, productivity of parents. Objectives: Investigate Peruvian citizens’ preferences for schools opening during a public-health crisis such as the COVID-19 pandemic in two scenarios: (i) when the threat from COVID-19 is low and schools are open; and, (ii) when the threat from COVID-19 is high and schools are closed. Methods: We conducted a Participatory Value Evaluation (PVE) from 22 September to 17 October 2022, on which 2007 respondents assessed which policy measures to implement in the two scenarios. (i) In Scenario 1 “Schools are open”, children go to school, teachers and parents go to their jobs, but children still experience learning deficits from previous school closures. (ii) In Scenario 2 “Schools are closed”, children cannot go to school and do not receive any formal teaching, leading to learning losses; many teachers must change careers; and, many parents have to stay at home to take care of their children and lose income. Respondents were shown a range of policy measures in each of the scenarios and received information about the effects of each measure on public health, children's well-being and learning loss. Results: We found that most respondents in Scenario 1 preferred mandatory vaccination for teachers and quarantine measures. In Scenario 2 we found that most respondents were positive towards reopening school policies. In both Scenarios respondents prioritized mandatory vaccination and quarantine measures over other mitigation measures. In Scenario 2, most respondents from the Highland region selected opening schools with 100% on-location teaching while hybrid teaching was mostly selected in the Coast region. Most respondents (82%) evaluated PVE as a good method to involve citizens in policy decision-making. Conclusions: Policies that focus on prevention (e.g. mandatory vaccination for teachers and quarantine measures) can count on substantial support in a scenario when schools are open. The strong preference for opening schools with a noticeable difference in the way classes are provided (e.g. teaching on location most preferred by respondents from the Highlands and hybrid teaching by respondents from the Coast) show the importance of introducing differentiated strategies among regions.

The need for engaging citizens in climate policymaking is increasingly recognised. Despite indications that the form of expert involvement can strongly influence participatory processes, this remains scarcely researched. We analysed two unique and contrasting cases of citizen engagement in national climate mitigation policy: (1) the Irish Citizens’ Assembly (ICA), the first national climate assembly involving live expert presentations and face-to-face deliberations; and (2) the Participatory Value Evaluation (PVE) on Dutch climate policymaking, where more than 10,000 citizens compared policy options in an online environment based on expert-based information on policy effects. Taking a dramaturgical approach, we found that the opening up and closing down of policy options and perspectives was influenced by the setting, staging and scripting of expertise. Apart from providing information on policy options, experts had significant roles in design choices and formulating recommendations, which shaped citizens’ deliberations and policy advice. In deliberative processes, citizens’ deliberations can be further influenced by putting experts in a privileged spot and emphasising their authority, whereas in the setting of an online tool, experts’ design choices may be masked by the fact-like presentation of expertise. Future research should further investigate the role of experts and expertise across a wider range of practices. Nevertheless, we conclude that the high degree of required technical knowledge in climate mitigation policy naturally implies strong expert involvement, which concomitantly steers the results. Alternatively, we may search to enhance citizens’ engagement in guiding climate policymakers by focusing on citizens’ normative perspectives.