S. Paraskevopoulos
Please Note
6 records found
1
Addressing Drinking Water Contamination
A Case Study Comparing Traditional with Model-Based Approaches
Rapid and effective decision-making is crucial during drinking water contamination events to ensure public safety. This paper examines a case study where a water utility, responding to customer complaints, suspected wastewater contamination in its network. We compare the traditional expert judgement approach to a model-based approach using the PathoINVEST tool. The tool performs simulations of contamination events informed by sensor measurements, identifies contamination sources using sampling results, and suggests optimal valve closures for mitigation. Our findings show that the model-based approach significantly enhances response efficiency and accuracy. It identified the contamination source with four samples in 1.3 h, compared to 11 samples in 3.7 h for the traditional approach, and resulted in a lower infection risk (12% versus 20%) at the time of source identification. Regarding valve closure, the model-based approach performed better, resulting in a 3%-point reduction in infection risk compared to the traditional approach. Modeling uncertainty is addressed by considering valve settings uncertainty; despite a 0.7% discrepancy in valve settings compared to the model, the tool accurately pinpointed the contamination vicinity 75% of the time. These findings support the claim that integrating modeling and sensor tools into emergency response protocols for drinking water contamination events can improve early identification and mitigation, potentially safeguarding public health in urban water supply systems.
During contamination events in the DWDN, water utilities need to act quickly, make informed decisions, assess the threat, and effectively mitigate the event. The central objective of the study of this thesis was to generate knowledge to help address the growing challenge of waterborne pathogen contamination in DWDNs and develop applications that can enhance decision-making and immediate actions in such emergencies. Tools and methodologies were developed and evaluated focusing on two main pillars. The first pillar involves understanding the event based on historical knowledge. Innovative approaches were developed and assessed for Artificial Intelligence-based information extraction and question-answering using scientific publications, enabling rapid access to up-to-date pathogen characteristics, historical information on contamination events, and control actions. The second pillar focuses on predicting and managing the specific contamination event in real-time. Advanced modeling tools were created to simulate contamination events in DWDNs, providing realistic representations of hydraulics and water quality dynamics, predicted health impacts, and support for real-time decision-making during emergencies.
Chapter 2 describes the development of an Artificial Intelligence (AI)-based model that extracts specific pathogen information from the scientific literature. By leveraging Natural Language Processing (NLP) and Deep Learning (DL) techniques, the study evaluated the feasibility and performance of an Information Extraction model to extract both qualitative and quantitative information from scientific publications about the waterborne pathogen Legionella. For the development of the model, a combination of supervised and rule-based techniques was adopted. The evaluation metrics showed a satisfactory performance for extraction of both qualitative and quantitative information with an overall F-score of 85% and 95% for the supervised and rule-based technique respectively. The model was also compared with a human extraction, returning similar results and indicating that the extracted information is of high quality. The results showed that the model can be used to rapidly extract critical information from text documents and be a useful tool for water utilities, enabling faster and more informed decision-making during the early stages of contamination.
Chapter 3 systematically assesses the performance of various open-source Large Language Models (LLM), including Llama 2, Mistral, and Gemma (and their variations) in a question-answering task related to pathogen contamination events of drinking water. The evaluation metrics included Precision, Recall, F1 score, Automated Accuracy, and Empty Score. The model with the highest performance on a set of 23 questions using 188 scientific publications was then manually evaluated by a human (Human Evaluation). The results showed that all models performed reasonably well with an average F1 score ranging from 81% to 87%. After considering all the evaluation metrics, the Llama 2 model was the most reliable model with an average Automated Accuracy of 86%. However, the hallucination effect of Llama 2 was evident. The Gemma model had a lower Automated Accuracy score but was less prone to hallucination. The Human Evaluation showed that the Llama 2 model delivered correct answers when the questions were clear and straightforward. However, when the question required further interpretation, the model often struggled. Overall, the study demonstrated that the use of LLMs in automated information extraction tasks show great potential for time-critical applications, such as processing large volumes of (historical) data in real-time thereby making it feasible to make historical information available in near rea-time in case of emergencies.
Building on the response to a pathogen contamination event in the DWDN, Chapter 4 presents the BeWaRE benchmark testbed, a comprehensive model. This testbed went beyond the state-of-the art and integrated all current relevant knowledge on pathogen transport and fate, bulk and wall chlorine decay, fast and slow chlorine reactions with TOC, TOC degradation, stochastic water demands, hydraulic uncertainty, and individual consumption patterns to calculate pathogen exposure and infection risk following the steps of Quantitative Microbial Risk Assessment (QMRA). A large wastewater contamination in different locations in a chlorinated and non-chlorinated network was simulated using three pathogens: Campylobacter, enterovirus, and Cryptosporidium. The results of this study showed that in non-chlorinated DWDNs, the modeled wastewater contamination event led to 11-46% infection risk in the total population, depending on the contamination location, but irrespective of the selected pathogen (due to the high pathogen concentration). On the other hand, in chlorinated DWDNs, the same scenarios resulted in lower infection risk for the pathogens that are susceptible to chlorine; 0.78-2.1 % for Campylobacter and 7.8-26.6 % for enterovirus. Moreover, the enterovirus infection risk was higher, despite the concentrations in the contamination source being lower, due to the lower susceptibility to chlorine than Campylobacter. While chlorination aids mitigation, large contaminations can still lead to infections due to chlorine resistance (for Cryptosporidium) and chlorine depletion at the contamination point. Finally, the varying levels of pathogen susceptibility to chlorine, the contamination location and duration, influenced the infection risk, while the response window to reduce the health impact was short; in these scenarios 5-10 hours post-contamination. The study provided a novel approach to assessing health risks, offering critical insights for water utilities to optimize their response during emergencies.
Chapter 5 further explores the added value of using modeling tools to support decision-making during emergencies in the DWDN. This was demonstrated through PathoINVEST, an analytical tool that utilizes the BeWaRE benchmark methodology, which was presented in the previous Chapter, to support water utilities in modeling contamination events in the DWDN. A case study was conducted with the aim of comparing a traditional approach (representing the status quo of current practices of water utilities) with a model-based approach (use of real-time modeling tools) during an emergency response to a contamination event in the DWDN. The model-based approach was shown to be more efficient than the traditional approach in identifying the source of contamination (1.3 versus 3.7 hours), requiring fewer samples (4 versus 11) and resulting in lower infection risk by the time the source was identified (12% versus 20%) in this case study. Moreover, the model-based approach was more effective in finding the best valves to close in the network (as mitigation measures) since it resulted in a 3%-point infection risk reduction. However, some actions taken in the traditional approach, such as the rapid closure of valves (cutting the network in half and thus limiting further spreading) before the contamination source was identified, were critical in mitigating the contamination. Another key finding was the importance of having an up-to-date overview of valve settings in the DWDN schematization to provide reliable results on source identification since any discrepancies between the actual network and the model can lead to inaccurate infection risk estimates when using modeling tools to support decision-making. Overall, this case study showed that integrating modeling tools in the current practices of water utilities provides a robust framework for improving water contamination management and decision-making processes, thus safeguarding public health during emergencies.
A concluding viewpoint is offered in Chapter 6, which considers whether the initial research questions from Chapter 1 were successfully answered. The implications of this research for water utilities are examined, providing information on how the proposed methodologies can be (and have been) used in real-world scenarios, facilitating a faster decision-making and contributing to effective mitigation of emergencies. Finally, the perspectives and future research are discussed, emphasizing the role of AI and the advancements in modeling tools. AI has shown significant potential in enhancing situational awareness and rapid information extraction during emergencies. Water utilities should explore the integration of AI into their standard operating procedures to further enhance emergency responses and routine management. Regarding the use of modeling tools during emergencies, future research should address key gaps, such as the complex dynamics when wastewater interacts with chlorine, the competition between chlorine-reducing agents, and the validity of hydraulic modeling assumptions such as perfect mixing. Accounting for cumulative health risks (multiple pathogens) and refining dose-response models to differentiate between infection and illness probabilities can provide insights for effectively managing risks to vulnerable populations. Moreover, the incorporation of metrics like Disability-Adjusted Life Years (DALYs) into modeling efforts could enable better communication of health impacts and evaluation of mitigation strategies. Finally, Digital Twins and real-time microbial sensors are identified as transformative technologies that can provide real-time insights into network dynamics. These advancements can shift water utility management from reactive approaches to proactive, data-driven strategies, significantly enhancing public health protection, operational efficiency, and resilience.
...
During contamination events in the DWDN, water utilities need to act quickly, make informed decisions, assess the threat, and effectively mitigate the event. The central objective of the study of this thesis was to generate knowledge to help address the growing challenge of waterborne pathogen contamination in DWDNs and develop applications that can enhance decision-making and immediate actions in such emergencies. Tools and methodologies were developed and evaluated focusing on two main pillars. The first pillar involves understanding the event based on historical knowledge. Innovative approaches were developed and assessed for Artificial Intelligence-based information extraction and question-answering using scientific publications, enabling rapid access to up-to-date pathogen characteristics, historical information on contamination events, and control actions. The second pillar focuses on predicting and managing the specific contamination event in real-time. Advanced modeling tools were created to simulate contamination events in DWDNs, providing realistic representations of hydraulics and water quality dynamics, predicted health impacts, and support for real-time decision-making during emergencies.
Chapter 2 describes the development of an Artificial Intelligence (AI)-based model that extracts specific pathogen information from the scientific literature. By leveraging Natural Language Processing (NLP) and Deep Learning (DL) techniques, the study evaluated the feasibility and performance of an Information Extraction model to extract both qualitative and quantitative information from scientific publications about the waterborne pathogen Legionella. For the development of the model, a combination of supervised and rule-based techniques was adopted. The evaluation metrics showed a satisfactory performance for extraction of both qualitative and quantitative information with an overall F-score of 85% and 95% for the supervised and rule-based technique respectively. The model was also compared with a human extraction, returning similar results and indicating that the extracted information is of high quality. The results showed that the model can be used to rapidly extract critical information from text documents and be a useful tool for water utilities, enabling faster and more informed decision-making during the early stages of contamination.
Chapter 3 systematically assesses the performance of various open-source Large Language Models (LLM), including Llama 2, Mistral, and Gemma (and their variations) in a question-answering task related to pathogen contamination events of drinking water. The evaluation metrics included Precision, Recall, F1 score, Automated Accuracy, and Empty Score. The model with the highest performance on a set of 23 questions using 188 scientific publications was then manually evaluated by a human (Human Evaluation). The results showed that all models performed reasonably well with an average F1 score ranging from 81% to 87%. After considering all the evaluation metrics, the Llama 2 model was the most reliable model with an average Automated Accuracy of 86%. However, the hallucination effect of Llama 2 was evident. The Gemma model had a lower Automated Accuracy score but was less prone to hallucination. The Human Evaluation showed that the Llama 2 model delivered correct answers when the questions were clear and straightforward. However, when the question required further interpretation, the model often struggled. Overall, the study demonstrated that the use of LLMs in automated information extraction tasks show great potential for time-critical applications, such as processing large volumes of (historical) data in real-time thereby making it feasible to make historical information available in near rea-time in case of emergencies.
Building on the response to a pathogen contamination event in the DWDN, Chapter 4 presents the BeWaRE benchmark testbed, a comprehensive model. This testbed went beyond the state-of-the art and integrated all current relevant knowledge on pathogen transport and fate, bulk and wall chlorine decay, fast and slow chlorine reactions with TOC, TOC degradation, stochastic water demands, hydraulic uncertainty, and individual consumption patterns to calculate pathogen exposure and infection risk following the steps of Quantitative Microbial Risk Assessment (QMRA). A large wastewater contamination in different locations in a chlorinated and non-chlorinated network was simulated using three pathogens: Campylobacter, enterovirus, and Cryptosporidium. The results of this study showed that in non-chlorinated DWDNs, the modeled wastewater contamination event led to 11-46% infection risk in the total population, depending on the contamination location, but irrespective of the selected pathogen (due to the high pathogen concentration). On the other hand, in chlorinated DWDNs, the same scenarios resulted in lower infection risk for the pathogens that are susceptible to chlorine; 0.78-2.1 % for Campylobacter and 7.8-26.6 % for enterovirus. Moreover, the enterovirus infection risk was higher, despite the concentrations in the contamination source being lower, due to the lower susceptibility to chlorine than Campylobacter. While chlorination aids mitigation, large contaminations can still lead to infections due to chlorine resistance (for Cryptosporidium) and chlorine depletion at the contamination point. Finally, the varying levels of pathogen susceptibility to chlorine, the contamination location and duration, influenced the infection risk, while the response window to reduce the health impact was short; in these scenarios 5-10 hours post-contamination. The study provided a novel approach to assessing health risks, offering critical insights for water utilities to optimize their response during emergencies.
Chapter 5 further explores the added value of using modeling tools to support decision-making during emergencies in the DWDN. This was demonstrated through PathoINVEST, an analytical tool that utilizes the BeWaRE benchmark methodology, which was presented in the previous Chapter, to support water utilities in modeling contamination events in the DWDN. A case study was conducted with the aim of comparing a traditional approach (representing the status quo of current practices of water utilities) with a model-based approach (use of real-time modeling tools) during an emergency response to a contamination event in the DWDN. The model-based approach was shown to be more efficient than the traditional approach in identifying the source of contamination (1.3 versus 3.7 hours), requiring fewer samples (4 versus 11) and resulting in lower infection risk by the time the source was identified (12% versus 20%) in this case study. Moreover, the model-based approach was more effective in finding the best valves to close in the network (as mitigation measures) since it resulted in a 3%-point infection risk reduction. However, some actions taken in the traditional approach, such as the rapid closure of valves (cutting the network in half and thus limiting further spreading) before the contamination source was identified, were critical in mitigating the contamination. Another key finding was the importance of having an up-to-date overview of valve settings in the DWDN schematization to provide reliable results on source identification since any discrepancies between the actual network and the model can lead to inaccurate infection risk estimates when using modeling tools to support decision-making. Overall, this case study showed that integrating modeling tools in the current practices of water utilities provides a robust framework for improving water contamination management and decision-making processes, thus safeguarding public health during emergencies.
A concluding viewpoint is offered in Chapter 6, which considers whether the initial research questions from Chapter 1 were successfully answered. The implications of this research for water utilities are examined, providing information on how the proposed methodologies can be (and have been) used in real-world scenarios, facilitating a faster decision-making and contributing to effective mitigation of emergencies. Finally, the perspectives and future research are discussed, emphasizing the role of AI and the advancements in modeling tools. AI has shown significant potential in enhancing situational awareness and rapid information extraction during emergencies. Water utilities should explore the integration of AI into their standard operating procedures to further enhance emergency responses and routine management. Regarding the use of modeling tools during emergencies, future research should address key gaps, such as the complex dynamics when wastewater interacts with chlorine, the competition between chlorine-reducing agents, and the validity of hydraulic modeling assumptions such as perfect mixing. Accounting for cumulative health risks (multiple pathogens) and refining dose-response models to differentiate between infection and illness probabilities can provide insights for effectively managing risks to vulnerable populations. Moreover, the incorporation of metrics like Disability-Adjusted Life Years (DALYs) into modeling efforts could enable better communication of health impacts and evaluation of mitigation strategies. Finally, Digital Twins and real-time microbial sensors are identified as transformative technologies that can provide real-time insights into network dynamics. These advancements can shift water utility management from reactive approaches to proactive, data-driven strategies, significantly enhancing public health protection, operational efficiency, and resilience.
In a desktop exercise, a water utility’s emergency response to suspected wastewater contamination in a drinking water network was compared with a model-based approach using PathoINVEST. This tool simulates contamination scenarios and assists with locating the source of contamination using sampling results. The sampling procedure used a portable sensor that offers rapid (20 min time-to-result) screening of fecal contamination. Preliminary results show that the model-based approach is able to find the contamination source faster and with fewer samples than current practices. Integrating modeling and rapid sensor tools in emergency responses improves decision-making and public health protection in drinking water networks.
Pathogen intrusion in drinking water systems can pose severe health risks. To better prepare in planning and responding to such events, computational models that capture the intrusion and health impact dynamics are needed. This study presents a novel benchmark testbed that integrates current knowledge on pathogen transport and fate in chlorinated systems and can assess infection risk from contamination events. The model considers organic matter degradation, chlorine decay mechanisms, pathogen inactivation kinetics, as well as stochastic water demands. We studied modeling of wastewater intrusion events that can occur anywhere within a chlorinated and non-chlorinated network. We applied the Quantitative Microbial Risk Assessment framework focusing on three pathogens: enterovirus, Campylobacter, and Cryptosporidium, and their respective dose-response models. Synthetic household-level water demand time series were used to model the individual water consumption timing and calculate the infection risk (exposure via ingestion). Model outcomes indicate that while chlorination aids mitigation, larger contaminations can still lead to infections due to chlorine resistance (for Cryptosporidium) and chlorine depletion at the contamination point. In our example scenarios, chlorine-susceptible pathogens infected 0.78–26.6% of the downstream population, while chlorine-resistant ones infected the entire downstream population. Enterovirus infection risk is higher, despite the concentrations in the contamination source being lower, due to the lower susceptibility to chlorine than Campylobacter. In non-chlorinated networks, the modeled wastewater contamination events led to 11–46% infection risk in the total population, depending on the contamination location. Hydraulic uncertainty had a limited influence on infection risk. Furthermore, Campylobacter's infection risk is more sensitive to the initial concentration in the contamination source whereas enterovirus infection risk to the inactivation rate. The model further indicates that the time window for effective mitigation of the magnitude of a waterborne outbreak is short (within hours).
Health risk assessment of environmental exposure to pathogens requires complete and up to date knowledge. With the rapid growth of scientific publications and the protocolization of literature reviews, an automated approach based on Artificial Intelligence (AI) techniques could help extract meaningful information from the literature and make literature reviews more efficient. The objective of this research was to determine whether it is feasible to extract both qualitative and quantitative information from scientific publications about the waterborne pathogen Legionella on PubMed, using Deep Learning and Natural Language Processing techniques. The model effectively extracted the qualitative and quantitative characteristics with high precision, recall and F-score of 0.91, 0.80, and 0.85 respectively. The AI extraction yielded results that were comparable to manual information extraction. Overall, AI could reliably extract both qualitative and quantitative information about Legionella from scientific literature. Our study paved the way for a better understanding of the information extraction processes and is a first step towards harnessing AI to collect meaningful information on pathogen characteristics from environmental microbiology publications.
Most water utilities have to handle a substantial number of customer complaints every year. Traditionally, complaints are handled by skilled staff who know how to identify primary issues, classify complaints, find solutions, and communicate with customers. The effort associated with complaint processing is often great, depending on the number of customers served by a water utility. However, the rise of natural language processing (NLP), enabled by deep learning, and especially the use of deep recurrent and convolutional neural networks, has created new opportunities for comprehending and interpreting text complaints. As such, we aim to investigate the value of the use of NLP for processing customer complaints. Through a case study about the Water Utility Groningen in the Netherlands, we demonstrate that NLP can parse language structures and extract intents and sentiments from customer complaints. As a result, this study represents a critical and fundamental step toward fully automating consumer complaint processing for water utilities.