SN
S. Najafian
info
Please Note
<p>This page displays the records of the person named above and is not linked to a unique person identifier. This record may need to be merged to a profile.</p>
2 records found
1
Automatic generation of anomaly reports in a Train Control System
Using Natural Language Generation and Case-Based Reasoning
In this thesis, we study automatically generating explanatory reports for anomalous incidents in a train control system (TCS) using Natural Language Generation (NLG). A TCS is a type of safety-critical software that allows train controllers to correctly set the tracks for a train to pass. The goal of this research is to process the majority of log files generated by such a system, detect anomalies that have occurred and represent that data in human-readable reports that explain anomalous incidents. The reports are generated by making use of NLG techniques, namely data-to-text. We design an NLG pipeline that incorporates novel graphical components. We perform all steps of the report generation process, which is the processing of data, anomaly detection and representing the data in natural language. To process the data we incorporate complex domain-specific rules which require extensive work to accommodate five separate types of event log files. Analyzing logs and detecting anomalous incidents proved complex due to the complicated structure of logs and the ill-defined relationships between different log file types. The log data explained with the NLG pipeline is more extensive than we have seen in literature, as it needs to be linked using complex domain-specific rules and includes temporal and geographical aspects of the railway system. Furthermore, the detected anomalies are very diverse and thus it is unclear what aspects should be included in a report for each anomalous case. We research whether a purely textual presentation or a combination of modalities provides higher information quality. The product of the NLG system are three presentation versions of incident reports, Text, TimeText and RailText. Each version focuses on different important aspects of the nature of the data, to explain anomalous incidents. Due to the diverse properties of the anomalous cases detected, we implement a Case-Based Reasoning (CBR) system to predict the appropriate presentation to explain each incident. We evaluate our work in two expert-based evaluation phases. The first phase evaluates the quality of the different report presentations. The second phase evaluates the feasibility of the CBR system and the quality of the reports chosen by CBR. The work in this thesis is significant as we manage to translate complex data into human-readable reports that are well received by experts and help in understanding anomalous cases. We learn that there is a difference in what presentation format provides the highest information quality of reports depending on the anomalous case being explained. Therefore we conclude that the properties of anomalous cases should be taken into account when generating anomalous reports in a TCS to ensure the highest perceived information quality of the reports. CBR is shown to perform that task well. Furthermore, we find that data familiarity of experts effects their preferences for report presentations.
...
In this thesis, we study automatically generating explanatory reports for anomalous incidents in a train control system (TCS) using Natural Language Generation (NLG). A TCS is a type of safety-critical software that allows train controllers to correctly set the tracks for a train to pass. The goal of this research is to process the majority of log files generated by such a system, detect anomalies that have occurred and represent that data in human-readable reports that explain anomalous incidents. The reports are generated by making use of NLG techniques, namely data-to-text. We design an NLG pipeline that incorporates novel graphical components. We perform all steps of the report generation process, which is the processing of data, anomaly detection and representing the data in natural language. To process the data we incorporate complex domain-specific rules which require extensive work to accommodate five separate types of event log files. Analyzing logs and detecting anomalous incidents proved complex due to the complicated structure of logs and the ill-defined relationships between different log file types. The log data explained with the NLG pipeline is more extensive than we have seen in literature, as it needs to be linked using complex domain-specific rules and includes temporal and geographical aspects of the railway system. Furthermore, the detected anomalies are very diverse and thus it is unclear what aspects should be included in a report for each anomalous case. We research whether a purely textual presentation or a combination of modalities provides higher information quality. The product of the NLG system are three presentation versions of incident reports, Text, TimeText and RailText. Each version focuses on different important aspects of the nature of the data, to explain anomalous incidents. Due to the diverse properties of the anomalous cases detected, we implement a Case-Based Reasoning (CBR) system to predict the appropriate presentation to explain each incident. We evaluate our work in two expert-based evaluation phases. The first phase evaluates the quality of the different report presentations. The second phase evaluates the feasibility of the CBR system and the quality of the reports chosen by CBR. The work in this thesis is significant as we manage to translate complex data into human-readable reports that are well received by experts and help in understanding anomalous cases. We learn that there is a difference in what presentation format provides the highest information quality of reports depending on the anomalous case being explained. Therefore we conclude that the properties of anomalous cases should be taken into account when generating anomalous reports in a TCS to ensure the highest perceived information quality of the reports. CBR is shown to perform that task well. Furthermore, we find that data familiarity of experts effects their preferences for report presentations.
Master thesis
(2019)
-
Nivedita Prasad, Nava Tintarev, Alessandro Bozzon, Odette Scharenborg, Shabnam Najafian
People like to travel in groups to visit places. Group recommendation systems can be used to recommend an itinerary of "places of interests" (POIs) in an ordered sequence. The order of POIs in the sequence can be explained to group members to increase acceptance of the recommended items. There is a possibility that explanations which reveal names and rating preferences could create a threat to privacy. The main study in this work uses two group types - a primary group consisting of closely-related members, and a secondary group consisting of loosely-related members. Explanations with either complete information or privacy-preserving information are offered alternatively to these groups. The purpose of this study is to evaluate whether different group types need different types of explanations to improve their satisfaction. These explanations explain the entire recommended sequence of POIs with regard to possible conflicting situations that could occur due to disagreement with the order of the sequence. A total of 25 participants took part in the evaluation. There was no significant difference identified between the explanation types preferred by each group type. To understand the underlying reason for this result, a post-hoc analysis was done. We identified a participant's most frequently used conflict-handling modes using the Thomas-Kilmann personality assessment test. We then analyzed the user comments provided during the questionnaire. The analysis potentially suggests that different conflict-handling modes could be a factor affecting which explanation type was preferred by a person when they are in a particular group (e.g. primary vs secondary).
...
People like to travel in groups to visit places. Group recommendation systems can be used to recommend an itinerary of "places of interests" (POIs) in an ordered sequence. The order of POIs in the sequence can be explained to group members to increase acceptance of the recommended items. There is a possibility that explanations which reveal names and rating preferences could create a threat to privacy. The main study in this work uses two group types - a primary group consisting of closely-related members, and a secondary group consisting of loosely-related members. Explanations with either complete information or privacy-preserving information are offered alternatively to these groups. The purpose of this study is to evaluate whether different group types need different types of explanations to improve their satisfaction. These explanations explain the entire recommended sequence of POIs with regard to possible conflicting situations that could occur due to disagreement with the order of the sequence. A total of 25 participants took part in the evaluation. There was no significant difference identified between the explanation types preferred by each group type. To understand the underlying reason for this result, a post-hoc analysis was done. We identified a participant's most frequently used conflict-handling modes using the Thomas-Kilmann personality assessment test. We then analyzed the user comments provided during the questionnaire. The analysis potentially suggests that different conflict-handling modes could be a factor affecting which explanation type was preferred by a person when they are in a particular group (e.g. primary vs secondary).