Interpretable models are essential in many machine learning applications, particularly in domains where transparency and trust are critical. Decision trees are a popular interpretable model, but their structure often leads to repeated identical subtrees and data fragmentation, which can result in large, overfit models with poor generalization. Decision diagrams could offer a more compact and less fragmented alternative by allowing sharing parts of the diagram, but constructing decision diagrams is computationally challenging and has seen limited practical adoption. This thesis introduces a novel local search-based algorithm for learning binary decision diagrams for classification. Our approach finds a middle ground between early greedy methods and exact optimization techniques, enabling scalable construction of compact and accurate diagrams. We define a local search approach with several move operators and explore multiple metaheuristics, identifying hill climbing with information gain-based initialization as the most effective strategy. We refer to this method as Decision Diagram Local Search (DDLS). We evaluate DDLS on 57 real-world datasets from the UCI repository and 480 synthetic datasets generated from known diagrams. Our method achieves competitive or superior accuracy compared to state-of-the-art decision tree and diagram methods on real-world datasets, while producing small models with lower fragmentation. Though challenges remain, especially on complex synthetic datasets, our results suggest that DDLS, and decision diagrams in general, hold significant untapped potential as interpretable classifiers.

Mind wandering is a phenomenon that is used to describe moments where a person's attention appears to shift away to something that is not related to the primary task, which can have a negative influence on the task performance. In this research, the aim is to create a viable algorithm that can automatically detect mind wandering based on eye movement from the Mementos data set. A method to automatically detect mind wandering could be used in online education in order to help students study more effectively, for example. The Mementos data set contains, unlike previous research, videos captured in an uncontrolled environment using inexpensive equipment. Features based on fixations and saccades were used to create two algorithms which were able to perform better than chance, having an average AOC-ROC of 0.63 and 0.59, as well as having an average F1 score of 0.046 and 0.041 compared to the chance-based model with an F1 score of 0.029.