JD

J.J. Den Toonder

info

Please Note

2 records found

Scheduler for Carbon-Aware Load Execution in OpenShift at ING

Master thesis (2023) - J.J. Den Toonder, T. Durieux, A. van Deursen, M.A. Migut, P.G.P. Braakman
The global climate change crisis and the associated phenomenon of global warming have taken center stage in recent years. Greenhouse gas emissions due to electricity generation are a contributor to this problem. Internet Services running in data centers consume enormous amounts of energy and should be optimized to reduce their greenhouse gas emissions.

This thesis explores the possibility of intelligently scheduling resource-intensive batch data-processing jobs to green energy generation hours in the day. Green hours are hours within the day during which the amount of greenhouse gasses emitted per kilowatt-hour (kWh) is lower compared to other hours of the day. There is a variance in the amount of emissions due to the variability of renewable energy generation and grid demand.

The system "S.C.A.L.E. (Scheduler for Carbon-Aware Load Execution)" is proposed. It schedules compute jobs to periods of low-carbon-intense energy generation based on predictions of renewable energy generation and grid demand. The system was evaluated against a simulated data processing pipeline at ING; this pipeline is one of the larger consumers of the ING private cloud. The scheduler aims to reduce greenhouse gas emissions by intelligently predicting task running times and green hours for the next day and optimizing the times at which tasks are processed throughout the day.

Several main conclusions are drawn based on this research:
  1. The accuracy of task load predictions regarding running times is crucial for effective scheduling. The research concludes that, with sufficient historical data, the scheduler can predict task running times with an acceptable margin of error (5-10%).
  2. The research explores the scheduler's ability to predict periods of low carbon intensity and the resulting reduction in carbon emissions by implementing it. The research affirms the scheduler's accuracy in determining low-carbon-intensive energy generation periods and estimates a potential 20% reduction in greenhouse gas emissions.
  3. The potential overhead introduced by implementing a carbon-aware scheduler is addressed. The research identifies that while the scheduling algorithm itself is lightweight, the concurrent processing of tasks introduces overhead. The tipping point, where the overhead outweighs the benefits, varies for each system and should be experimentally determined.

The thesis concludes by emphasizing the significance of implementing a carbon-aware scheduler to reduce the environmental impact of data centers. The proposed scheduler is a promising contribution to sustainable computing practices. Further, the research suggests the need for continued work and adoption of the scheduler into production environments, especially within the context of the ING data processing pipeline. ...
Bachelor thesis (2021) - J.J. Den Toonder, Y. Lee, M.M. Specht, M.A. Migut
Remote learning, learning from home using online available materials, is becoming increasingly more common. This paper focuses on reading activities during remote learning. An important part of learning is keeping sustained attention on the learning materials, as a shift from sustained attention to internal thought or mind-wandering oftentimes decreases the learning performance. Yet this shift is very common during daily activities. It is therefore important for a remote E-learning system to be aware of these attention shifts and allow it to intervene when necessary. Prior research indicates that facial emotion detection and participant's body temperature are generally missing as data modalities. Especially facial emotion recognition may contribute to this area of research, as facial emotions may indicate a learner's affective state during the learning process, and detection of this can be done using a simple consumer laptop web camera. Therefore this paper aims to investigate the feasibility of using a standard laptop web camera to detect facial emotions and a cheap Infrared Temperature Sensor (IR-sensor) to detect the loss of sustained attention. Two experiments were conducted to gather attentive and inattentive data. From this data, features were extracted which were used in multiple machine learning models. The created Machine Learning (ML) models worked well on synthetic test and validation data, but they performed poorly in practice. Our main hypothesis for this is overfitting of the ML models on the data, as due to the Coronavirus Disease (COVID-19) no more than three participants partook in the user studies. Overall, the conclusion is that both emotional facial detection and participant body temperature show great potential to detect sustained attention, but further research needs to be done with a larger group of participants to confirm this. ...