Adaptive thread pool scaling and real-time thread monitoring

Adaptive thread pool scaling and real-time thread monitoring

Janssen, Martijn (TU Delft Electrical Engineering, Mathematics and Computer Science)

Rellermeyer, Jan S. (mentor)
Epema, D.H.J. (graduation committee)
Al-Ars, Z. (graduation committee)

Delft University of Technology

Computer Science | Distributed Systems

2022-08-15

Thread pools, integrated in programming languages, packages and dependencies are widely used by developers. Thread pools assume they are running alone on the system, which is not always the case. Previous research has shown that adapting thread pool size has been effective under specific conditions. In this research, scaling the thread pool with respect to CPU and network usage is examined. However, simpler metrics can achieve better results. Two solutions are provided for algorithmically scaling the thread pool, both with a different use-case in mind. Next to that an improved way to collect CPU and network metrics is provided, allowing for real-time thread-based measurements. The result of the scaling solution is improved performance, while also offering reduced energy usage. This research shows that when multiple thread pools are running on the same machine, performance and efficiency is improved.

thread pool
concurrency
contention
power efficiency
Linux

http://resolver.tudelft.nl/uuid:afb0671a-feb5-4a99-892f-9aa4cf16493a

Student theses

master thesis

© 2022 Martijn Janssen