Treatment Effect Estimation of the DragonNet under Overlap Violations

Treatment Effect Estimation of the DragonNet under Overlap Violations

van Veen, Marco (TU Delft Electrical Engineering, Mathematics and Computer Science)

Bongers, S.R. (mentor)
Krijthe, J.H. (mentor)
Bidarra, Rafael (graduation committee)

Delft University of Technology

Computer Science and Engineering

CSE3000 Research Project

2022-06-23

The large amounts of observational data available nowadays have sparked considerable interest in learning causal relations from such data using machine learning methods. One recent method for doing this, which provided promising results, is the DragonNet (Shi et al., 2019), which utilises neural networks in order to estimate average treatment effects in populations. The performance of the model, however, was not tested on datasets which contain low amounts of overlap between the treated and non-treated subpopulations, which makes it harder to accurately estimate treatment effects. Therefore, the goal of this paper is to investigate the performance of the DragonNet when used on datasets with (near) overlap violations. This has been done by looking at the mean absolute errors and variances of the estimated treatment effects and comparing these to other models. The results showed that the performance of the DragonNet becomes significantly worse compared to other models when large portions of the population suffer from low overlap. Additionally, the variance of the results also increases in these cases, making the results less reliable. From the obtained results, it can be concluded that it is best to choose another model for treatment effect estimation if relatively large amounts of overlap violations are suspected.

dragonnet
causal machine learning
overlap violations
Causal Inference

http://resolver.tudelft.nl/uuid:2d60c130-789a-46dc-804e-d2f493b89e60

Student theses

bachelor thesis

© 2022 Marco van Veen