Physical pooling functions in graph neural networks for molecular property prediction
Artur M. Schweidtmann (RWTH Aachen University, TU Delft - ChemE/Product and Process Engineering)
Jan G. Rittig (RWTH Aachen University)
Jana M. Weber (TU Delft - Pattern Recognition and Bioinformatics)
Martin Grohe (RWTH Aachen University)
Manuel Dahmen (Forschungszentrum Jülich)
Kai Leonhard (RWTH Aachen University)
Alexander Mitsos (Forschungszentrum Jülich, RWTH Aachen University, JARA Center for Simulation and Data Science (CSD))
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
Graph neural networks (GNNs) are emerging in chemical engineering for the end-to-end learning of physicochemical properties based on molecular graphs. A key element of GNNs is the pooling function which combines atom feature vectors into molecular fingerprints. Most previous works use a standard pooling function to predict a variety of properties. However, unsuitable pooling functions can lead to unphysical GNNs that poorly generalize. We compare and select meaningful GNN pooling methods based on physical knowledge about the learned properties. The impact of physical pooling functions is demonstrated with molecular properties calculated from quantum mechanical computations. We also compare our results to the recent set2set pooling approach. We recommend using sum pooling for the prediction of properties that depend on molecular size and compare pooling functions for properties that are molecular size-independent. Overall, we show that the use of physical pooling functions significantly enhances generalization.