Aligning sketches to their corresponding painting could give more insight into the creative process of an artist. This is a difficult task that cannot be solved directly with classical image registration techniques. Typically, features such as cracks and brushstrokes are used to match different modalities. A sketch does not contain such artifacts and is often roughly similar to the final painting. Therefore the following question rises what suitable feature detection, feature extraction/description, and transform model estimation methods can be used to align sketches to their corresponding painting. This paper provides a proof of concept by taking a manual feature detection, and a histogram of orientations as a feature description. We demonstrate that our algorithm can automatically align sketches with up to 1.4 percent of the accuracy of manual alignment.