Regression is difficult because of noise, imbalanced data sampling, missing data, etc. We propose a method by classifying the continuous regression labels to tackle regression robustness problems. We analyze if our method can help regression, given that the class information is already included in the regression labels. We start by extensively experimenting on 1D synthetic datasets and find out that classification can help regression when the data sampling is i balanced. This happens when the data are clean, noisy in inputs and noisy in outputs, but not when they are partially missing. We then validate our conclusion on the KITTI dataset by estimating 3D object orientation. We conclude that our method can help regression in real-world.