A Dichotomy Concerning Uniform Boundedness of Riesz Transforms on Riemannian Manifolds