We study a self-propelling pair of steadily counter-rotating cylinders in simulations of a two-dimensional viscous fluid. We find two strikingly, opposite directions for the motion of the pair that is characterized by its width and rotational Reynolds number. At low Reynolds numbers and large widths, the cylinder pair moves similarly to an inviscid point vortex pair, while at higher Reynolds numbers and smaller widths, the pair moves in the opposite direction through a jet-like propulsion mechanism. Increasing further the Reynolds number, or decreasing the width, gives rise to non-polarised motion governed by the shedding direction and frequency of the boundary-layer vorticity. We discuss the fundamental physical mechanisms for these two types of motion and the transitions in the corresponding phase diagram. We discuss the fluid dynamics of each regime based on streamline plots, tracer particles, and the vorticity field. The counter rotating cylinder pair serves as a prototype for self-propelled bodies and suggests possible engineering devices composed of simple components and tunable by the rotation and width of the cylinder pair.