Synchronization plays a crucial role in the dynamics of living organisms. Uncovering the mechanism behind it requires an understanding of individual biological oscillators and the coupling forces between them. Here, a single-cell assay is developed that studies rhythmic behavior in the motility of E. coli cells that can be mutually synchronized. Circular microcavities are used to isolate E. coli cells that swim along the cavity wall, resulting in self-sustained oscillations. Connecting these cavities by microchannels yields synchronization patterns with phase slips. It is demonstrated that the coordinated movement observed in coupled E. coli oscillators follows mathematical rules of synchronization which is used to quantify the coupling strength. These findings advance the understanding of motility in confinement, and open up new opportunities for engineering networks of coupled oscillators in microbial active matter.