We study the dynamics of a nonlinear electromechanical oscillator with delayed feedback. Compared to their linear counterparts, we find that the dynamics is dramatically different. The well-known Barkhausen stability criterion ceases to exist, and two modes of operation emerge: one characterized by hysteresis in combination with a bistable frequency and amplitude; the other, by self-stabilization of the oscillation frequency and amplitude. The observed features are captured by a model based on a Duffing equation with delayed force feedback. Nonlinear oscillators with delayed force feedback are exemplary for a large class of dynamic systems.