The search for non-toxic alternatives to hexavalent chromium based corrosion inhibitors requires a comprehensive understanding of the factors critical to effective corrosion protection. Key considerations include the evolution of corrosion inhibition with inhibitor concentrations and exposure times, the inhibition efficacy in the presence and following absence of inhibitors, and the stability of inhibition upon polarisation. In our electrochemical comparison of promising organic molecules with sodium dichromate, we found that even top-performing candidates can lead to premature conclusions if such critical factors are overlooked. While organic molecules can match the inhibition performance of chromates under specific conditions, this can be misleading when considering concentration, time, and polarisation dependent behaviour. Initial high performance can also be deceptive in dynamic environments, as we observed that the inhibition provided by most organic molecules drastically decreases when the inhibitor is absent in the electrolyte. These observations call for broader comprehensive inhibitor robustness studies that take into account factors including time, concentration, stability, and polarisation effects in inhibitor efficacy analysis.