Spotting When Algorithms Are Wrong