Learning to Fail, and Fail Again