Your Classifier Is Broken, But It Is Still Useful