What we are working on.

Your Model Already Knows the Answer

The best test of an AI model is a real world problem with a known answer. It is also the easiest test to cheat. A map of the three ways the answer leaks into a model, the eight methods used to catch it, and why not one of them proves a model is clean.