"Build open verification to crowdsource trustworthy contributions Karpathy describes a design challenge in scaling autonomous research: how do you accept improvements from an untrusted pool of contributors on the internet without being deceived? His answer is to make verification cheap and objective: "if anyone gives you a candidate commit, it's very easy to verify that that commit is correct — someone could claim from the internet that this piece of code will optimize much better and give you much better performance. You could just check very easy." The general principle is that any collaborative system becomes scalable and trustworthy when it is structured so that claimed results can be independently verified cheaply, regardless of the contributor's identity. Source: Andrej Karpathy, Conviction, Episode with Andrej Karpathy"