"Train on adjacent skills to lift core domain Meta originally skipped coding training for Llama 2 because users wouldn't ask coding questions on WhatsApp. That turned out to be a mistake: "it turns out that coding is important for a lot of domains not just coding — training the models on coding helps them just be more rigorous and answer the question and kind of help reason across a lot of different types of domains." For Llama 3 they reversed course and heavily prioritized coding as a result. The lesson applies broadly: practicing a discipline adjacent to your main skill — logic, writing, or a second language — often strengthens your primary domain more than direct repetition of it. Source: Mark Zuckerberg, Dwarkesh Patel Podcast, Llama 3, Meta AI, Future of AI"