Sutskever (OpenAI Co-Founder) on the Simplicity of LLM AI
“Hinton gave Sutskever some papers to read, which he devoured. He remembers being perplexed by the simplicity of the math, compared to the math and physics of his regular undergrad coursework. He could read these papers on deep learning and understand powerful concepts.
‘How can it be that it’s so simple…so simple that you can explain it to high school students without too much effort?’ he told me. ‘I think that’s actually miraculous. This is also, to me, an indication that we are probably on the right track. [It can’t] be a coincidence that such simple concepts go so far.’”
In Why Machines Learn: The Elegant Math Behind Modern AI by Anil Ananthaswamy (2024).
Ilya Sutskever co-founded OpenAI. He was chief scientist and served on the board of directors. He is currently CEO of SSI. Sutskever has 870,000 scientific citations to his name.
Geoffrey Hinton is University Professor Emeritus at the University of Toronto (where modern AI was created under his leadership); Nobel Prize winner in physics; Turing Prize winner. He is referred to as the "godfather of AI."