He’s not saying “AI is done, there’s nothing else to do, we’ve hit the limit”, he’s saying “bigger models don’t necessarily yield better results like we had initially anticipated”
Sam recently went before congress and advocated for limiting model sizes as a means of regulation, because, at the time, he believed bigger would generally always mean better outputs. What we’re seeing now is that if a model is too large it will have trouble producing truthful output, which is super important to us humans.
And honestly, I don’t think anyone should be shocked by this. Our own human brains have different sections that control different aspects of our lives. Why would an AI brain be different?
Lol… I just read the paper, and Dr Zhao actually just wrote a research paper on why it’s actually legally OK to use images to train AI. Hear me out…
He changes the ‘style’ of input images to corrupt the ability of image generators to mimic them, and even shows that the super majority of artists even can’t tell when this happens with his program, Glaze… Style is explicitly not copywriteable in US case law, and so he just provided evidence that the data OpenAI and others use to generate images is transformative which would legally mean that it falls under fair use.
No idea if this would actually get argued in court, but it certainly doesn’t support the idea that these image generators are stealing actual artwork.