The study shows that once you remove the LLM though, the benefit disappears. If you rely on an LLM to help break things down or add context and details, you don’t learn those skills on your own.
I used it to learn some coding, but without using it again, I couldn’t replicate my own code. It’s a struggle, but I don’t think using it as a teaching aid is a good idea yet, maybe ever.
That’s not the fault of the user/students, though. They’re different tools. One is outright worse than not using it. Neither produce lasting benefits.
Headline: Screwdrivers better than hammers for screws.
Text: When craftspeople were trained using hammers with screwdriver bits duct-taped to them, they were able to perform the task, but were not able to keep pace with people using screwdrivers. Another team was given power drills, which were effective in practice. However, these did not produce any benefit once all people were given screwdrivers.