studies show a clear trend – output is up (more code, more commits, bigger diffs), but outcomes don’t reflect that trend. If anything, the average team is taking longer to ship worse software
One study found a significant correlation between confidence in AI output and belief in the paranormal.
💀 💀 💀
This doesn’t seem to cover there is also no LLM that doesn’t plagiarize, or where the training data appears to be compatible with such behavior (e.g. CC0). Now I don’t know what that means legally, but morally it seems to be tossing away other project’s licensing and I think for FOSS as a whole that’s no good.
Also something worth reiterating: https://machinelearning.apple.com/research/illusion-of-thinking LLMs apparently can’t do basic logical reasoning. Even a junior coder can do that. I’m always surprised anybody would let LLMs near their code, at all.
Of course it didnt cover that. This was an article on the efficacy of AI in writing software, not a treatise on ethical or legal concerns. I would completely lose trust in the author if they started piling on every reason why “AI Bad”, because it would be clear that they have an agenda
In my opinion that’s not the framing the article uses. It just says “I’m currently pulling together a bunch of sources – that are mostly recent – on the topic of LLMs and their use in software development.”.
Leaving out any ethical concerns for that basic framing seems like a pretty notable choice, so I thought it was worth pointing that out.
output is up (more code, more commits, bigger diffs)
We’ve known measuring output by lines of code is counterproductive for a long time.
Has management known that?
A lot of problems seem to be downstream from “management are idiots and assholes”
I’m sure there were pockets but it legitimately seemed like that dragon had been slain until recently. Trying to assign more meaning to scrum points has been in vogue for a while though.
My team assigns both hours and points to tasks. I’ve never seen the points used for anything but they still spend time on it.
I could’ve told them this, tbh.
Anyone can tell anyone anything, it doesn’t make it true or validated.
