“…contrary to the hype, researchers have consistently found that AI-generated code is a bug-filled mess, forcing some programmers to pick up the pieces.
“No one knows right now what the right reference architectures or use cases are for their institution,” Dorian Smiley, CTO and founder of AI software engineering company Codestrap, told The Register.
“From the large language model perspective, people aren’t really addressing the fallibility of the underlying text,” CEO Connor Deeks added.
As software engineers continue to be put under pressure to use AI for their work — or else land on the chopping block — many errors could fall through the cracks.
“Even within the coding, it’s not working well,” Smiley told The Register. “Code can look right and pass the unit tests and still be wrong.”
The executive explained that the benchmarks required to verify code simply haven’t caught up yet, which means companies leveraging AI may be flying by the seat of their pants by using AI to verify AI code, a potentially dangerous feedback loop…”