Code analysis firm sees no major benefits from AI dev tool when measuring key programming metrics, though others report incremental gains from coding copilots with emphasis on code review.

“Many developers say AI coding assistants make them more productive, but a recent study set forth to measure their output and found no significant gains. Use of GitHub Copilot also introduced 41% more bugs, according to the study from Uplevel”

study referenced: Can GenAI Actually Improve Developer Productivity? (requires email)

  • phoneymouse@lemmy.world
    8·
    3 months ago

    It’s helpful when you want to try to figure out an error or even just write a few lines of boiler plate code quickly without needing to look through library documentation.

    • hex@programming.dev
      1·
      3 months ago

      Yes. It’s also helpful if you’re grappling with a new framework and similarly are struggling with a basic error. But more complex issues, AI will usually struggle and introduce questionable design decisions if we lean on it too much.