> A GitHub [survey published in August](https://github.blog/news-insights/research/survey-ai-wave-grows/) found that 97% of software engineers, developers, and programmers reported using AI coding assistants.
-
> A GitHub [survey published in August](https://github.blog/news-insights/research/survey-ai-wave-grows/) found that 97% of software engineers, developers, and programmers reported using AI coding assistants.
97% using tools that generate 41% more bugs. Fuck all of this. What a fucking clown car of an industry
-
Steven Saus [he/him]replied to Baldur Bjarnason last edited by
@baldur I am looking at this right now and it's... well, a mess of a survey.
First, who puts their methodology in ultra-widescreen slides? And these questions are SUPER vague and all perception based. Like, yes, I've used an AI tool. Sometimes it is very useful (usually with something really simple). Sometimes it's completely fucking wrong. But it's all perception and a bunch of noise. UGH.
-
Steven Saus [he/him]replied to Steven Saus [he/him] last edited by
for those following this thread, I ended up writing it all up:
GitHub's survey about the benefits of AI coding assistants doesn't say much, is embarrassingly bad, and makes many claims that its data simply does not support.
Lies, Damn Lies, And Surveys About AI
GitHub's AI Survey is embarrassingly bad and doesn't support its conclusions.
(ideatrash.net)
-
@StevenSaus survey by a company about their own product (which they are currently burning money on at an unbelievable rate) shows positive results.
-
I will note that this negative study is also by a company that wants my email address to download it, so they can mail me about their dev analytics dashboard services.
-
Simon Willisonreplied to Martijn Faassen last edited by
@faassen @groxx @StevenSaus I gave them an email address in the hope of reading the full survey… and they emailed me a VERY thin two page PDF
I used Google Gemini to extract text from this image into markdown here (because LLMs are useful like that) https://gist.github.com/simonw/862733da36e33b475717321a0aaecbc0