There's an utterly ridiculous "study" out from Stanford about "ghost engineers" which are reportedly engineers who do nothing at companies.
-
@grimalkina yeah, it sounds dubious at best on that alone, allowing an outsider and a panel of ten "experts" to review all the code by 50k engineers? It sounds incredibly unlikely, given NDAs
-
@thisismissem did they simulate this panel with an LLM? I feel like I know the answer.
-
@mjf_pro @jaredwhite it doesn't quite specify what "simulate a panel of ten experts" actually means, but I guess, yes, it could mean this.
-
@kissane based on the author's previous paper, I'm gunna guess yes: https://www.gsb.stanford.edu/faculty-research/working-papers/predicting-expert-evaluations-software-code-reviews
-
@thisismissem gooooo it's all goo
-
Ha, surprise surprise, this isn't actually a "pre-print" at all, but uses another pre-print's data by the same author(s), and even in that pre-print looking at Predicting Expert Evaluations in Software Code Reviews the data seems woefully flawed
-
@thisismissem Useless then. These days, for better or worse, a whole lot of my code is written by my IDE via automation or #Copilot. Sure, I *start* typing a line, and the rest is done for me.
The *vast* majority of my time is spent interacting with users, developers, thinking and discussing new features, bug fixes, and the like.
Coding is a small, but important part of being a developer. If all someone measures is code output though, that's useless.
-
@thisismissem "simulated" as in... they got a bunch of LLMs to read it and make value judgements about a thing that's a bad metric in the first place?
-
@Floppy probably. I can't actually find claimed pre-print, but they've another pre-print which conspicuously uses the same sample sizes for data, data which wasn't collected properly from what I can tell.
-
@thisismissem @jaredwhite I think it means “figure out a way to blame the engineers for everything that goes wrong, as cheaply as possible!”
-
This post is deleted!
-
@thisismissem A colleague of mine told us how their software engineering manager measured productivity by counting semicolons written per week back in the 90s.
It was only a matter of time until they started using semicolons to frame their comments.
-
@thisismissem Where can I apply to be a ghost engineer?
-
@Jeff @drahardja probably at: https://careers.ghost.org
(Joking aside on that term, the Ghost team do some fantastic work)
-
I contracted a helpdesk gig where I made myself reportback liason and the client didnt renew me and the contractor wouldnt leave me alone for a year and I still talk to them every so often about Hospital/clinic placements
-
@thisismissem do you have a DOI?
-
@DenialShown nah, it was a bunch of tweets by a person that worked on a pre-print that was assessing something else. The "pre-print" claim by this person appeared to mostly just be lending credibility to what he was saying, along with using Stanford's name for legitimacy
-
Hrefna (DHC)replied to Emelia 👸🏻 last edited by [email protected]
This matches my impression as well.
Is it too much to hope that his faculty adviser throws him out on his ear for this nonsense?
Oh wait his faculty adviser is a business and psych researcher who regularly goes outside of his lane.
Sigh.
-
@drahardja @blogdiva @thisismissem
Goodhart's Law strikes again!
https://en.wikipedia.org/wiki/Goodhart's_law -
@samir In Germany it would be invalid to fire someone w/o a warning. So the moment I'd get that warning judging my none performance based on not enough code changes I'd maliciously comply and do lots and lots of commits just to teach everybody the meaning of Goodhart's law by example.
@thisismissem
