I really like Drew's framework here dividing current AI use-cases into Gods (human replacement, which I think of as still mostly science fiction), Interns (assistants you delegate closely-reviewed tasks to, which is most of how I use LLMs today) and Co...
-
Matt Campbellreplied to Simon Willison last edited by
@simon You sure you linked to the right song? Have you gone through the kind of existential crisis portrayed in that song? I always saw you as being cautiously optimistic about AI, that it can be a useful tool if used well, but not making us redundant.
-
Simon Willisonreplied to Matt Campbell last edited by
@matt @forrestbrazeal oh I absolutely went through these 5 stages of grief, but I've been firmly in the 5th step for over a year at this point
-
Matt Campbellreplied to Simon Willison last edited by
@simon @forrestbrazeal I don't think I ever actually felt the anger. And I feel kind of guilty about that, because of course some people have decided to stop there and fight against AI, and they have such moral certainty about it.
-
@simon @matt @forrestbrazeal I don’t feel like I am stuck in step 4, but I can’t get to step 5 because I do very much believe that (at least in their current incarnation) AI is very much going away. I am worried about the collateral damage that this particular dead tree is going to cause when it smashes into the rest of the ecosystem. E.g.: nvidia currently has a market cap of 11% of GDP, which I do not think is sustainable. But who on earth is going to get a positive ROI on ChatGPT at $20/mo?
-
Simon Willisonreplied to Matt Campbell last edited by
@matt @forrestbrazeal I've not felt the anger personally, because I've been releasing open source code for 20+ years so I already default to "I want people to be able to reuse my work as much as possible" - but I absolutely understand the people who ARE angry
If I was an artist and someone trained Stable Diffusion on my work without my permission and then started competing with me for commissions that used my own personal style I think I'd feel very differently about this all
-
@glyph @matt @forrestbrazeal I expect there's going to be a substantial AI crash, but I don't think (most of) the tools I'm using right now will become unavailable to me - especially since I can run Llama 70B on my own laptop now
-
Matt Campbellreplied to Simon Willison last edited by
-
@matt @simon while I agree that the models you are using locally will not go away, I am also skeptical that they will receive much in the way of maintenance once the commercial bubble has burst. Nobody is getting paid when you run a model on your laptop locally, and training them still requires a zillion hours of GPU time and a corpus in the petabytes
-
Simon Willisonreplied to Matt Campbell last edited by
@matt @glyph the models I can run in my laptop today are leagues ahead of the models I ran on the exact same hardware a year ago - improvements in that space have been significant
This new trick from Microsoft looks like it could be a huge leap forward too - I've not dug into it properly yet though https://github.com/microsoft/BitNet
-