@
[email protected] For... I think in general, yes (as in, could one construct an arbitrary ML model that could have re-usable parts?), there's work that can be (and has been) done. But I also think it's something you'd have to specifically focus on during model construction and training; I suspect it's pretty unlikely you'd get it "for free".But for the large models, specifically LLMs... yeah, that's a whole ass barrel of fish, isn't it. I do wish they had focused on seeing if it was possible, but then again, if they were the type of people to care, we wouldn't be inundated with these models anyway...