About as open source as a binary blob without the training data

acargitz

Arguably they are a new type of software, which is why the old categories do not align perfectly. Instead of arguing over how to best gatekeep the old name, we need a new classification system.

Fushuan [he/him]

The source OP is referring to is the training data what they used to compute those weights. Meaning, petabytes of text. Without that we don't know which content theynused for training the model.

The running/training engines might be open source, the pretrained model isn't and claiming otherwise is wrong.

Nothing wrong with it being this way, most commercial models operate the same way obviously. Just don't claim that themselves is open source because a big part of it is that people can reproduce your training to verify that there's no fowl play in the input data. We literally can't. That's it.

[email protected]

It's not just the weights though is it? You can download the training data they used, and run your own instance of the model completely separate from their servers.

Fushuan [he/him]

The runner is open source, the model is not

The service uses both so calling their service open source gives a false impression to 99,99% of users that don't know better.

[email protected]

Did "they" publish the training data? And the hyperparameters?

[email protected]

Is it common? Many fields have standard, open datasets. That's not the case here, and this data is the most important part of training an LLM.

Fushuan [he/him]

The training data is NOT right there. If I can't reproduce the results with the given data, the model is NOT open source.

magic_lobster_party

The model is as far as I know open, even for commercial use. This is in stark contrast with Meta’s models, which have (or had?) a bespoke community license restricting commercial use.

Or is there anything that can’t be done with the DeepSeek model that I’m unaware of?

Fushuan [he/him]

The model is open, it's not open source!

How is it so hard to understand? The complete source of the model is not open. It's not a hard concept.

Sorry if I'm coming of as rude but I'm getting increasingly frustrated at having to explain a simple combination of two words that is pretty self explanatory.

[email protected]

There are lots of problems with the new lingo. We need to come up with new words.

How about “Open Weightings”?

[email protected]

Open sources will eventually surpass all closed-source softwares in some day, no matter how many billions of dollars are invested in them.

[email protected]

I mean, I downloaded it from the repo.

[email protected]

Just look at blender vs maya for example.

[email protected]

Never have I used open source software that has achieved that, or was even close to achieving it. Usually it is opinionated (you need to do it this way in this exact order, because that's how we coded it. No, you cannot do the same thing but select from the back), lacks features and breaks. Especially CAD - comparing Solidworks to FreeCAD for instance, where in FreeCAD any change to previous ops just breaks everything. Modelling software too - Blender compared to 3ds Max - can't do half the things.

[email protected]

The training data would be incredible big. And it would contain copyright protected material (which is completely okay in my opinion, but might invoice criticism). Hell, it might even be illegal to publish the training data with the copyright protected material.

They published the weights AND their training methods which is about as open as it gets.

[email protected]

They could disclose how they sourced the training data, what the training data is and how you could source it. Also, did they publish their hyperparameters?

They could jpst not call it Open Source, if you can't open source it.

[email protected]

You downloaded the weights. That's something different.

[email protected]

There were e|forts. Facebook didn't like those.

billwashere

That sounds like a segment on “My 600lb Life”

[email protected]

I reckon C++ > Delphi