So now that I have a machine with 64GB of RAM and a decently fast CPU, I can try out some "AI" coding models without qualms about outsize environmental impact, and uh.
-
> Both sequences start with the same initial conditions, t(0) = 0 and t(1) = 1, but unlike the Fibonacci sequence which has t(2) = 1, the Tindall numbers have t(2) = 1 as well.
-
Jordan :ms_nonbinary_flag:replied to !!__NORA__!! on last edited by
@noracodes Oooh what'd you get?
-
!!__NORA__!!replied to Jordan :ms_nonbinary_flag: on last edited by
@jordan A Minisforum UM773.
-
deepseek-coder-v2 also produces dangerously wrong output about unsafe Rust; despite coming extremely close to plagiarizing the examples I give in Programming Rust's section on unions, it talks about unions being a solution for overlapping *lifetimes*, rather than overlapping *fields*, as well as outputing a program that uses `unsafe` union access without guarding its type, which can result in UB.
-
What we have with these models is the kind of thing the "uncanny valley" guards against with face generation: it's close enough to be convincing, but not close enough to be right. But with code, it's very hard to tell without close inspection.
-
!!__NORA__!!replied to !!__NORA__!! last edited by [email protected]
Code Llama is also... extremely disappointing.
The prompt, "Please write a Python program that takes two filenames as arguments and swaps their contents." resulted in output that:
- was not valid Python, starting with ``` (indicating the beginning of the program) followed by a non-commented header "Python Program for Swapping the Contents of Two Files"
- opened each file twice, first as read-only and then, after reading, as write-only, instead of once as read-write
- read the contents of the files into memory instead of just, you know, moving one of the files to a temporary and then moving them to their new destinations. (This is arguably an interpretation of the prompt, but still.)
- had a bunch of typos, like "content" instead of "contents" and "one of the file"
-
Output is here if you're interested https://gist.github.com/NoraCodes/97a84cb29317cdfda55fee6342467495
-
@noracodes I mean ,reading that, does it mean swapping the contents of the filename variables?
-
@mattyroses I was interested in how it would interpret a slightly ambiguous prompt, but I'd have been happy with either.
-
Oh, and they also do this: https://gist.github.com/NoraCodes/e5a8ae51e288cbf3d58b83aae8a9e915
This just straight up doesn't even try to do what I asked, it's so overfitted on "output a starting chess board" that it didn't even get to the part where it has to implement the actual logic.