Nils Durner's Blog Ahas, Breadcrumbs, Coding Epiphanies

Google Bard supports Coding / Codeium caught cheating?

Google Bard now supports coding as an explicit use-case. It improves on Github Copilot and also GPT-4/ChatGPT in terms of rights awareness:

If Bard quotes at length from an existing open source project, it will cite the source.

Using the same sample of (alleged) LGPL-infringement that Codeium present in their recent blogpost:

implement the following function: "// sparse matrix times dense vector
/* y = A*x+y */
csi cs_gaxpy (const cs *A, const double *x, double *y)
{
}"

Bard will not reproduce Tim Davis’ work more or less verbatim, but returns reasonably distinct code: Bard Code 1 Bard Code 2

A colleague voiced suspicion than Codeium cheated in their demoes, by including original header comments as well, thus severely tempting the model.

I had noticed the headers as well, so removed these before verifying (see my screenshot; same prompt used with GPT-4). One other thing I noticed was that they only use simple cases. The original, really complicated code with seemingly original ideas, that Tim Davis had posted on Twitter, was NOT used for their demo. Why not, I wonder. Perhaps it is as the colleague said: they are cheating, and only select examples that work in their favour.