Non-uniform performance reported for in-context learning: How Language Models Use Long Contexts: Read more... 10 Jul 2023 - 1 minute read
GPT-4 API was just made generally available, and: Read more... 07 Jul 2023 - 1 minute read
Prompted by a colleague posting the Handelblatt article about SAP investing in Aleph Alpha, I elaborated that the beauty of Aleph Alpha is GDPR-compliance and generally good data hygiene. With OpenAI, for me it’s oftentimes a “write code to do X”, with X actually being done on data that sits with me locally. But if X requires advanced natural la... Read more... 01 Jul 2023 - less than 1 minute read
First glance at & hands-on Aleph Alpha, the German competitor of OpenAI: Read more... 29 Jun 2023 - 2 minute read
Prompted by an interview with Jerry Liu of LlamaIndex posted by a colleague, I shared that we have been evaluating this since March or so, with rather poor results esp. when the data basis gets larger. I contributed a patch to add GPT-4 support, but as it turned out, the problems are not with the backend LLM, but IMHO a fundamental design issue ... Read more... 28 Jun 2023 - less than 1 minute read