Nils Durner's Blog Ahas, Breadcrumbs, Coding Epiphanies

Llama 3.1 405B: Quantization and Hosting Challenges

Simon Willison, creator of Datasette and co-creator of Django, recently asked on Twitter for a “vibe check” on Llama 3.1 405B. He was particularly interested in whether it’s becoming a credible self-hosted alternative to the best OpenAI or Anthropic models, and if any companies previously hesitant about sending data to API providers are now usin... Read more...

Anti-AI Sentiment

Insightful article in WSJ, as anti-AI sentiment seems to be growing: Technology providers increasingly offer kitted-out AI premium products, although they have yet to gain traction among many enterprise customers. Tools like Copilot for Microsoft 365 or Gemini for Google Workspace are turning out to require a lot of hand-holding to make them ... Read more...

Synthetic Data in AI: Hype, Concerns, and Reality

A recent paper in Nature, “AI models collapse when trained on recursively generated data” by Shumailov et al., has sparked a heated debate in the AI community about the potential risks of using synthetic data for training language models. The paper suggests that indiscriminate use of model-generated content in training can cause irreversible def... Read more...

LLM Benchmarks: Progress and Gaps

Ethan Mollick, Associate Professor at The Wharton School, recently noted some significant gaps in current LLM benchmarking: Read more...

[UPDATED] Gpt 4o

description: “Introduces GPT-4o, highlighting architecture improvements, performance gains over GPT-4, and multi-modal input capabilities.” layout: post title: “Updated: GPT-4o” date: 2024-05-14 last_updated: 2024-05-14 tags: [gpt-4, chatgpt, summarization] — Read more...