Nils Durner's Blog Ahas, Breadcrumbs, Coding Epiphanies

Microsoft Copilot Chat

Microsoft has launched Copilot Chat, an offering similar to ChatGPT:

It seems generally free to use. There are some advanced features¹ on a pay-per-use basis, and a $30 subscription model with even more advanced integrations.

(¹ “Agents”; which are based on OpenAI Assistants?)

Notes:

  • The blog post mentions “web grounding”, but that doesn’t seem to be actually available (in the EU)?
  • When used via corporate SSO login, Enterprise Data Protection is enabled
  • As I wrote elsewhere: “Confusingly, providers also offer AI assistants that lure with the same AI model names but create different conditions for the underlying language model through their orientation, fine-tuning, and product design. These AI assistants include products like Claude from Anthropic, ChatGPT from OpenAI, Gemini from Google, and Bing Copilot from Microsoft.”. Copilot Chat falls in the same category. Example: when used for the SVG (kind-of a programming language, like HTML, but for vector graphics) of a pelican riding a bike, it won’t oblige like the original GPT-4o model does, but displays a pixel image inline:

Microsoft Copilot Chat screenshot: pelican on a bike

Despite this being dressed up for business, Gen. AI remains perilous and should be handled with care. Also, don’t rely on it for last-minute work as the usage limits are unclear. Again, as I wrote elsewhere: “Within the respective usage plans of these AI assistants, one must also expect non-transparent usage restrictions that may unexpectedly deny users further use or suddenly downgrade them to a particularly low-performance language model within the same model family.”

  • Web search is enabled and used automatically
    Copilot chat response with web references
    • (⚠️ Search-enabled AI is a very messy affair. I have done several tests/examinations and the best advice I can think of is to use it to just find something you reasonably know is true/exists/can be challenged: „Is there evidence that…“, „Find the article that…“. Then, review the original source presented. Don‘t rely on the „summaries“ presented by the AI, these can be wrong. Also, different products vary wildly, but ChatGPT is among the best I have tries. Be very cautious here.)
  • the model that is used underneath seems rather weak - GPT-4o mini, perhaps? If you appreciate the Claude model (which Mario talked about at Town Hall), you may be disappointed. Copilot Chat shines for the Search integration, not because it‘d be a powerful LLM. It may not be best for translation tasks, but I would like to hear about experiences from others.
  • “Pages” reminds me of OpenAI Canvas, but is less powerful.
  • Code Interpreter also works. Sample prompt: “Use Code Interpreter to determine if this year is a leap year.”