Massive increase in short term memory of Chatbots 🧠

Hey there,

In today’s edition:

📰 News: Massive increase in short term memory of Chatbots

🛠️ Tools: Chrome extension to summarize any webpage, all-in-one chatbot.

🧠 Learn: Deep dive on AI models like ChatGPT, understand how prompt-injection attacks work.

Reading time is 3 minutes. Let’s dive in 🤿

Anthropic’s chatbot can remember 75K words

What: AI models such as ChatGPT have become increasingly proficient in summarizing documents, drafting emails, and even writing small components of code.

But they struggle with larger and complex documents because of limitations on their "context window".

Anthropic released a substantial upgrade to its Claudie chatbot, a ChatGPT competitor, to expand the context window size from 9K to 100K tokens. This is roughly equal to 75,000 words, blowing GPT-4's 32K context window out of the water.

Why it matters: Think of context window of an AI model as it’s short-term memory, determining how much information it can remember when answering your questions.
A larger context window helps the AI understand context, maintain coherence in long conversations and avoid repetition.

Claudie's 100K context window means you could upload entire book or summarize 6 hours of audio!

• Easily interact with large text data - Claudie can digest, summarize and explain long documents like financial statements, legal documents, and legislative pieces.

• Enhanced code assistance - Claudie can read hundreds of pages of developer documentation and surface answers to technical questions

• Rapid prototyping - Claudie can consume entire codebase into context and intelligently build on or modify it!

Bigger Picture: A larger context window requires more computing power and slows down the model, but Claudie seemed to have cracked the problem.

This opens up a whole new avenue of business use-cases. For instance, lawyers could upload entire case files or financial analysts could analyze couple of years of financial documents and get answers within seconds!

New Tools
Leverage AI to grow

• ChatHub: All-in-one client to use multiple chatbots at the same time and place, making it easy to compare their answers (link)

• Seia: Helps you understand what your AI system is doing and maximizes your AI’s ROI and compliance. (link)

• AI Text Assistant: Chrome extension to summarize any webpage and create comments. (link)

• Markup: An open-source tool that lets you to transform unstructured documents into structured formats and build structured datasets from free-text. (link)

Misc 🌎
From the corners of the Internet

• Learn: Course on how Large Language Models (LLMs) like ChatGPT work (link)

• Read: Hacking AI models? Read how Prompt-Injects attacks work (link)

• Build: New retrieval framework in Langchain allows you to link Google search with OpenAI! (link)

• ChatGPT: 70% plugins to augment ChatGPT roll out to all premium users (link)