Can I just do this with my favorite LLM?

AI tools have made it easier than ever to connect each of the software systems across your business. Here are a few key challenges we’ve seen with our “AI power user” customers.

1. Chatbots don’t have unlimited storage capacity

   • Adding hundreds of documents to a chat will quickly run through your available context and make any future queries more expensive. 

   • It’s important to provide any LLM with the context it needs to answer your question. However, if you provide it with too much information you can run into “context rot”. This is when the LLM has been given so much context that its performance starts to drop again. More context = more noise, which can conflict with itself. The right answer might be somewhere in your four hundred documents, but that doesn’t mean the chat tool will be capable of retrieving it.

2. Outputs can be inconsistent

   • Some answers need to be the same every time you ask. AI as a conversation partner is pretty low risk - it doesn’t need to ask you the same questions or provide the same feedback in every scenario. AI as a source of truth

3. Too much information can be bad

   • Knowing what to ask, when to ask it, and when to follow up with more questions is still an essential part of the decision making process. A flood of information can be just as difficult to manage as no information. We’re the dam that protects you from data overload. 

   • You don’t know what you don’t know. We act as a third party that benefits from less knowledge of your business. We want to learn as much as we can from every business owner, but we’ll never know as much as you do. That can actually be one of our strengths. We bring an objective, outside perspective that reviews what is and isn’t helping you. 

4. What if you’re not measuring anything yet?

   • The example we use most often is a coffee shop that sells specialty lattes. There are 10 different drinks, but only one button that says “latte”. You can ask ChatGPT to review your point of sale data, but if you never tracked which drinks were sold in the first place you’ll never know which ingredients to stock up on or which drink to include in this month’s promotion.

Finally, any business owner who wants to do it themselves with Claude is a rad business owner! We’re firm believers that anyone can learn anything, and part of our mission is to make every person we work with feel more comfortable using data. If your preferred AI tool can connect to every area of your business and help you make smarter decisions and put more money in your pocket every month, you’ll get nothing but support from us.