Picture it, Redmond, 2008. A young, naive program manager at Microsoft builds a prototype of one of the world’s first far-field, open-microphone, conversational AI assistants. Excited by his invention, he invites his engineering manager to witness the masterpiece in action. He confidently says, “Hey Xbox, channel up,” and the Xbox responds, “Got it. I’ve changed …
If you’ve followed my previous posts, you might be under the impression that I’m against large language models (LLMs). However, in the words of my mother, “I’m just kvetching!” The truth is, I’ve been a devoted fan of LLMs for quite some time and have successfully integrated them into multiple customer-facing products. So, why the …
Read more “How to Use Nondeterministic LLMs for Building Robust Deterministic Applications”
We’ve all been there. You gather your team for a meeting, you make a bunch of decisions that lead to a series of follow-up action items. Then a week goes by, you meet again and nobody remembers what on earth you decided and none of the action items have been closed out. And right there …
Read more “The Astonishing Reasons Why Your LLM is a Bad Notetaker”