What my agent remembers, and where it keeps it
Ted Lasso recommends being a goldfish. It is, he says, the happiest animal alive: it forgets everything in ten seconds and moves on. My agent took that advice. Hermes is a goldfish — every conversation starts from zero, and anything it “knows” about me is either written into the prompt or fetched from somewhere else. And for a while I was one too: it would ask me again about things we had settled a week ago, and I would explain them again, from the beginning. The difference between us is that I could do something about it. So I spent a few weeks giving it a memory. We are goldfish, the agent and I, but only one of us was going to stay that way. This is what I learned about the options, what each of them actually means, and the architecture I ended up with. ...