Romit Raj

Lawyer turned product manager at a privacy company. I self-host things, break them, and write down what I learn.

Two bars of the same 15.6 GB of memory. Before: the agent takes 9.4 GB while rendering a video, leaving 6.2 GB for everything else and causing a 15 minute freeze. After: a hard fence caps the agent at 6 GB, Unraid keeps 1.7 GB, 1.2 GB is protected for DNS, media and chat, and 6.7 GB is shared by everyone else.

Sixteen gigabytes and an agent that wanted ten

I should have bought RAM last year. Anyone who runs anything at home has said some version of that sentence in 2026. Conventional DRAM contract prices rose 93 to 98 percent in the first quarter of this year alone, according to TrendForce, and they are still climbing, with another 10 to 15 percent forecast for this quarter (TrendForce, 30 September 2026). Graphics cards are worse. TweakTown found the cheapest RTX 5090 in Germany listed at about $5,900 (₹5,61,000), against a list price of about $2,360 (₹2,24,000), converted at 18 October 2026 rates. The AI build-out is buying the memory, and the rest of us get what is left. ...

October 18, 2026 · 8 min · Romit Raj
Isometric drawing of an espresso group head pulled apart on two posts: a boiler and gauge at the top, a feed pipe into the group, a dispersion block, a shower screen with about a hundred holes, a portafilter with two spouts, and a cup filling below.

Pushed, not poured: the tiny holes in an espresso machine

A few days ago I got stuck on what I thought was a simple question. When you pull a shot of espresso, the hot water comes out of a metal plate full of small holes, the shower screen, and lands on the coffee as a gentle, even rain. How does water get through holes that small so neatly? I had a picture in my head for this: a bathroom shower, water sitting up top, gravity doing the work, the holes letting it dribble through. Both halves of that picture were wrong, and the real answer is a lot more interesting. ...

October 17, 2026 · 5 min · Romit Raj
Three doors on a dark floor. The left door is chained and padlocked, labelled private section 638.51 suits, closed. The middle and right doors stand open with warm light inside, labelled section 631, ECPA and VPPA, and regulators, both open.

SB 690 explainer: one door closes, two stay open

California took the most common website-tracking lawsuit away from private plaintiffs. What closed, what stayed open, and what the retroactivity clause does to the cases already in court.

October 17, 2026 · 11 min · Romit Raj
Diagram: three memories, one agent. An always-on file feeds the prompt, Honcho answers who I am, GBrain answers what we did, and the off-chat files pipeline has no path into the conversation.

What my agent remembers, and where it keeps it

Ted Lasso recommends being a goldfish. It is, he says, the happiest animal alive: it forgets everything in ten seconds and moves on. My agent took that advice. Hermes is a goldfish — every conversation starts from zero, and anything it “knows” about me is either written into the prompt or fetched from somewhere else. And for a while I was one too: it would ask me again about things we had settled a week ago, and I would explain them again, from the beginning. The difference between us is that I could do something about it. So I spent a few weeks giving it a memory. We are goldfish, the agent and I, but only one of us was going to stay that way. This is what I learned about the options, what each of them actually means, and the architecture I ended up with. ...

September 30, 2026 · 8 min · Romit Raj
The LLM cost proxy dashboard: daily token bars and a per-model cost table.

Metering what my Hermes agent spends

My agent, Hermes, talks to me on a Matrix server I run myself. Self-hosting the chat window was a privacy decision before it was anything else, and that setup is a post for another day. What matters here: an agent that chats all day needs a meter. So every LLM call it makes goes through a proxy I wrote — and “wrote” deserves an asterisk, because I’m a lawyer. An LLM helps me code things out; I mostly argue with it until it works. One SQLite file tells me what it spent today. ...

September 20, 2026 · 2 min · Romit Raj