EDUCATION & TRAINING
Brute-Force Retrieval Holds Through 5,000 Memories. Then It Doesn't.
Dev.to Machine Learning
About This Tutorial
The last post I wrote measured how long it takes to query my Linux box's memory from my Mac over a WireGuard mesh. The answer was about 20 milliseconds, plus or minus a few for Tailscale jitter, stable across sizes from 10 to 500 entries. That ended with a sentence I should not have left there without testing: "the linear scan over a few hundred vectors is negligible at this scale." That is true at a few hundred. The honest follow-up question is the one I had skipped. At what scale does it stop being true. I knew the rough shape of the answer.