Large Universe Model/Essays/The companion problem
EssayThe companion problem
The most valuable personal application of continuous attention is also the one that should make you most careful.
What continuity offers a person
The gap between an assistant and a colleague is not intelligence. It is that one of them was there in March.
A Large Language Model helps with whatever you bring it and begins each conversation from nothing. It does not know what you decided, what you have been avoiding, or that the assumption behind your current plan stopped being true last week.
A Large Universe Model holds that between conversations. The three things this makes possible are genuinely hard to do unaided:
Honest project state. Which of your commitments are actually moving, as opposed to formally open.
Reconciliation. What you agreed to, against what your calendar and inbox show happening.
Returning to decisions. You chose something in March for stated reasons. Two of those reasons are no longer true, and nothing in an ordinary life is structured to tell you.
That last one is the strongest case for personal continuity and is impossible without persistence.
What it costs
Ingestion of a life. Calendar, correspondence, health, finances, reading. The value comes from breadth, which means the uncomfortable answer to "how much should it see" is "as much as possible" — and that has to be weighed honestly rather than waved past.
A model of you that persists. A belief state about a person is a durable artefact. Where it lives, who can read it, what happens to it in a dispute or an acquisition are questions with real answers that mostly have not been given.
Being told the truth. A system that maintains an honest picture of your commitments will surface things you have been successfully avoiding. This is the point and it is not always welcome.
The restraint requirement
A companion that comments continuously is worse than none. The trigger has to be a confident belief breaking — not activity, not thresholds, not a daily summary. See the alert that nobody reads.
The honest position
The personal application is the one where the technology's value and its intrusiveness are the same property. Continuity is what makes it useful, and continuity is what makes it a surveillance system pointed at one person by their own choice.
That trade is defensible when the person makes it knowingly and controls where the state lives. It is not defensible by default.