The agent memory problem.

An agent can forget something useful. It can also remember something wrong for a very long time. Both belong in the design of memory.

What is agent memory?

Agent memory is information retained beyond the immediate task and made available to influence later agent behavior. It can include facts, decisions, instructions, interaction history, or reusable lessons.

That definition contains two distinct decisions: what to retain, and what to let influence the next task. A system can be good at the first and still make poor choices about the second.

A context window carries information into a model invocation. A memory system preserves and selects information across invocations. Increasing the window does not by itself settle provenance, currentness, access, or usefulness.

Persistence preserves mistakes, too.

An instruction may have been correct for a previous API, customer policy, or project structure. Persistence lets the agent reuse it after the circumstances change. Retrieval can make the problem worse by ranking the familiar instruction highly.

The issue is not that persistent storage is undesirable. It is that storage does not supply a lifecycle. A memory needs a way to be reviewed, revised, scoped, expired, or withdrawn.

A practical design asks who authored a memory, what source supports it, when it applied, which principal may see it, and whether its guidance should still be active. These questions belong alongside recall quality.

Relevance and usefulness are different measurements.

Retrieval asks which stored information matches the current query or task. A highly relevant memory can still be stale, misleading, or counterproductive. A retrieval score does not establish what would have happened without it.

Similarly, observing that a memory appeared in successful tasks can be confounded by task selection. The memory may be used only on easy work. Or it may look bad because it is retrieved for the hardest tasks.

A controlled comparison can address a more specific question: for the eligible task population and experimental design, how did outcomes differ when this memory was delivered or withheld? The answer remains conditional on reliable assignment and outcome collection.

Close the loop around future work.

UniMem connects persistent memory to randomized eligible-memory holdouts and recorded task outcomes. It checks trial integrity before interpreting effects and distinguishes evidence from insufficient data.

The integration must deliver only the admitted, non-withheld memories and record every assigned task’s final result. If failed tasks disappear from the dataset, an apparently favorable effect can be misleading.

Governance completes the loop: configured harm withdrawal, content-bound lesson review, and separate promotion and rollback workflows provide ways to act on evidence. None of these turns arbitrary remembered text into verified truth.

UniMem measurement implementation

Start with a smaller, better question.

Instead of asking whether an agent “has memory,” choose one recurring workflow and one type of remembered guidance. Decide what success means, what may be withheld, and which rules must stay protected.

First verify persistence and recall. Then verify the feedback path. Only then ask whether the guidance improves outcomes. An honest answer may be that more observations are needed.

The objective is deliberate continuity: preserve experience, inspect its influence, and retain the ability to reconsider it.

Put experience to work.

Try the local loop, or bring one workflow to a pilot conversation.

Technical details link to the inspected source. Check deployment requirements before enabling optional features.