Abstract:We propose Intelligent Schema Memory (ISM), a self-evolving memory-augmented system that improves mathematical reasoning for a frozen LLM under continual learning with hard episodic resets. ISM maintains a compact, self-refined bank of strategy schemas learned from both successful and failed episodes, with symbolic tools that check intermediate steps and certify answers. Without updating model parameters, ISM outperforms passive, retrieval, and reflection baselines on MATH-Hard and OlympiadBench, using 64% and 86% fewer schemas respectively than the strongest passive baseline. These results show that small, actively maintained, and verified strategy memories can support reliable continual mathematical reasoning under strict episodic this http URL codebase is available at this https URL .
From: Prakhar Dixit [view email]
[v1]
Tue, 30 Jun 2026 06:21:08 UTC (3,432 KB)
[v2]
Wed, 1 Jul 2026 06:02:51 UTC (3,432 KB)