Frozen stabilization enables small unstructured neural networks to form robust continuous memories and exhibit separation of timescales without fine-tuning or symmetries.