What do I do when the people who understand the old system are leaving?

Capture their knowledge before they go: architecture, credentials process, common failures, integrations, reports, workarounds, and recovery steps. Record demonstrations, document critical procedures, and identify a new owner. Prioritize knowledge that would be hardest to reconstruct during an outage.