How do I keep a person in the loop for unusual cases?

Create explicit review points for cases that are uncertain, high-risk, or outside normal rules. Show the reviewer the relevant data, proposed action, and reason it was flagged, then record the decision.