How do I measure whether an automation is actually working?

Measure the business result that mattered before automation, such as time, errors, response time, missed work, or completion rate. Compare it with the old process and include the time people spend fixing or monitoring the automation.