Our local Hermes person is a woman who comes back in the evening if we're not in.
SWMBO was expecting something and that happened here. She saw him getting out of his van, and got ready to go to the front door. A few seconds later he was getting back in the van. He'd carded us.
She called his depot, and they contacted him. He swore blind he'd knocked several times and waited about 2 minutes.
SWMBO pointed out that we had CCTV of him running up to the door, thrusting the card into the letter box, and running back to his van.
They called him and made him drive back. He was not happy.