Returning packages

So I had an extra package on my route yesterday and it wouldn’t let me scan it in. It said it’s already part of a delivered block to return it. I know there supposed to be returned by 10am but would I be in and real trouble if I just waited until my block later this afternoon ?