Does canceling an invoice also credit the credit card on file? We do not want to have to reprocess payment.

Cancelling or stopping payments does not refund the credit card on file. Go to Store > Transactions, then click on the specific receipt. Select the red Refund button at the upper left of the receipt.