Yes, you can go to the Arena page and cancel the challenge you have sent to your opponent.