With regular Linux servers, you can easily copy your key pair with the ssh-copy-id command. But with an AWS instance, things get a bit tricky. However, there is a way around the complication.

Replace the public key in ~/.ssh/authorized_keys on your existing instance so the attacker can no longer unlock it with their private key.