Alternatively, if you have two flash drives, you could boot an installer on one flash drive, and install it onto the second flash drive. Then you can make permanent changes to the Linux install, but still remove the flash drive to "undo" any changes to the PC