To use the Arduino IDE on Windows without needing to install it:
Go to https://www.arduino.cc/en/Main/Software
Click the "Windows ZIP file for non admin install" link
Extract the archive to a folder
Open the folder, and double click Arduino.exe