Here is a good link to the .ZIP version of XAMPP:

https://sourceforge.net/projects/xampp/files/XAMPP%20Windows/5.6.24/

This version can be run from a folder straight out of a flash drive, for example.