winpt-0.4.0-installer.exe contains both GnuPG and WinPT ready to install in Windows 95/98 NT 2000 XP.

WinPT is a Windoze utility that sits on the taskbar. In the Windoze Clipboard, you can encrypt, sign, decrypt and verify data. You can also import and export keys to the Clipboard.

See http://www.winpt.org/