Here is an all-in-one solution for a portable WordPress. The creator packs MySQL, PHP, Apache and WordPress together and allows you to drop this folder onto a thumbdrive or network share, etc. It’s nice and small (<30MB) and works well.
WordPress Portable: http://wordpress-portable.webnode.com/
It also gives you a system tray icon with a right click context menu.