If your hardware is capable, it's always worth it to run a 64-bit kernel. It's faster, more secure, and has less limitations. Whether 64-bit userspace is useful to you, that depends on many things: do you have programs that need more than 4gb RAM, or heavily use the cpu, etc.