If you want to jailbreak a lower firmware version you can find the appropriate tutorial here.
Create a folder on your desktop called Pwnage
Download the latest RedSn0w from here and place it in the Pwnage folder. Likewise, download the 5.0.1 firmware from here and place it in the Pwnage folder. (Note: you do not need to download the 5.0.1 firmware if you are already on iOS 5.0.1)
Extract the RedSn0w zip file by double clicking it.
Step Two: (Skip this step if you're on iOS 5.0.1 already)
Connect your iPod to the computer and launch iTunes.
Select your iPod from the list of devices on the left. Now hold down Option and click the Restore button. Restore is preferred as it won't create any wasted space on your iPod.
Navigate to the Pwnage folder on your desktop and select the 5.0.1 firmware ipsw. Click the Choose button to continue.
iTunes will now update your iPod to the new firmware.
Launch the redsn0w application from the redsn0w folder we extracted earlier.
Once RedSn0w opens click the Jailbreak button
Plug your iPod into the computer and make sure its OFF then click the Next button
RedSn0w will now guide you through the steps to get into DFU mode. You can find more help with DFU mode here
Hold down both the Home button and the Power button for 10 seconds.
Release the Power button and continue holding the Home button until RedSn0w detects the device.
Your iPod will now reboot
RedSn0w will prepare the jailbreak data.
Select Cydia from the list of options and click Next.
Your iPod will now be rebooted again and RedSn0w will begin uploading the new RAM Disk and Kernel.
Once this is complete you will be notified that RedSn0w is done. When your iPod finishes rebooting (5 minutes or so) it will be jailbroken with Cydia on the SpringBoard.
*As usual a big thanks to the iPhone Dev-Team, Chronic Dev-Team, pod2g, and Geohot for their hard work and contribution to the iPhone community.