I'd throw another battery in it. I've seen batteries with bad cells still show proper voltage but have no load capacity. Also you should be reading more than 6 volts on a fully charged battery.
ETA: 12V auto batteries typically run around 12.7 volts and a brand new fully charged one will be a little over 13 volts. You may just need to charge that one, but I think it's low or dead.