In case anyone mis-understood my post above, I was not saying .22 is adequate for deer. I was merely mentionning that there are caliber restrictions in certain areas. To be honest, muzzle loaders had completely slipped my mind but the OP had given me the impression he was referring to cartridge weapons.
And always use eye protection when shooting.