Equal and opposite reaction dictates that the gasses and unburned powder accelerating forward are going to cause the gun to accelerate backward.
Handy calculator here: http://www.shooterscalculator.com/recoil-calculator.php
Of course "felt recoil" is going to be a combination of factors, but there's no doubt powder weight affects recoil.