In general, the fewer grains a bullet has, the less recoil one will feel.
Just agreeing with you.Just purely from an action/reaction standpoint, I would think the more mass being propelled the more recoil there would be; lighter slugs should result in less recoil.