I'd be leery of changing ammo and expecting the same POA/POI, even if it's the same grain weight in bullet. Your ballistic coefficient, powders & primers vary, as do cases. Those small variations become large divergences at hunting distance.
Practice, that's the key to accuracy with any choice of ammo. It's also why having 100-200 rounds of your preferred load on hand is a smart investment.
The best advice I've ever received on accuracy is to "remove all of the variables until you achieve the accuracy you are looking for." That means being consistent on ammo and reducing the variability between loads to me.