Yes those marks. There’s no problem going lower. Half charges can be dangerous. Those marks could be from a previous loading at a higher charge, but the stuff bolt lift is likely still from excess pressure. It’s possible that you’re getting a stiff bolt lift without excess pressure due to the brass being more springy due to being fired multiple times. The result is that it doesn’t size down as small from full length sizing, and it doesn’t shrink back as much after firing. Annealing could help. As someone who doesn’t enjoy annealing all the time, I would recommend either changes brands of brass(to Lapua or Winchester) or chucking it after 3-5 reloads if backing off doesn’t fix the problem.
Shooting over a chrono could help. While it doesn’t tell you anything directly about pressure, it can still guide you in the right direction a little bit. If you’re shooting faster than the manual(after adjusting for barrel length) then you’re most likely running a higher pressure as well.