Inserts are the main downside of any micro diameter (4mm/.166") arrow.
Because standard field point/broadhead threads (8-32) are too large to fit inside a micro diameter shaft, a "half-out" style insert must be used (if you want to stick with 8-32 thread components). A micro diameter half-out by necessity leaves the point/head cantilevered far out in front of the arrow shaft, which makes the half-out more prone to bending or breaking on hard and/or angled impacts. I've also heard of folks having trouble maintaining good alignment with the shaft when installing multi-piece half-outs (like Black Eagle's FOCOS system).
If you're willing to switch to "Deep Six" (6-40) threaded points/heads, you could use a hidden insert (HIT). A HIT sits fully inside the shaft, keeps the point/head closer to the shaft, and will withstand hard/angled impacts better than a half-out. However, there are very few options for Deep Six broadheads.
IMO the supposed juice of a micro diameter arrow (better penetration, less wind drift) isn't worth the squeeze (higher cost, insert dilemma).
A standard diameter (6.5mm/.245") shaft of moderate gpi (like your Black Eagle Outlaws) is my go-to recommendation for a hunting arrow. Such shafts are strong, relatively inexpensive, and compatible with good ol' simple flanged inserts. If you're wanting to go a bit heavier, just add screw-in weights behind the insert.