I think the key detail left out in my post was I was thinking about where I live, Colorado. I wasn't implying that public land makes it impossible to watch a buck grow, but consider this here in Colorado:
1.) The majority of people live far from their hunting spot.
2.) In many units, you won't get a tag every year.
3.) You cannot hunt every season - you have to pick your weapon/season.
4.) The seasons are generally short. Archery is 5 weeks. Rifle seasons are 5-9 days.
5.) The home range of most western game is far larger than a whitetail, plus most migrate.
This is a huge contrast to some states where you can essentially hunt the same animal from Mid-August to January.
Is it still possible? Sure, and there are some circumstances that increase the possibility. For example, someone might have access to a piece of public that's landlocked by private.
Its still very cool when you can do that, and I applaud those that make it happen!