WY non-resident points have creep so if you skip even 1 year you might not just add 1 year to when you have points to draw a unit but certainly will add 2 years and maybe even more. If you plan to hunt a unit that only takes a couple of points now then no big deal unless...Wyoming whacks the portion of tags allocated to non-residents. That topic has come up as have flipping the allocation between lower price regular and higher price special tags.
Almost every year, one of the Western states changes up the game on non-resident big game hunters. Maybe you now have to buy a hunting license to apply or they cut allocation to non-residents or you can no longer draw a cow elk tag, etc etc.
If you can afford $1500 or so in fees/licenses then continue to build points not only in WY but in AZ, CO, etc. In a blink of the eye you will be empty nesters and most likely with more money and more vacation days yet less health so at that moment will benefit by already having a pile of points in lots of states in order to draw some nice tags.
I am building points for javelina in AZ. Have not heard a lot of good things about eating them. I usually only hunt what I will eat. That said, I have never hunted one. Some day I might want to, though, and since I apply in AZ for other critters then the cost to build javelina points is not much more. I have been fortunate to harvest several different species of big game so maybe a javelina will become a pressing goal. If not, am out some cash.