Those are very good questions!
For essential equipment on a liveable budget I suggest buying a
used rifle in a versatile caliber ... like this WWII 30-06.
View attachment 216341 Other good all round calibers = .270 and .300 Win. You'll never have trouble finding ammo for those (present freaky context excluded). Though I could easily afford a new truck for every day of the week, I drive a 1999 GMC Jimmy with 300K miles. That soccer mom outfit cost me four grand used thirteen years ago and it's maybe the best investment in outdoor gear I've made to date. Economical and tough. I have spent a lot of money on my hunting dogs. If you get into bird hunting you'll see why. Also no better investment for your mental health (Labs are a great chick magnet!). Check the Goodwill and Salvation Army stores for hunting clothing. Last year I found a brand new Remington 4-in-1 RealTree camo pattern hunting jacket, tags still on it, for $35! Someone's Christmas gift that didn't fit. Those stores always have a good selection of used binocs and digital cameras dirt cheap. Your money goes to charity too. I see good GPS units in pawn shops going for almost nothing these days (from people upgrading to smart phone apps instead). Best advice I can give to someone starting out, especially on a budget, is don't get hung up on the "stuff." Use your money for experiences.
Speaking of experiences ... I am a lifetime loner. Hunting alone is not without its drawbacks (nearly fatal on a number of occasions) but I find it much more rewarding. It's just me against/with the elements. No other artificial interference. I love the outdoors to pieces and am happiest when I am closest to Nature. The school of hard knocks is not the easiest way to go but when you get there, the satisfaction of knowing you've done it on your own is satisfying beyond words. Be a problem solver not a timid sheep following a herd or herder. Good luck!