It will be an outdoor culture shock and social culture shock for you, I lived in New England for 22 years, and loathed most of it. Deer hunting will be tough at best, most of the "camps" up there are owned by Mass. and NY guys, and the pressure is reflective of that. NH gets pounded by the non-residents (insert "Massholes"), and VT deer hunting?? that's funny, deer in Vermont!?
Sure you can find a big buck if you work hard enough at it, and that's what you'll find: A big buck, not ALOT of big bucks....don't let others paint a rosy picture, cause it's hard freaking hunting. And comparing the Benoits to the average hunter is like comparing Mike Tyson to a high school brawler. The Benoits have been up there for generations and know every knook and cranny and what the deer do and where they prefer, etc. etc. etc....
If you move you'll have to make the best of things, find other outdoor things that fill the gap. I really got into digging shellfish (quahogs), wish I would've capitalized more on the saltwater fishing. There's also good freshwater fishing in Maine, and grouse hunting. Waterfowl hunting in New England just plain sucks unless you find a localized hot spot.
You WILL miss the open views and vistas of the west and the big wide open, but you can also get up on some mountains to get a view every now and then, but it's New England, not the Rocky Mountain West so yes it will be different.
I love it when guys post sh!t like "I've never lived there but (insert any cliché statement)"...wtf? As soon as the opener on any post starts to that affect I ignore it.
If I had a choice between living in the populated Colorado or in rural remote Maine, I'd choose the West every single time, there are so so many more outdoor opportunities out here in the West compared to the East, but that's just me.