Look at it as an investment that you get the added benefit of recreating on. Instead of stocks or bonds, own some real estate. Are your other investments just for you? You might not make quite the same return on recreational land as on equity investments but you might be able to come close.
I'm having to deal with this right now, the land I bought in 2007 that I told the wife was an investment just got an unsolicited offer of over 4 times what I paid for it. It is well over the current market price because of it's proximity to an electric substation that was built 4 years ago. To be true to my word calling it an investment, I'm going to sell it. BUT I'm going to reinvest that money (plus some more) into another piece of "investment" property.