One thing you should consider doing if you especially love the outdoors is moving to a place such as Wyoming or Colorado or New England, where there is lots to do outdoors during the summer, and where there is skiing to do in the winter; in such places, you will have no problem finding a job during the warmer months as a guide (either a guide for hiking, or for climbing, or for whitewater rafting, or for any of a number of other things), and during the winter, you can work at one of the local ski resorts!
If you are wanting to get out of the country for your adventure - especially if you are wanting to get into some warmer weather - another great idea is to look for job opportunities in a place where you can help people to get outfitted for the vacation they are about to embark upon. As you attempt to make connections in a place such as the Virgin Islands, you should be able to land yourself a job doing exactly this - living on the beach, on an island, where you can hang out and relax in the evening, and where you can work closely with tourists during the day to get them ready for day trips on the water, or for week-long vacations away from the shore!
And of course, there is no greater adventure for some people than moving around the country and seeing lots of different things; if you have ever felt this way yourself, look for jobs (such as being a pilot driver for wide loads, or being a flight attendant) that will allow you to get paid for traveling all over the country!