Well, Garmin seems to be at the top of their game, according to many GPS enthusiasts I've spoken with. Get a little hand-held one. Prices vary, so it depends on what bells and whistles you want on it.
I have a very basic one that is water resistant (although I wouldn't dunk it on purpose). No color on the screen. No additional software (yes, an add-on). Garmin Etrex Legend. Wish I had color.
Mine works, but it's not very effective, just raw out of the box, like it is.
I can pull up Google Maps on my pc, right click, and select "Directions to here", and a side window opens up with the the coords in decimal format. Now I pull up this website:
http://www.csgnetwork.com/gpscoordconv.html and convert each piece of the coords (N and W, one at a time) to the proper format for my unit. From there, I enter the data into it and it will show me how far I am from it, straight line.
Maybe there's a shortcut to all of that, but I'm self taught (that's code for retarded).

This is a hassle, but it helps a lot if your mountainside doesn't look like you thought it would from the map (always).
The best thing to do, and I can vouch, is to get some mapping software (anywhere a GPS is sold) and you'll have everything you need. It's around $100 and the price does not drop EVER. I've been holding out, but it's still the same price, 2 and 1/2 years later.
Also, you may want a color screen. Mine isn't and the color ones are easier to see and read.
Most units will have plenty of other options for recording your tracks, speed, mileage, etc.
Expect to pay at least $250 for a decent unit and the software. Shop online and get better deals on the unit, itself. They're not cheap, so shipping should be free. I think mine was $116.00.