I say go for it and don't be discouraged. Just over four years ago I started flying for pretty much the same reason as you are talking about. My drive to and from work was 7 hours and its 2.5 flying (@145mph). I've made that same commute monthly, sometimes weekly, for the last four years (having similar flexibility to your work schedule), and getting shut down or having to turn back has been rare. Aside from thunderstorms/turbulence/IFR conditions, I'd say the main thing you need to prepare to deal with is the density altitude in NM, oh yeah and thermals haha. I learned to fly at 1100' msl and fly in/out of the ranch (work) at roughly 5000'msl, in the summer DA's are 7-9K and boy did I show up fully ignorant when I started flying in the higher density altitudes in the summer. Plan wisely, trust your guts, respect the weather, and go for it. When I was starting out all kinds of naysayers told me I couldn't/shouldn't learn in a tailwheel, especially a 180, thank goodness I didn't listen to that advice. If flying wasn't an adventure, that would really suck IMO
You should read Contact Flying by Jim Dulin (bcp member), he has some good information that will help you out flying in the Desert mountains of the Southwest. Let us all know how it works out for ya.