Just talking money, let's say you find a nice, clean older 172 for under $40,000. At that price, it's very likely to have usable working avionics, but nothing new or fancy, maybe even the original pair of navcoms, a working ADF, and a transponder. So you buy it with the idea that it's a pretty good VFR airplane and when you get your IR, for light IFR use, too. And you'd be right.
Since much of the airspace throughout the country will require ADS-B Out for any aircraft in that airspace, you decide you better get with the program. Wham! $8,000 to make it ADS-B Out compliant. Oh sure, you could dodge around the airspace, but in your part of the country, that's a heckuva lot of dodging. And you realize that that dodging is not really easy, with a sectional in your lap and only the OEM avionics in your airplane. So you get a nice iPad Mini, mount it to the yoke, get Foreflight Pro, perhaps a Stratus 2, and again you're golden. All that set you back another AMU (that's $1,000, if you're not yet familiar with AMUs, "aviation monetary units"--that's how we fool ourselves into thinking we're not spending too much on our airplanes).
But meanwhile, the FAA continues to shut down ground-based approaches in favor of GPS approaches. All the NDB approaches are fast disappearing, and the VORs aren't far behind. But they're being replaced rapidly with precision GPS approaches. So you visit your friendly local avionics shop again and ask about an IFR certified GPS, and you gag again--$15,000 installed for a new 650, maybe a couple thou less for a used 430W.
So very quickly, IR in hand, the only way you can fly your $38,000 172 in the system and actually use it regularly for IFR and go to the places you want to go to is to spend an additional $24,000.
That's exactly where I have been, except that I started with a more expensive 172 (justified by a low time airframe and lower time engine) which became even more expensive right away when the engine threw a rod, and I had to land in a field. I spent $30 AMUs, because in addition to the $23,000 engine, I had a bunch of other upgrades done at the time.
So with all that in mind, I'd recommend that you get your certificate first, learn to fly whatever you want to fly, get pretty good at it, and then start thinking about owning. I love my little airplane, and it suits me just fine, but believe me, for most pilots, renting makes much more economic sense than owning.
Cary