I get about 40-50 hours a year IFR as a professional pilot in the Corporate world of flying. (I'm not breaking any records either.) Before I became a pro pilot, I seldom used it and was way out of currency, but I had many days the weather was marginal VFR, and I knew I could keep the vertical stab up, (except for a Bananza V tail) and call ATC for some help.
Now I recommend low time IFR pilots set their own minimums to low VFR regardless of approach mins, till they feel comfortable. I also recommend a second pilot or auto pilot.
It is pretty exciting to spend an hour in the clouds, and break out with the runway in front of you.
I wouldn't blame you for paying off your plane early, or flying more. If you do that, put a little money up for some dual from a CFII for some basic instrument training.