It will come back.
Personally, I got new clubs, i.e. replaced the starter clubs, once I made Master. It took a couple of weeks but my playing came around. Within a month, I was Tour Master.
If you really want to get your avg back down, beat higher tiered players in match play. I think that's what got me to TM faster than I could have imagined.