I've always felt that....the more that the wheels feel like that are coming off, the more you want the wheels to stay in contact with the ground right? If you launched your car off a hill with the lugnuts loose the wheels would come off on landing!
I feel the same with your golf swing, so here's my attitude and quote by the way:
"When it doubt, punch it out."
__________________
I'm not a TGM or PGA certified Pro, but I did stay at a Holiday Inn Express last night