The part is there to prevent rattling. Cut a small strip of silicone tape and wrap it around the metal part where the rubber used to fit.
Thank you John for your suggestion.Just noticed one of my rubber pieces abandoned ship sometime in the last 1000 miles, I ended up wrapping the tab with Frog tape, the green masking tape, since I didn't have any silicone tape. We will see how long it lasts. At least it is wiggle free now.
Another alternative would be some High Temp RTV.