I fitted out our Wayfarer World, I beefed up on the backing washers on the bolts and was able to put a broader plate in that went over both bolts and had much wider support.
Perhaps similar is possible on your boat? If so I would say it’s ok to fill the old holes – clean them out thoroughly, then fill with epoxy. Drill out new holes.
Bob