That would work also. Use a larger drill bit such as a 3/8". Drill just deep enough to remove the rivet head. If you drill just a little to far you would drilling into the part that is going to be thrown away. Then use a punch to knock the rest of the rivet out.Wonder if I drill down thru the head a little ways. My chiesel might work then.