They are designed to come out. You need to use a razor knife to cut them out. I'd suggest using painter tape over the entire area, then cut out around the edge to remove the cover. That's what was suggested in the installation instructions I got with a set of Bed Rails that I ordered.