They are a small set of LED's on a board, I believe, that is integrated into the switch assembly. You end up replacing the assembly as the lights aren't a service part.
My HVAC control lights don't light up all the way...I tap on the switch and, voila! they are back on.