More specifically, LEDs need to be current limited, usually with a series resistor. In some cases (like the HF lights) this is accomplished using the internal resistance of the battery. I've seen the same with the little coin-cell keychain lights (the battery is stuck between the LED leads, the switch is a little bit of plastic that holds one of the leads away from th battery).
The LED itself regulates voltage. That's what a diode does.