A 3V drop over an LDO is usually reasonable with low enough currents. Some LDOs require capacitors to be stable, and it’s usually a good idea to have some capacitance on your power rails anyway.