Librem 13 doesn't switch on at all!

Yes, I think. For me, I would boot the laptop, run some heavy workload and then the laptop would crash. After the crash, the symptoms similar to yours showed where on booting again, the power-on LED which is the rightmost of the three LEDs above the keyboard would light up for a few seconds and then the machine used to turn off again.

Overheating was definitely the problem for my machine. We thought about upgrading BIOS because when I bought my laptop, the BIOS version was close to 4.7/4.8 and had known problems with overheating. However, when the BIOS upgrade didn’t work, I sent the laptop back to Purism support and they figured it was because of the missing rubber pad.