Of course now that I have contacted support about the issue, it hasn’t shown up again. Maybe the recent updates fixed it somehow?
For those curious of how to switch to another kernel already installed, support sent me this command: sudo flash-kernel --force 6.5.0-1-librem5
Replace the kernel version with whatever alternative you have installed.