If those are considered by the package to be configuration files then they are still there because you did apt remove ... rather than apt purge ...
You should be able to apt purge ... even after a package has been removed.
Maybe check the package name and status with
apt list | grep '^linux-image-.*-librem5'