Is there a good "outer case", "shelf", or some container around my librem mini?

If you want true silence you can (with a bit of work) mount it in a passive chassis: