Is there a good "outer case", "shelf", or some container around my librem mini?

Hardware
2

You can put it on a sound dampening matt or put it in a box where you have covered the inside with sound dampening:
https://www.amazon.com/sound-dampener/s?k=sound+dampener

You also might be able to find a quieter fan to replace the stock fan.