This is not expected. I have been running Qubes 4.0 for a few years on a Librem 13 and now on a Librem 14 for several months, and I have not had any issues connecting to my 2.4GHz or 5GHz network, each with its own SSID like yours.
I do not know enough to be able to help you solve this, but I wanted to at least answer the question of whether or not this is expected behaviour.