Librem mail address book

So on my Pixel3 I’ve installed Librem mail and have attached various accounts. I don’t have a Librem email account. The problem is it doesn’t seem to have any access to my address book. It has access to Contacts, but still doesn’t pull up any addresses, so I have to manually to them in. Any ideas about what I need to do?