You could try DisplayLink as a compromise. But there are limits and drawbacks (closed protocol, partly closed source/ blob, didn’t work with wayland, no idea how it works with bullseye).
Update: