Don't know if AVP has webxr support, but that'd be a good way to get it onto quest and other existing VR devices quickly. There's already some demos out there focusing on putting three.js views into VR.
Using passthrough to align the direction and angle would be cool too, by lining up the moon/horizon through the camera or something.