The problem is in software. Big developers don't want to make games for a niche market. Hardly anyone does anymore. Without much new stuff to play, people who aren't on social VR platforms get bored and just go back to regular games.
The Meta VR game exclusivity thing doesn't help either.