After months of struggling with compute shaders and metal API trying to bake indirect illumination, I took a look at the light volume lump in the Q3 BSP format
This looks like a much easier solution than trying to make a ray tracer for HD lightmaps, and I hate that it took this long to look into