First win: lazy parsing + binary search.
A source map is a list of lines, each with mappings sorted by column. The old approach decoded every line upfront, all 110K of them.
By only decoding the line you ask for and halving the search space, it's only ~17 steps instead of 3000.