Several outlets are reporting it with this preposition. I'm not in the habit of reading about rowing so I don't know what's standard, but it seems to me that one "rows across" any distance at all. The OP said where she started and where she finished, so it's quite clear she didn't row to Japan.