community.libretranslate.com
Introducing MiniSBD: Fast sentence boundary detection
Continuing the discussion from Sentence Boundary Detection for Machine Translation - #55 by pierotofy, I’m happy to share MiniSBD, a subset port of Stanza’s tokenizer models that uses 8-bit quantized ...