On PC/macOS, you can enable safe mode by holding down shift when starting the game. On Android, hold the launch button instead.
A popup will be shown to confirm your intent, like the one shown below.
Once in safe mode, you can open the Geode menu and manage your mods as needed.