Went into a rabbit hole and found this: https://github.com/notune/android_transcribe_app
Solid app that uses Parakeet V3.
With these random apps on the internet I am always a bit sceptical. Checked it with adb and it is really fully local. I now have a voice keyboard that is a lot better than Google's and has local multilanguage support. I am stoked :)