Choose/change language in voice typing (Android)

Operating system

Android

Joplin version

3.4.7

What issue do you have?

TL;TR. Is it possible to change language which is used for voice typing (in general or just for one session) to be different than default language set in General → Language?

Longer version.

Recently, I've discovered voice typing in Joplin. It works really nice, but I have one problem with it.

I have language in my Android (and Joplin) set to English and voice typing in English works with automatically downloaded model. However, usually I want to take notes in Polish and when I speak Polish... it is understood correctly, but translated into English (pretty well) and written in that form. I would like to keep written notes in Polish (but still have Joplin language set to English for consistency with the other Android apps). Is it possible to choose it globally (just for voice typing) or per "voice typing" session?

I've noticed that when I speak English it translates the text into french as well, but not always. @personalizedrefriger is it expected that it translates to the language of the app?

It's expected that voice typing tries to transcribe in the language of the app—Joplin currently sets the voice typing transcription language to the app language (see: code: sending the language code to whisper.cpp, code: sending the locale to the native module).

The library Joplin uses for voice typing (whisper.cpp) does have an option to auto-detect the input language. If I recall correctly, language auto-detect was kept disabled due to poor performance during testing. However, 1) Joplin originally used a much smaller Whisper model, this might be less of an issue with the voice typing model Joplin currently uses 2) this option doesn't seem to have been evaluated in the Whisper comparison notebook.

Based on this, it could make sense to:

  • Evaluate how much the language auto-detect option impacts transcription accuracy (for test data in several different languages).
    • If the language auto-detect option doesn't significantly reduce transcription accuracy for the current app language, enable language auto-detect by default.
  • Add a setting to allow users to change the transcription language. This setting might include "Auto-detect" and "Match application" options.
1 Like

Sound good. @personalizedrefriger Should I create a feature request(s) with your proposals on GitHub?

(I missed the email notifications about your reply…)

Should I create a feature request(s) with your proposals on GitHub?

I've done that here:

1 Like

Cool, thanks!

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.