Unfortunately, this seems to not be possible due to:
You cannot fully run JoplinPortable from your USB stick (it will always copy itself in USERNAME\AppData and use USERNAME\.config\joplin-desktop as path for the files), or have those issues been solved?