I'm not entirely sure how the portable version works. I downloaded it and opened the JoplinPortable.exe, it opened Joplin like usual, already having my note and css from the regular installed version loaded. But yes, when I started it through the JoplinPortable.exe the issue remained.