If you use the procedure described here:
Tentative procedure to make Joplin Portable truly portable on Windows - Support - Joplin Forum
Joplin will start as fast as the installed version, as it will run exactly the same executable
and you can keep it wherever you want, as it will be truly portable
Let me know if you need any clarification on that