You shouldn't need to do anything, just modifying and restarting Joplin should be enough.

You are definitely killing Joplin completely aren't you? It isn't just closing and going to the system tray?