That's actually not what the setting does, and I agree it is worded very poorly.
You have to use Windows to auto start Joplin. That option only minimizes the app to the tray when you "close" it. Has nothing to do with auto starting.
There was recently a thread about this...