This problem has existed for a long time since I changed mac. I can't really close all the windows of joplin. Once opened, it can never disappear from the list of opened windows. Other programs running in the background can do it, such as clash or pritunl.
I use alt-tab as window manager on mac, ref: GitHub - lwouis/alt-tab-macos: Windows alt-tab on macOS