Joplin Server pre-release is now available

Two things: Yes, you need a reverse proxy configured, because you want to access everything via http(s), even in your local LAN. Secondly (based on the previous point), the APP_Base_URL has to be without the port, maybe take a look at this thread.