Using Syncthing with Joplin

tomasz86 · 2024-03-05T18:52:17.057Z

sttrebo:

but i'm not syncing a ton of files.

How many exactly?

In my experience, it works fine until ~1000 files in the Joplin filesystem sync folder, however once the number reaches a few thousands, then even just scanning the folder in Syncthing may take forever, especially if the Android device in question isn't a flagship. This is important because Syncthing needs to finish scanning the folder before it syncs new files into it, so the whole synchornisation gets delayed.

sttrebo · 2024-03-05T22:27:08.908Z

it's been a while, but if memory serves it was only 200-300 -ish...

Medullitus · 2024-03-08T02:00:10.554Z

Another example of how knowledge multiplies as it is shared...

Medullitus · 2024-03-08T02:01:37.956Z

Hello,

So, what do you suggest we do to achieve fast synchronization between Joplin's computer and Android versions? Is using WebDAV a solution?

tomasz86 · 2024-03-08T11:45:10.887Z

Can't really answer the question, I've only ever used Syncthing for Joplin. One big advantage of Syncthing on Android is that it can run and sync in background, meaning that even though the sync itself may take a while, it is able to run all the time, so in most cases all note-related files are already synced when you actually open the Joplin app. The app itself still needs to perform its own synchronisation with the filesystem, but that's usually quick (as long as the hardware is decent) and also doesn't even require Internet connectivity.

Medullitus · 2024-03-08T15:59:35.237Z

Thank you for your response, but I'm a bit confused. Above, you mentioned that there is also slowness with Syncthing. However, at the same time, you say that Syncthing could be a fast solution.

Let me express my question more clearly. I am currently using Onedrive, and I have around 10,000 notes. If I were to format my computer or phone and reinstall Joplin from scratch, the synchronization of around 10,000 notes with Onedrive could take hours, maybe even days. If I were using Syncthing for synchronization, how would it be different for me?

HarSel · 2024-03-09T13:18:17.890Z

I'm using WebDAV from my Synology NAS to a bunch of Android devices. About 3000 notes (9000 files) and on most devices it's taking around 6-7 seconds. Everything from a super-slow Tab A8 to a more recent (but still antique in this field) Tab S7+. The initial sync of each device can take many hours due to the >35000 "resources" involved but after it's done it works perfectly.

Medullitus · 2024-04-14T17:03:45.624Z

HarSel:

I'm using WebDAV from my Synology NAS to a bunch of Android devices. About 3000 notes (9000 files) and on most devices it's taking around 6-7 seconds. Everything from a super-slow Tab A8 to a more recent (but still antique in this field) Tab S7+. The initial sync of each device can take many hours due to the >35000 "resources" involved but after it's done it works perfectly.

If you also add that getting a high-end NAS device and monthly server rental are necessary for this solution, then people who cannot afford these things will not bother researching your method in vain.

sttrebo · 2024-04-14T17:55:29.790Z

Most low to midlevel nas devices are fine (as long as you can install a webdav server on it). Going this route, you do not need any other server rental.

HarSel · 2024-04-14T17:58:01.322Z

A $300 NAS is all it took. I don't know what server you refer to but none is needed. I later upgraded the NAS but the initial investment worked perfectly and I didn't have to put all my notes out on a public platform like the internet.

Medullitus · 2024-04-14T18:10:11.179Z

@HarSel @sttrebo

Can you set up a server using the NAS device linked below, for example?

zyxelguard.com

Zyxel NAS326 2-Bay Cloud Storage NAS | ZyxelGuard.com

The Zyxel NAS326 2-Bay Cloud Storage NAS.

LeoW · 2024-04-14T19:54:25.275Z

I'm using a truenas scale server with an instance of Joplin server on it.

Very fast.

Tailscale vpn for internet connectivity.

Medullitus · 2024-04-14T20:03:21.390Z

LeoW:

I'm using a truenas scale server with an instance of Joplin server on it.

Very fast.

Tailscale vpn for internet connectivity.

Thank you, my dear friend. By the way, I'm looking forward to the video you'll make.

LeoW · 2024-04-14T20:07:07.012Z

@Medullitus,

Please refresh my memory. What video topic are you interested in?

Medullitus · 2024-04-14T20:17:01.311Z

I meant this post of yours:

Evernote user since 2011 with a lot of data, I'm considering switching to Joplin but need reassuranc Lounge

It looks like I get a reprieve from having to make the video and you get a reprieve from having to install the windows subsystem for Linux. When I first started using Joplin only the Linux client could import folders. The windows app did not. I have since learned today that the windows client can now import folders too. so, never mind. From the docs: Joplin import_export you can either import a single file or a directory that contains multiple ENEX files. If you import a single file, a note…

HarSel · 2024-04-14T21:27:54.088Z

They claim it has a WebDAV server application so it should work as long as it is compliant with the WebDAV specs. They no longer make it so if there's a problem there likely wouldn't be any support.

LeoW · 2024-04-14T22:04:22.298Z

What specifically are you referring to for software that has a built-in webdav server?

Rclone/Roundsync can both serve files over the network using the webdav protocol. I haven't personally tried it but I will put it on my to-do list.

In theory you should be able to share your PC files from Joplin using rclone for windows serve feature.

Until I test it I can't say whether or not the Android client for Joplin can select webdav as it's synchronization choice and have it work. After Wednesday when my schedule frees up, I will try it.

I have only used http file serving to date.

I just turned my phone into a webdav server and was able to map a drive to it from Windows, so perhaps Joplin will work too.

You would probably want to turn your PC into a webdav server, and then tell your mobile joplin to use webdav sync to the PC. I will test this after wednesday.

These options should work for those who absolutely don't want to put their files on a Cloud Server. A Cloud Server is easier and available 24/7 from all of your devices.

roundsync_webdav3840×86 46 KB

HarSel · 2024-04-14T22:31:33.225Z

LeoW:

What specifically are you referring to for software that has a built-in webdav server?

It was the Zyxel NAS326 mentioned in an earlier post. I use Synology myself.

HarSel · 2024-04-14T22:56:39.419Z

LeoW:

A Cloud Server is easier and available 24/7 from all of your devices.

I'm a toy lover and have over 10 "devices" if you count Android phones and tablets and a couple of Windows laptops. I have only 2 devices (phones) that have access to the cloud. None of the Android things even have Google accounts on them. So, my devices have 24/7 access to my local network only. One PC connects to the internet by tethering to a phone. The rest are quite happy to remain offline. I tried SyncThing to keep other than Joplin files consistent across devices but never had much luck with it. The NAS cured that issue and everything now keeps itself in sync with the NAS.

btw. I'm retired so these things really are just toys.

LeoW · 2024-04-14T23:09:00.781Z

And if you are not technically Savvy enough to install a network attached server or you just want to keep it simple with a PC and a phone you can probably use and I'm not going to say yes until I test it, rclone to turn the PC into a web dev server and you can install it as a service so that it runs automatically when the computer boots and you log in so you don't need to interact with it at all and then your phone can run Roundsync which is rclone on Android. You configure it to connect to the PC using the webdav protocol.

Then, you can either choose to synchronize on Demand by running roundsync and clicking the sync button or you can schedule it to run every 15 minutes or every hour or however often you want it to.

This is a simple solution for somebody that only wants to have their PC in their phone talk directly to each other without the cloud or a server.

I'm going to test this to make sure after Wednesday this week.

It's another toy to play with.

If you get bored you can give it a try even though you don't need it. It would just be for the heck of it.

For off the network synchronization between my phone and my computer and my Nas I use tailscale VPN peer-to-peer Mesh networking which is free.

no matter where I am my phone has direct access to my computers at home over an encrypted connection that does not require me to open ports on my router. Tailscale took no more than 15 minutes for me to install and configure on my phone and two computers. Actually three because of it's on my Nas too.