Using Syncthing with Joplin

sttrebo · 2024-03-05T14:09:07.240Z

Webdav is a file storage service, syncthing is a file syncronization service. Depending on the webdav service, it can be fast or slow. Syncthing speed primarily depends on connection speed.

tomasz86 · 2024-03-05T18:29:49.188Z

sttrebo:

Syncthing speed primarily depends on connection speed.

Syncthing is actually very slow on Android 11+ when dealing with many small files located in a single folder (which is the case with Joplin). This is due to the how the OS deals with filesystem access through FUSE. There is no workaround. This is one of the reasons why I only sync a small Joplin profile to Android.

sttrebo · 2024-03-05T18:39:15.442Z

ah, good to know. i'm using syncthing from my android 14 phone to my synology NAS. haven't noticed any significant speed issues, but i'm not syncing a ton of files. when my target was my self-hosted nextcloud, it was definitely slower but i attributed that to nextcloud and not to syncthing.

tomasz86 · 2024-03-05T18:52:17.057Z

sttrebo:

but i'm not syncing a ton of files.

How many exactly?

In my experience, it works fine until ~1000 files in the Joplin filesystem sync folder, however once the number reaches a few thousands, then even just scanning the folder in Syncthing may take forever, especially if the Android device in question isn't a flagship. This is important because Syncthing needs to finish scanning the folder before it syncs new files into it, so the whole synchornisation gets delayed.

sttrebo · 2024-03-05T22:27:08.908Z

it's been a while, but if memory serves it was only 200-300 -ish...

Medullitus · 2024-03-08T02:00:10.554Z

Another example of how knowledge multiplies as it is shared...

Medullitus · 2024-03-08T02:01:37.956Z

Hello,

So, what do you suggest we do to achieve fast synchronization between Joplin's computer and Android versions? Is using WebDAV a solution?

tomasz86 · 2024-03-08T11:45:10.887Z

Can't really answer the question, I've only ever used Syncthing for Joplin. One big advantage of Syncthing on Android is that it can run and sync in background, meaning that even though the sync itself may take a while, it is able to run all the time, so in most cases all note-related files are already synced when you actually open the Joplin app. The app itself still needs to perform its own synchronisation with the filesystem, but that's usually quick (as long as the hardware is decent) and also doesn't even require Internet connectivity.

Medullitus · 2024-03-08T15:59:35.237Z

Thank you for your response, but I'm a bit confused. Above, you mentioned that there is also slowness with Syncthing. However, at the same time, you say that Syncthing could be a fast solution.

Let me express my question more clearly. I am currently using Onedrive, and I have around 10,000 notes. If I were to format my computer or phone and reinstall Joplin from scratch, the synchronization of around 10,000 notes with Onedrive could take hours, maybe even days. If I were using Syncthing for synchronization, how would it be different for me?

HarSel · 2024-03-09T13:18:17.890Z

I'm using WebDAV from my Synology NAS to a bunch of Android devices. About 3000 notes (9000 files) and on most devices it's taking around 6-7 seconds. Everything from a super-slow Tab A8 to a more recent (but still antique in this field) Tab S7+. The initial sync of each device can take many hours due to the >35000 "resources" involved but after it's done it works perfectly.

Medullitus · 2024-04-14T17:03:45.624Z

HarSel:

I'm using WebDAV from my Synology NAS to a bunch of Android devices. About 3000 notes (9000 files) and on most devices it's taking around 6-7 seconds. Everything from a super-slow Tab A8 to a more recent (but still antique in this field) Tab S7+. The initial sync of each device can take many hours due to the >35000 "resources" involved but after it's done it works perfectly.

If you also add that getting a high-end NAS device and monthly server rental are necessary for this solution, then people who cannot afford these things will not bother researching your method in vain.

sttrebo · 2024-04-14T17:55:29.790Z

Most low to midlevel nas devices are fine (as long as you can install a webdav server on it). Going this route, you do not need any other server rental.

HarSel · 2024-04-14T17:58:01.322Z

A $300 NAS is all it took. I don't know what server you refer to but none is needed. I later upgraded the NAS but the initial investment worked perfectly and I didn't have to put all my notes out on a public platform like the internet.

Medullitus · 2024-04-14T18:10:11.179Z

@HarSel @sttrebo

Can you set up a server using the NAS device linked below, for example?

zyxelguard.com

Zyxel NAS326 2-Bay Cloud Storage NAS | ZyxelGuard.com

The Zyxel NAS326 2-Bay Cloud Storage NAS.

LeoW · 2024-04-14T19:54:25.275Z

I'm using a truenas scale server with an instance of Joplin server on it.

Very fast.

Tailscale vpn for internet connectivity.

Medullitus · 2024-04-14T20:03:21.390Z

LeoW:

I'm using a truenas scale server with an instance of Joplin server on it.

Very fast.

Tailscale vpn for internet connectivity.

Thank you, my dear friend. By the way, I'm looking forward to the video you'll make.

LeoW · 2024-04-14T20:07:07.012Z

@Medullitus,

Please refresh my memory. What video topic are you interested in?

Medullitus · 2024-04-14T20:17:01.311Z

I meant this post of yours:

Evernote user since 2011 with a lot of data, I'm considering switching to Joplin but need reassuranc Lounge

It looks like I get a reprieve from having to make the video and you get a reprieve from having to install the windows subsystem for Linux. When I first started using Joplin only the Linux client could import folders. The windows app did not. I have since learned today that the windows client can now import folders too. so, never mind. From the docs: Joplin import_export you can either import a single file or a directory that contains multiple ENEX files. If you import a single file, a note…

HarSel · 2024-04-14T21:27:54.088Z

They claim it has a WebDAV server application so it should work as long as it is compliant with the WebDAV specs. They no longer make it so if there's a problem there likely wouldn't be any support.

LeoW · 2024-04-14T22:04:22.298Z

What specifically are you referring to for software that has a built-in webdav server?

Rclone/Roundsync can both serve files over the network using the webdav protocol. I haven't personally tried it but I will put it on my to-do list.

In theory you should be able to share your PC files from Joplin using rclone for windows serve feature.

Until I test it I can't say whether or not the Android client for Joplin can select webdav as it's synchronization choice and have it work. After Wednesday when my schedule frees up, I will try it.

I have only used http file serving to date.

I just turned my phone into a webdav server and was able to map a drive to it from Windows, so perhaps Joplin will work too.

You would probably want to turn your PC into a webdav server, and then tell your mobile joplin to use webdav sync to the PC. I will test this after wednesday.

These options should work for those who absolutely don't want to put their files on a Cloud Server. A Cloud Server is easier and available 24/7 from all of your devices.

roundsync_webdav3840×86 46 KB