I have at least more than 700 notes, and it takes a lot of time to sync them, much more than from onedrive or another provider.
I have 3TB of space, almost unlimited traffic, and it takes a lot of time.
Can you improve speed for this upload and download on Windows 11, Android and Debian?
How do you sync with Mega S4? With the S3 sync target?
Yes. As s3 in joplin
700 notes is not a lot depending on the size of notes.
I just uploaded an 85 mb video file in a note to Backblaze which is S3 compatible. It went fine.
Verifying speed issues with Mega S4.
I use/sync Joplin with Backblaze B2, which is also S3 compatible.
I would set up a test for your scenario with mega if I could but I would have to pay for a month of storage.
One thing that would be good for you to do is test your speed of uploading and downloading files to your S4 storage using another method as a way of determining where the problem is.
I normally do this using a cloud drive mounting utility called rclone. Rclone can mount S3 style storage as a drive letter in Windows or a folder in either windows or Linux. There is an app for Android also. Start with a Desktop.
Here is the download/install for rclone for Linux. There are other options too.
Here are the optimal rclone settings.
If you get very good performance using Rclone I can assist you in configuring your Joplin to use Rclone to synchronize your data to your storage on each platform.
Great that you got it working!
Is the performance like on your Android with the default S3? Is it fine on the phone and just not good on the desktop?
Reason I'm asking is there is an app that you can get from GitHub called RSAF. Is basically Rclone on Android. Can even import your rclone config file from the desktop so you don't have to recreate the remote. Settings you must turn on a couple of features that are off by default. They are related to sharing the remotes with other software and the file system. It will let you choose file system in Joplin and then from there choose the remote in rsaf and you will get to the same file system that desktop gets to. I'll post the link to the software if you're interested?
Thanks for the heads up about the RSAF app! I gave it a go and was surprised to find it is actually compatible with the Joplin Android file system sync. Note that it does require selecting a sub directory on a remote which has been setup on the RSAF app, as Joplin will give an error if you set it to the root of the remote.
While it does come with the performance limitations of Android SAF, it’s not so much of an issue if your Joplin profile has under 1000 items like myself. And this opens up the possibilities of using many sync targets without having to constantly run a background service on your phone. I previously tried using Google Drive on the Roundsync app and it was really slow, but I get reasonable performance using Box on both Roundsync and RSAF.
For Roundsync, make sure you use this fork. Original roundsync is OLD very old rclone. This one is current as of today.
Take care.
I know that tool, I using it from time to time, but nah it not solved my problem with slow uploads and downloads.
direct upload or download from mega is faster much faster than from joplin.
Hi,
With those two programs The underlying problem is Operating system Sharing the file system Between the apps.
I have tested on Android and app called termux. It is Linux on Android.
You can install rclone in termux, serve mega s4, and Joplin will be able to navigate to the mega folders.
That should yield far better performance.
I run an FTP server in termux and then connect to it with free file sync to backup my data.
Oh, also it is important to not run termux from Google Play Store you need to get it from either fdroid or GitHub.
Hi,
I found another way that might be better for you and it is running quite fast as far as I can tell.
I downloaded and installed Termux from github.
Then I updated all software. pkg update
pkg upgrade
pkg install rclone
rclone config and create the remote.
Unfortunately in this environment there's no fuse 3 so you can't mount the mega drive.
But you can do is actually better. My understanding is that Joplin synchronizes better over webdav than it does over the file system.
Run rclone serve webdav megas4:
Then go to Joplin on Android and run config and set the sync system to webdav. The url will be http://127.0.0.1:8080
The username and password are both "anonymous"
@LeoW I’m happy with the Dropbox integration, but I like to keep my options open. Running anything webdav or termux would require constantly running a background / foreground service, which I’m not particularly keen on because aside from the battery drain, Android is aggressive at killing those services unless you either make an app a device administrator or keep a notification active 24/7. I used to find the latter ok, but now that sticky notifications aren’t possible anymore, it’s really easy to accidentally dismiss the notification
Yeah what I would recommend it that situation is to keep termux turned off unless you need to sync.
The problem with Dropbox is you only get like one or two gigabytes of free space and then additional space can get expensive.
I open termux, hit the up Arrow to go to the history of my previous rclone command and then I can immediately switch to Joplin.
I don't have any issues with battery drain. There are many hours of the day that you don't need to sync with Joplin.
You only need to have it for synchronization not for editing the local notes that you already have on your phone.
I have rsaf talking to my backblaze account and that works very well.
It would be a shame if you have already purchased a year or more of Mega storage.
I pay backblaze by the month.
Usually no more than three dollars a month.
I've been using the s3 sync with cloudflare r2 for over a year and it works great on both desktop and android, and significantly faster than Dropbox when I compared them
Agreed. Most people don't understand because they don't have the opportunity to see for themselves that Microsoft and Google and Pcloud and Dropbox are a lot slower than S3.
Well the good thing is now you know and understand different and more options than you knew a short while ago and can make an intelligent informed decision going forward.
Different users will have different priorities. In my case my priority is to use a free service, and I don’t use attachments, so lack of storage is not an issue.
In terms of speed, for just syncing plain text I find the speed on Dropbox manageable. I do take notes constantly on my phone, so starting up a service on demand is not practical at all. I know you can get a free allowance on services with S3 buckets, but I don’t like the idea of having to give out my card details and get automatically charged if I happened to go over the limit. So I’m fine with using any of the free plans of a cloud storage provider, providing the speed is reasonable
In that case Mega offers a free 20 GB encrypted plan.
I know because I have an account and have had one for the past couple of years in fact I earned an extra 10 GB so I have 30 now you get an extra 10 for installing their client software.
Rclone supports Mega so instead of using the mega S4 or Dropbox you could use Mega with rclone on your desktops and then you have a choice between rsaf and termux.
This will give you 20 GB of storage which is probably a lot more than you're getting with Dropbox.
And as you noted most of your notes are just text and possibly some pictures but not heavy file attachments.
That means synchronization will be easier and you'll probably fit inside the Dropbox 2 GB plan for possibly a year or more.
All windows users that have a subscription to Microsoft Office 365 gets 1 TB of storage so that's a good place to go to .
On both Google and Microsoft I followed the instructions and activated the drive API and got my own client ID and Secret which makes the performance better than using a shared ID.
I know I have a friend who uses a backup software program for all of his data and it goes to backblaze B2 and he only has a couple hundred megabytes of data which is significantly more than you would ever need for Joplin and I think he said he pays on average between a dollar and $3 a month for the storage he uses.
BB has an entry-level plan where they charge you by the gigabyte and the rate that they charge you per gigabyte is broken down from having to pay a maximum of $6 for 1 TB of storage per month so you divide $6 by how much space you're really going to use you're not going to use the terabyte every month so you might use 100 gigabytes and that probably wouldn't cost you more than a dollar a month.
Here is a link to the sign up page for the free 20 GB.
When I said I don’t use any attachments I meant embedded resources as well. It’s literally just use text notes, so I use under 100mb for my whole collection and I’m never going to reach the 2gb limit of Dropbox
@
Agreed. You will be fine for quite some time.
Here is a neat little trick.
If you do want to for any reason attach a file of any size to a particular note you can put the file on the free Mega server and then you can get a URL that shares the file and you just put that URL in the note.
With this system you can theoretically attach as many documents as you want to any note and they won't take up any storage in dropbox.
I do this in not only Joplin but Others That have no way of even adding an attachment.