The header for encrypted data is “JED01” (for Joplin Encrypted Data v01) so if it starts with this it should work, or at the very least it should give a different error message.