I looked at it a few times but every time I'm concerned that deleting them while the app is running could interfere with E2EE, which runs in a background service. It's definitely fine to delete them while the app is not running though, and eventually we should look into it again and find a safe way to delete them at runtime.