Hi!
I see that it can be quite annoying, it should be possible to hide it. I made the plugin so it appears when installed and I haven't put this into consideration.
I am going to create a new setting for that so users can toggle the panel and save the configuration. This will be part of the next release