I agree, it would be better, if the default action were Cancel for delete operations. I never understood why Ok was highlighted and pre-selected in the dialog. Maybe we should also change Ok to a Delete button.
History won’t work when a note was deleted. Or at least I didn’t find a way to get a deleted note back.