A way to just select notes/rests only?

I don't know about anyone else, but I'm regularly deleting my metronome symbol in the first measure, and also my dynamics and custom instrument (Shift-I) markings, simply trying to select notes on their own!
I know I must be missing something. I've tried narrowing a selection by going to "Clear Special...", but it seems that just "notes" isn't an option?
I know I must be missing something. I've tried narrowing a selection by going to "Clear Special...", but it seems that just "notes" isn't an option?