Add an option to "punch" but not destroy Noteblocks in Adventure mode

In the Minecraft gamemode "Adventure" you can not destroy or place blocks without the NBT tags, such as "CanDestroy".

What you can do is interact with right click stuff, mostly as far as I know, this includes Noteblocks. But, when right clicking a Noteblock it increases the "pitch level" of it. Now the issue is that you can not left click it and play the actual note without it changing the pitch level.

And let's say you don't want someone to be able to destroy the Noteblock, if you assign an item the "CanDestroy" tag, what can you do? Well, I don't know of anything right now, so it would be cool to see some feature that would resolve this issue.