Shortcut for breaking blocks

I've had a great idea for how to speed up survival building in a way that adds some QoL into the game.

Since you can middle click to place the block you are looking at I think it would be a great idea to be able to push maybe "ctrl + middle click" to switch to the tool in our inventory that can break that block.

I think this would help the flow of building in survival by mitigating constant inventory management while making it survival friendly.

Let me know what you think!