Happy ghasts and allays

Building with the happy ghasts has its benefits, but the allays take it a step further if you have some linked to you. This is surprisingly unintuitive as the allays push your happy ghast violently and relentlessly as they merely wander. This makes it very difficult to make minute movements to break and place blocks. It's infuriating actually. There has got to be some sort of entity mass, strength, or priority value that lets you exist on your happy ghast (or any entity) without being able to be moved by another mob by contact because of the fact that you're mounted on that entity. At least for allays, they're passive do a lot of heavy interaction. They're more of a chore to use and contain and I lose more and more faith in using them now that you can barely fly around on your ghast without them flinging you in the opposite direction. Oh the agony!