Allays should help eachother out!

Once you open up a cage with an Allay(s) in a Woodland Mansion, the Allay(s) you just released will open up the other cages!

For cages next to Pillager Outposts, the Allay(s) you released there will go to any other cage in the vicinity and help the others escape them!

(If Allays end up following you.) If you make them follow you to another Pillager Outpost that has a cage with an Allay in it, it will help them out too!