Yet...speaking individually...if you're astral projecting, it should seem as if you are THERE. Kinda like The Matrix....you know you're not there, but your mind tells you something else. It would explain why they would panic or be afraid.
I don't think they should be forced to rally if they fall below 1/2 the unit, but if a unit or spell creates a fear effect, let it stand.