Totally unacceptable on the basis of risk. Shouting at them would have been bad manners but perfectly justified in this case. Hitting a ball intentionally at them is an attempt to cause bodily harm and I imagine may well be criminally prosecutable even without actual bodily harm. Had he hit them, I imagine he could well be opening himself not only to massive financial pain but very possibly to jail time.