I think a human touch will always be necessary in these kinds of judgement calls.

Definitely. I know of someone who got automatically banned for writing a comment like “that guy must be hung” (as in “having a big member”) as a jokingly lighthearted reply in a comment thread of people just messing around. The bot interpreted it as “someone has to hang that guy” and slammed down the ban hammer for inciting violence.

And actual human being would have instantly realized from the context that there was no need to interfere, but bots are tone-deaf.