This post from Derek Powazek on why AI is not the answer to online community management is very good an you should go read it. Most of his points apply more broadly to the problem of trying to use technology as a replacement for human judgement.