maven-surefire-plugin does not fail build if TestNG and JUnit47 are used

I have a module where maven-surefire-plugin (2.10) is configured to use
TestNG and JUnit47. The former has several tests that all succeed and the
later has two tests that fail. However the build succeeds. How can I
configure surefire so the build fails if either have failures which is the
expected behavior?