Can the Anti-Defamation League please, PLEASE just STFU?

This is outside my normal lane, but it's so egregious that I just can't avoid ranting about it here: During a baseball game between New York and Tampa on Saturday, Fox broadcaster Tim McCarver, a former teammate of ex-Yankees manager Joe Torre, said this about the way that Torre's success with the team has been rather indelicately whitewashed in the franchise's organizational memory:

"You remember some of those despotic leaders in World War II, primarily in Russia and Germany, where they used to take those pictures that they had ... taken of former generals who were no longer alive, they had shot 'em," McCarver said Saturday. "They would airbrush the pictures, and airbrushed the generals out of the pictures. In a sense, that's what the Yankees have done with Joe Torre. They have airbrushed his legacy. I mean, there's no sign of Joe Torre at the Stadium. And, that's ridiculous. I don't understand it."

McCarver has since apologized -- "Although my analogy was inappropriate, in my opinion the underlying point remains true" -- which I think was probably unnecessary. (Is it just the case now that any time you say "Nazi," it's necessarily offensive and inappropriate?) But the ADL had its own take. According to ESPN.com,

The Anti-Defamation League, which advocates against anti-Semitism and bigotry, also felt McCarver's comments went too far.

"No matter what one thinks of the Yankees' treatment of Joe Torre, likening it to how Germany and Russia treated their generals who fell out of favor is an inappropriate comparison," the organization said in a statement, according to the Daily News.

Honestly, can you guys just STFU? What in the world does this have to do with "anti-Semitism and bigotry"? Why does the ADL think its organizational position on this matter is any more relevant than what Abe Foxman thinks about the tie I'm wearing today?

Serious question: what exactly is inappropriate about what McCarver said? Ok, so he compared Torre's departure from the Yankees to a murderous political purge, but are we all so uptight nowadays that we can't take that for what it was -- a colorful simile? I'm not the guy who sits around bitching about how political correctness is ruining the world and whatnot, but this is just damned stupid, full stop.

EDIT: Slightly more context from the NY Daily News.