I'm going to have to say yes, and I think it needs to be pretty drastic. Even if we make it so that only comments with substance are worth an entry, the current spam comments won't need to change at all in order to stay eligible.
As an example, the worst offenders of the spam comments just look at the sim and write a short summary about what happened. They don't really spark discussion, make an insightful comment about what's going on, or really say anything worth noting. It seems like a common template of "here's who won, here's which players showed up, here's what the losing team needs to change next game." Instead of people engaging with the league and talking openly about the results, they just show up to write a summary like it's an extra PT.
So if we want to set some sort of standard for spam (or maybe a better word is "frequent" comments), I thin we need to really sit down and talk about what really counts as useful or engaging. But of course, this is just my two cents- putting it out there just in case some people have noticed a similar pattern.