Is that really the problem?
It's certainly a part of the problem, yes. And that's in large part because many people are perfectly fine with it, *because* it attacks black and brown people. Much like when Ferguson police were plundering the black residents, and then acted like me a group of grieving black people with military equipment, it allows many people to say "Well, what's the problem? They're all criminals anyway." And yes, many people express exactly this.
I don't want to go too far down this path of debating whether or not stop and frisk is a good idea, or even whether it is or is not racist. I want to relate it to the OP, and specifically to why calling it racist might end up with people voting for Trump.
And in that case, they are simply confirming suspicions. "What?! How dare you call this policy racist?! I'm so mad, I'm voting for the white supremacist!" The OP was right, I absolutely do not get that - except as the concept of "white fragility", which posits that many white people react to criticism of any systemic racial issue as though they are personally being attacked and insulted. And in that case, the only answer I have is "get over it."
What happens all too often is that any measure intended to fight crime is automatically called racist. Why? Because it disproportionately affects black people. That's just reality. The causes for that are rooted in history and are not going to be solved in our lifetime, but the reality is that a disproportionate share of criminals in our society are black. (Aside: disproportionate share. Not majority, but disprpoportionate share.) Any anti-crime program will necessarily end up targeting black people more than white people. You can't avoid it. As a result, all anti-crime programs end up being called racist.
No, the problem is that the people who are not affected by this sort of crime at all, respond as though *all* black people are "black brutes", which is a long-running stereotype that dates back to Reconstruction (black men especially transformed from docile, stupid, and child-like, to superpowered violent rapists within a single generation.) The end result is that we end up with police that ignore theft, rape, and most non-fatal violence, and are unequipped to deal with even murders, but will spend their time chasing down weed smokers, or harassing two black guys chatting outside and then arresting them for "manner of walking" or "resisting arrest".
And in this case, the police become no better than any other street gang.
And yet, we have many people who claim to be anti-crime, yet support exactly this sort of ridiculous and counter-productive standard of policing. I don't have time to coddle them, particularly since they won't listen to me regardless. Again, this is an issue for white people to solve, not us black folks.
Here's where Bill Clinton was a lot smarter than his wife, and why he got elected twice, but she didn't. He didn't play the racist card. He went for tough on crime policies. If Trump were running against Bill, Trump would have lost, because Bill had his "Sister Solja" moment, and that reassured angry white males that he wasn't against them. Hillary really needed one of those moments, but she didn't provide one.
And here's where we get to the heart of the problem. Clinton *did* strike me as somewhat hostile to black people, and we all knew that it was about telling racists "hey, I'll keep the black people on a short leash." The crime bill was deeply flawed as it was, but could have been far worse given GOP hostility to basic community programs (remember the caterwauling over "midnight basketball"?). And Sista Souljah was, in reality, a C-list rapper who few people cared about. And then there was the time he flew to Arkansas to oversee the execution of Ricky Ray Rector...
A white person who thinks that appearing with Beyonce, or proposing better training and standards for police so that they don't just rush up and shoot black people, is against white people is a racist, period.
If you wish to claim that Hillary calling someone a racist is giving up on them, then sure, I agree. But I'm not a part of any political campaign, and will never run for president, so I'm free to say as I please without much concern for that. And while I'm angry at those on the left who tossed out the candidate who was far and away the best at speaking against racism in my lifetime (and this includes Obama), I'm simply speaking truth when I note Trump's obvious white supremacism. All his victory means to me is more racism, more violence, and potentially more wars. And I've long decided to double my efforts against him and his hateful ilk.