Unlike you, I am Jewish, but I don't "look" Jewish, so I have been privy to many an anti-Semitic rant or theory (especially after 9-11). I have the same experience you do except about racism as I am not black, but I do have nieces who are African-American. There are those who assume I am OK with anti-Black racism because I am white and spew their hate and nonsense, right up until I confront them, and then show them pictures of my beautiful nieces.
When I first moved to Oklahoma, I needed a new car. I was told which dealership was the best. The rationale? I could "easily Jew them down on the price (negotiate)." The irony? I was told to avoid another dealership because they would "Jew me" (cheat me) on the price. I always found it so odd that to "Jew someone" could have a "positive" meaning (get a good deal) and a negative one (getting a deal at someone's expense).
Here at DU, someone recently posted a tweet of some twit who was wining, in 2017, about a Michael Jackson video from years ago not getting "play time" because of the video. She, incorrectly, identified the video as the first version (it wasn't) and also neglected to mention it was the version with these lyrics:
Beat me, hate me
You can never break me
Will me, thrill me
You can never kill me
Jew me, sue me
Everybody do me
Kick me, kike me
Don't you black or white me
Again, the anti-Semitism of the lyrics never register to some, even worse, there are those who still try to defend it.
Anti-Semitism is one of the few bigotries against an actual minority which is acceptable. There are other bigotries against non-traditional minorities (Southerners, East Coast, age, weight) which get passes at regular intervals, but Jews, always seem to be an exception to inclusion to diversity concerns,
unless it suits another purpose or bolsters the complaints of another minority group. Hell, not too long ago, a year or so ago, there was a survey to "check your privilege" and one of the categories which got a person +25 points was if you were a Jew! Being Christian only got you a measly +5! IN THE US?! Now, if that were a survey in ISRAEL that would be different, but there are those who think Jews are privileged and not a real minority. The real, low down, rotten, dirty shame is many Jews by into this myth and even help perpetuate it by downplaying, ignoring, or worse yet, excusing anti-Semitism, especially when it comes for their side of the fence.