When you consume a story and love it, you take from it what you need. Once the story is out there and communities build around them, the entire world of it changes and grows. The fans fundamentally change the story, usually for the better.
That being said, it’s important to listen those who are hurt by the things we consume. To look at the negative aspects and accept that they can be hurtful. If someone says they are hurt by something, we must listen and learn from that.
Harry Potter is filled with racist, homophobic, classist, pro-slavery, colonialist, and antisemitic themes. I’m sure there are other things in there that I haven’t noticed. It’s also filled with messages about the power of love, found family, doing the right thing, and standing up against oppression. Nothing is perfect. It’s your responsibility to decide if the good outweighs the bad.
We plan on keeping our Harry Potter books and making sure we explain the faults to our kids. However, we gave away our Marion Zimmer Bradley books and I refuse to read Lovecraft. You need to decide on your own balance.
If the Harry Potter universe is important to you, if you have fond memories of waiting in line for the books, if you smile when you hear the words Mushroom and Badger close together, or if your life was influenced for the better by these book; those memories and events are still good and valid. As much as the creator influences the work, so do the consumers. Don’t allow the author’s misguided hateful views to dim the positive that the books have done.
If you still love the world and still want to consume things about it, I recommend looking into fan fiction, fan art, and other creators that have played with those worlds.