Same thing happened to me Don't join anime clubs in high school.
As for me, I got my first dose of anime when I was very young, and due to heavy localisation, I didn't even realise that stuff came from Japan. I only realised that during middle school, but I quit everything japanese during my entire middle school time because anime fans were socially being treated very badly. I only made the leap back to anime during high school, and I was relieved to find out that most people had much more open minds now. They weren't bothered by my tastes, even when I talked about them in public. Things went by, and I am now a hopeless anime fan who isn't the least bit productive. I've also taken a liking to japanese culture, and I'm now in the process of learning the language.