You can have stupid feelings, especially once they concern how you treat others. There’s a big difference between “idk why, but I really like cherry flavored ice cream” and “idk why, but these people make me feel uncomfortable”, because the latter opens you up to treating others with prejudice.

It’s your job to wrestle with them and make sure your feelings are justified, or to change your mind.