Woody Allen has called actors who have spoken out against him “self-serving.” The director said actors were just trying to be “fashionable” with their protest. A number of actors have refused to work with him after allegations of sexual abuse were made against him by his adopted daughter Dylan Farrow.

Allen called the recent protests against him “silly” and compared it them to people adopting new eating trends.

“The actors have no idea of the facts and they latch on to some self-serving, public, safe position,” Allen told The Guardian. “Who in the world is not against child molestation?”

“That’s how actors and actresses are, and [denouncing me] became the fashionable thing to do, like everybody suddenly eating kale,” he continued. “I thought people would see it as laughable rubbish right away and from day one I never really took it seriously. I mean, it’s like being confronted with a story that I murdered six people with a machine gun. You can give them the facts over and over. But the facts don’t matter. For some reason, emotionally, it’s important for them to buy into the story.”

Colin Firth, Greta Gerwig, Mira Sorvino and Timothee Chalamet are among the actors who have said they will never work with Allen again. Allen’s latest film has topped the global box office statistics with its international release.