Career trajectory after portraying Jesus

https://www.reddit.com/r/movies/comments/dcjveo/career_trajectory_after_portraying_jesus/

While there were controversies with The Last Temptation of Christ upon its release, 30 years later Willem Dafoe is still appearing in mainstream films in either supporting roles or as a lead character. Whereas, 15 years after the release of The Passion, Jim Caviezel is still only really remembered for his role as Jesus. Also, prior to filming The Passion, Mel Gibson told Caviezel that his portrayal of Jesus would make it harder for him to find other roles. Caviezel himself has said that after The Passion it was hard for him to secure parts in other movies.

Why the drastic differences between their careers? How come Dafoe’s acting career wasn’t as significantly impacted by his portrayal of Jesus as Caviezel’s?