What about Roger Carmel

For about half the film Carmel is a sharp villain in a cool hat and carrying an umbrella. Then he sorta drops out of the story and another actor, Arthur O'Connell, comes along in practically the same role, also wearing a sharp hat and well dressed as well.

Did Carmel have to drop out of the film and they replaced him or what?