Proposed Duel - Script Goof?
At one point the Duke posits that he was capable of calling Charles Grey out for a duel. However, as noted later in the film, Grey had no rank and little status. Dueling was something that was supposed to be conducted by equals, lest the social order be endangered.
More likely the Duke would have threatened to have his servants go and "teach him a lesson."