Burt Lancaster refference

In Burt Lancaster's biography book it is mentioned that Hal B. Wallis had all intentions of using Burt as the lead. But Burt was more interested in his own productions with Norma, and he got out of doing the film. Charlton replaced him. But during the scene where Charlton is talking with Henry Morgan after the first raid in the film, Morgan mentions "You remember Sweed the old boxing champion", in direct reference to Lancaster's first film, The Killers (although it was produced by Hellinger, who had beaten Wallis in releasing the first Lancaster film, even though Wallis had already shot Desert Fury).