Punk rockers did wear swatsika shirts.

Sid Vicious which is an Punk Rock Icon wore Swatstika shirts and symbols, but i think it was more about rebelion. also city street gangs and outlaw bikers also wore swatsika symbols