Help! Trouble with Akuma.

Okay, so I scored 3 perfect matches and unlocked the fight with the bastard. I defeated him, but he wasn't unlocked for me! I'm pissed off. How do you unlock this sonuvabitch?

P.S. I was using Ken.