Guys who sleep with transsexuals

Would you consider them gay?

I personally have no sexual attraction to men, and never had any homoerotic experiences even as a kid.
I love women, and find femininity very sexy and attractive.
but i also do find some feminine "passable" transsexuals attractive. like the real Calpernia, if you watch the extras on the dvd, you can see her. i think shes pretty hot.
now ive never had any real contact with transsexuals, but i would consider dating one, even if she had a penis. otoh i would never do anything with another man.
so i know that might make me somewhat bi, but i pretty much consider myself a straight guy.

im interested on what you all think- especially women, would you consider me gay because of this?