Is it just me?

I think he's just fine. In fact, I think he does a great job of not coming off as pretentious. He clearly knows a lot about culinary and Spanish history (perhaps even more than Claudia), but he never sounds like he is talking down to his co-hosts, or the viewer. Gwyneth Paltrow, on the other hand, knows almost nothing about what she's talking about, yet often tries to sound like an expert. I respect your opinion, though.