Richard Singing?

It's been about 20 years since I last saw Caroline in the City. I'm currently watching it on CBS's app on my Roku, but I'm still in the middle of the first season. I may be mistaken, but I seem to remember an episode in the last season or two where Richard sings (and maybe dances and plays the piano)... but I might be mistaking that for an episode of The Nanny, which I also watched around the same time period and also haven't seen in about 20 years. Is there such an episode, or am I mistaking it for some other show?