Criterion's version is a revelation.

In the 36 years I've been studying Hitchcock I've probably seen this film more than a hundred times, and owned a dozen or so editions in various formats.  I've also been a great fan and collector of Criterion for years, so knowing what they're capable of my expectations for their treatment of The Man Who Knew Too Much were high. And they have done a spectacular job, surpassing my expectations and even satisfying my hopes.
To my knowledge no other way of seeing the film approximates this. The movie hasn't looked or sounded so fine in many years, and although this is a cliche I have to tell you that I've seen details in this presentation my eyes never caught before.
To be so familiar with a film and then experience it as something brand new is an amazing and moving experience, so treat yourself to it when you're able.  It may help to know that Barnes & Noble stores have an incredible sale every six months with all Criterion DVDs and Blue Rays, even brand new releases, at half retail (I usually wait for it, but this time I couldn't).
Finally, because through an error of ommission they aren't mentioned on the package or shown in the menu, I'm relieved to find that optional English subtitles ARE featured (accessible by using your remote's subtitle button).  The production credits for the disc contained in the booklet include one for subtitle supervisor (Brett Sharlow), so these are original. 
I haven't yet watched the entire film with the subtitles on, but the scenes I just looked at are extremely accurate and more detailed than subtitles usually are. For example, the German dialogue is actually spelled out in the early scene of Bob's attempt to communicate with the hotel employee, whereas the more common practice is to simply type "(Speaking German)."   And we can now read the lyric of The Storm Cloud Cantata, better appreciating how it comments on the narrative. Such details are matters of great interest, so my thanks to Brett Sharlow.
And thank you, Criterion!  Hitchcock would have loved you as much you love him (he just wouldn't have been as demonstrative).

I have 7.004 billion brothers and sisters.
You do, too.