Badge envy...

If you go to DPReview and do a side-by-side comparison of the Fujifilm X100 with the Leica X1 (which you can do from the former's test), it's difficult to support the conclusion that the "easily delivers the best image quality in its category". At high ISO the X100 is surely a bit better and both cameras are rated highly for the lens quality (and the Fujifilm is a full stop faster).

Of course the X100 is physically a bit larger, but then it has a built-in viewfinder and something of a handgrip (both cost-extras on the Leica). With both cameras there appear to be quirks, and neither appear to be up with the best on AF, speed of use. Also both are expensive albeit the Leica hugely so.

Of course there will always be sold by the badge on a camera, and I suspect that is far and the way the most important issue when it comes to premium-priced products like the Leica. Until I see some direct side-by-side objective evidence under comparable conditions I'm inclined to think the Leica does not easily deliver the best images - if anything it's subtly the other way.