Ok, spent more time with the X-E1 and here's my initial impression.
1) Feel is good, expecially with the grip. Fits my hands better that the M4/3 bodies which I have. Thought that the set up was a little front heavy with the 18-55mm lens but its all good with the grip. Somebody commented that it feels like a tin can but I didn't think so. The only complaint I have is that the small dial on the back is a little sharp on the edges but its not a biggie.
2) Controls are quite intuitive. Wish there could be at least 2 Fn buttons though. Quick manual is handy.
3) EVF is good but noticed some lag when zooming.
4) AF is surprisingly fast with the 18-55mm (I've used the X100 before).
5) Quite honestly, I don't quite like it when I'm forced to use the aperture ring in Av mode. That was a bit of a shocker but should get used to it.
6) ISO expansion is off in RAW mode and since I only shoot in RAW, I cannot use ISO 100.
7) Only have single axis leveller. Cameras of the same generation provide dual axis. This can be a pain.
8) Waking the camera up from auto-off is a function by itself, which had to be turned on. Hello!!!
9) RAW means RAW, cannot change ratio aspect. No biggie either.
10) I don't really need a big dial which does nothing but let me control exposure compensation but that's keeping in line with the retro design I supposed.
Have to admit, it was the design which enticed me to get the camera. I thinkit looks way better that the bigger brother. I knew very little about useability of Fujifilm cameras and I bought the X-E1 with no intention of using it for my work but its could well be turning out just fine. I didn't felt this excited when I got my D800E or H4D. Looking forward to the 14mm and the UWA zoom.