I can aver that the UI of both Vi and Emacs are highly distracting to me, because I spend my time swearing at them trying to remember what mode I'm in, whether I'm editing text or accidentally invoking editor commands, trying to remember their ridiculous non-standard keystrokes for saving or cutting or pasting or whatever.

Because they totally fail to follow the UI guidelines introduced in the early 1980s and adopted across almost all OSes by the start of the 1990s onwards, they are extremely distracting and constantly get in my way.