I agree with you 100%. Anything that is inherently graphical will most likely be a pain to use in a terminal. However, lots of stuff can work pretty nicely: system management, music players, email clients, text editors, file explorers, etc.

In the end, it’s about finding a good balance between both worlds, in such a way that you feel comfortable with your machine and workflow.