UI is User Interface, I believe. It's basically what you see on screen (Unit cards, mini-map...)
FRAPS, I don't think is an abreviation, but is a usefull program to take screenshots and videos. It's free, but in that case you can only get 30 seconds max videos. I don't know any other limitation.