Considering it's now ten years old, you have to go into Morrowind accepting that it's not going to be pretty... especially when compared to something like Skyrim. However most people who've played them all seems to agree with me that for so many reasons, Morrowind was the best of the lot.
The combat isn't great, and oh my lord you'll wish Cliffracers had never been invented, but the inventory system is (mostly) simpler, you can physically place all your loot wherever in your house you want and it doesn't go flying through the air when you next enter the room... The journal system actually records more than just one line of information on a quest (more like ALL information on it!) which you can search through to find pretty much a particular line of dialogue you were told about it, and you aren't led around by the hand either. If it says "there's this rare book and it's probably in the West Canton of Vivec", then you have to go there and work out for yourself that hey, West Canton has this rare book store, maybe I'll talk to the owner. As opposed to "Go talk to Applesauce the Khajiit, in the Old Rare Book Store in Vivec's West Canton here we'll put an arrow to guide you right to him" in the newer games.
Plus the modding community has done AMAZING things. It's pretty much recommended you start out with a few of the mods installed, unless you really want the original experience.
Man, I could talk about Morrowind all day. The opening sequence is so nostalgic for me, I can still hear the guy's voice