For me, it's sentence building. I have a pretty extensive Spanish vocabulary but, I simply cannot put the words together (to form more than a basic sentence). I, also, have a very hard time hearing what native Spanish speakers are saying. Unless they speak VERY slowly, I'm lost a few words in. Thank god learning a language when you're a child didn't seem this hard. I'm sure a lot of us would give up!