This happened to me, too, Eden. I had problems getting the caps off at first, and I was afraid of breaking something, so I quit trying to get them off. I had never even seen a breastpump before, so I had no idea what was supposed to do what!
Well, I now take the yellow caps off when I clean it, but I leave the membrane on there. But as Nona said, don't worry about the milk you have stored so far. And don't feel like a lone ranger! I have been there and done that! <img src="http://www.asklenore.com/ubbthreads/images/icons/wink.gif" alt="" />
Four weeks to go! Woo-Hoo!