I thought yams and sweet potatoes were the same thing! Maybe after having a can labeled as "Yams" with sweet potatoes as the ingredient helped to skew things for me.
I prefer fresh sweet potatoes over the canned version. So now I'm wondering if I actually did eat real yams from a can, and compared the taste to sweet potatoes. I see where the two could very easily get confused.