Oh, you're right! I keep forgetting the 2nd Doctor! But I did see some episodes where Jamie appeared with Tom Baker. I guess it never clicked that he was being brought back for several episodes, as sometimes happened with other former companions.