I think it's absolutely expected and, probably, is reflected in our views of other teams.
I suspect the average fan of a particular team would know their players inside out. Good points, bad points, personality/fitness defects. Unless they are one of those that religiously watch every game in the same division that they possibly can, then the chances of seeing any opposition players is once, and for a few, twice a season. In these games they are concentrating on how their team play and other than oppo players who have a stormer or stinker, by the next morning most can't even name who played against them.
Add to this the natural bias when watching and you end up with a skewed view of the match anyway (you only have to look at some of the barbs aimed at Deadbat when he marks down certain players especially in the old Hoofy days when we played shite football but it was all we had and we had to "defend" it) and you're very unlikely to want any of your favourites replaced by outsiders.
The nearest I find to embarrassing (football certainly never does that to me) is how precious we've all become if anyone doesn't tug their forelock every time they've played us!