You contradicted yourself there nicely and I'm glad you did, because your opening sentence is something we hear a lot, and it's a very dangerous way to think. There are NO easy games at this level. And I mean NONE.ZERO. ZILCH.
It's simply not possible to say one team will be easier than another to play. On the day it's 11 v 11 and it will come down to the following:
A manager can have a big influence on the first one - but he's pretty much stuck with what he's got in terms of the second one, and he can have no influence at all over the third one.
When folks talk about "on paper" they are really only looking at the second one, the ability of the players, based on what's known about them - and sometimes that is also pretty much Zero as well.
Anyhow, your further comments are testament to this. We are more than capable of losing to lesser teams, in fact mostly I prefer us to be playing the bigger, more fancied teams, because we seem to be more up for it.