I'd say it's more often than not harder. This isn't because there are ten men per se but because those remaining feel aggrieved and are more determined to win than they would otherwise be.
Then maybe feel a little more determined yourself?
My personal view is that if you're smart enough, having a numerical advantage should also be a footballing advantage.