I think that's the point. I couldn't hate Palace, they are a club with proper fans. The rivalry is a bit of pantomime fun.
Like us, they're fans that choose to support their local club rather than plastic wankers, so we have one thing in common. But the rivalry is the same as other rivalries. While some of those will have started over religion or competing for work, that's all a long time ago and now the fans just want success at the expense of their rivals the same as us.