I respect your view but I don't share it. I'm never close enough to opposition fans for them to hear anything I might say or vice-versa. They add absolutely nothing to the occasion for me; our team and our fans do that perfectly well.
I haven't been to Ipswich for a couple of years now, but I can't recall many places with "Home Fans Only" outside so many pubs. It's Ipswich and Brighton for crying out loud.