I see the “agree to disagree” as a bit of a social flag for the conversation that says “I don’t wish to get into it / continue arguing about it” because there is no way to respond to it. If you try to continue the debate you look like an asshole, and if you drop it the person who says it gets to continue being wrong without being challenged.

It’s very annoying and I hate it.