Take Down the Rebel Flag

I'm not proud of the fact that my state's flag contains the Confederate battle flag. Whether or not it represents "Southern heritage", we have to consider this: the swastika is an ancient symbol representing the four corners of the Earth. It was used for thousands of years before the Nazis appropriated it. There are millenia of world heritage behind it.

But the Nazi swastika is extremely offensive to anyone with any sense of moral outrage. Therefore, it is almost universally decried as a symbol of hate. I don't see anyone but neo-Nazis waving a swastika, and even then it's not as a symbol of worldly heritage, but of hate.

How is the Confederate battle flag any different?