Whether you agree with what Robertson said or not is immaterial, its that he is being punished for expressing his opinion, a first amendment right and that's wrong.
As well, A&E has the right to fire him as a result of what he said and we have the right not to watch the garbage on their channel.