Morality has everything to do with imposing itself on other's rights. Is murder not a moral issue? Or stealing property from someone else? It is a form of morality to even suppose that people have "rights" as you say. What gives them these "rights"? There are cultures that exist with different moral codes where these same rights do not exist.