Probably not, at least in comparison to what I know of other alien races both real and fictional. But, the Irken Empire have the... dubious honor of being the ones that everyone in the universe takes issue with on some level because of their actions.

[So while not unique, they're winning the contest of "most annoying and hated species" last Zib checked.]