[CentOS] trying to remove cyrus-sasl

I'm trying to remove the packages for cyrus-sasl using yum, but for
some reason, yum wants to uninstall everything related to e-mail, as
well as X-Windows, Gnome, etc etc.

yum remove cyrus-sasl

Transaction Summary
=============================================================================
Install      0 Package(s)
Update       0 Package(s)
Remove      81 Package(s)
Total download size: 0
Is this ok [y/N]: n
Exiting on user Command

How can I just remove cyrus, without uninstalling my entire desktop?

Thanks,
Gordon