I changed the modprobe.conf file to look like this:
[root@vmhost network-scripts]# cat /etc/modprobe.conf alias eth0 bnx2 alias eth1 bnx2 alias eth2 e1000 alias eth3 e1000 alias scsi_hostadapter megaraid_sas alias usb-controller ehci-hcd alias usb-controller1 uhci-hcd
alias bond0 bonding options bond0 -o mode=802.3ad miimon=100
then I shut down all the interfaces, removed the bonding module, and then did a /etc/init.d/networking restart and all was well