[CentOS] SSH slow

Hi All,

All of my systems are running 5.4 x64. The are all AMD x64 processors with at least 2gb of RAM in each.

I am running SSH on a non standard port.

When I SSH into ANY of my systems, I get prompted for my password right away, but after entering, it takes 30+ seconds to get logged in and get a prompt so I can work.

I dont quite know what to look for here

Does anyone have thoughts?

-Jason