There are a couple of bugs in Bugzilla about this. One that I posted (#622) describes the problem and Russ's response gives the solution.
Searching for GPG in Bugzilla finds the bugs, including the one with the solution.
--- centos-request@caosity.org wrote:
Send CentOS mailing list submissions to centos@caosity.org