Does anyone know how to get procmail and dovecot to play happily together with mboxes? I'm on Centos 6.5, fully patched.
I'm getting tons of lock timeouts which is killing performance.
I tried using dovecot's lda from procmail, which prompted many adjustments to selinux, which I managed, but it still gives permission problems, and I haven't succeeded in getting it to deliver mail.
Any guesses at all would be useful.
thanks, -chuck
-----Original Message----- From: Chuck Campbell Sent: Friday, June 13, 2014 9:09
Does anyone know how to get procmail and dovecot to play happily together with mboxes? I'm on Centos 6.5, fully patched.
I'm getting tons of lock timeouts which is killing performance.
That is 1 of 2 reasons why we switched to Maildir.
I tried using dovecot's lda from procmail, which prompted many adjustments to selinux, which I managed, but it still gives permission problems, and I haven't succeeded in getting it to deliver mail.
Any guesses at all would be useful.
I would recommend switching if that is an option, if it helps we did it incrementally on our userbase.
thanks, -chuck
-- ACCEL Services, Inc.| Specialists in Gravity, Magnetics | (713)993-0671 ph. | and Integrated Interpretation | (713)993-0608 fax 448 W. 19th St. #325| Since 1992 | (713)306-5794 cell Houston, TX, 77008 | Chuck Campbell | campbell@accelinc.com | President & Senior Geoscientist |
"Integration means more than having all the maps at thesame scale!"
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
-- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- - - - Jason Pyeron PD Inc. http://www.pdinc.us - - Principal Consultant 10 West 24th Street #100 - - +1 (443) 269-1555 x333 Baltimore, Maryland 21218 - - - -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This message is copyright PD Inc, subject to license 20080407P00.
On Fri, Jun 13, 2014 at 09:14:06AM -0400, Jason Pyeron wrote:
-----Original Message----- From: Chuck Campbell Sent: Friday, June 13, 2014 9:09
Does anyone know how to get procmail and dovecot to play happily together with mboxes? I'm on Centos 6.5, fully patched.
I'm getting tons of lock timeouts which is killing performance.
That is 1 of 2 reasons why we switched to Maildir.
What was the second reason? Always looking for justification to take up the line with my recommendations...
I tried using dovecot's lda from procmail, which prompted many adjustments to selinux, which I managed, but it still gives permission problems, and I haven't succeeded in getting it to deliver mail.
Any guesses at all would be useful.
I would recommend switching if that is an option, if it helps we did it incrementally on our userbase.
Are there any tools to convert procmailrc files to maildir compatible recipes?
-chuck
On Fri, 13 Jun 2014, Chuck Campbell wrote:
On Fri, Jun 13, 2014 at 09:14:06AM -0400, Jason Pyeron wrote:
Does anyone know how to get procmail and dovecot to play happily together with mboxes? I'm on Centos 6.5, fully patched.
I'm getting tons of lock timeouts which is killing performance.
That is 1 of 2 reasons why we switched to Maildir.
What was the second reason? Always looking for justification to take up the line with my recommendations...
I can't speak for Jason, but here are some of our reasons for switching to Maildir (which works well with procmail):
1. Incremental backups are much smaller 2. Large mailboxes aren't a bottle neck
Bruce Schneier recently quipped that sometime around 2006 he stopped filing messages into named folders because e-mail searches became faster than manually sort. Many folks now use e-mail clients with pretty fast search features, so using mailboxes as a sort of filesystem became inefficient -- so mailboxes (particularly the main inbox) get large. Maildir is so much faster in that sort of environment.
(I'm a dinosaur, still using a CLI mail client, so I still prefer folder-based organization -- but I recognize I'm part of a small and shrinking minority.)
Are there any tools to convert procmailrc files to maildir compatible recipes?
Changing destination names, and adding closing '/' characters is really all that's needed. E.g.,
:0 * ^List-Id:.*<centos.centos.org> mailinglists/centos
becomes
:0 * ^List-Id:.*<centos.centos.org> .mailinglists.centos/
The closing '/' tells procmail to use Maildir.
-----Original Message----- From: Paul Heinlein Sent: Friday, June 13, 2014 12:32
On Fri, 13 Jun 2014, Chuck Campbell wrote:
On Fri, Jun 13, 2014 at 09:14:06AM -0400, Jason Pyeron wrote:
Does anyone know how to get procmail and dovecot to play happily together with mboxes? I'm on Centos 6.5, fully patched.
I'm getting tons of lock timeouts which is killing performance.
That is 1 of 2 reasons why we switched to Maildir.
What was the second reason? Always looking for
justification to take
up the line with my recommendations...
I can't speak for Jason, but here are some of our reasons for switching to Maildir (which works well with procmail):
- Incremental backups are much smaller
- Large mailboxes aren't a bottle neck
That's it. 15 users, with 20 2GB+ mbox files with a daily change of a 100k+ was killing our backup effort by having to backup .6TB every day.
And the load on the imap server was through the roof, now it averages a 0.01
Bruce Schneier recently quipped that sometime around 2006 he stopped filing messages into named folders because e-mail searches became faster than manually sort. Many folks now use e-mail clients with pretty fast search features, so using mailboxes as a sort of filesystem became inefficient -- so mailboxes (particularly the main inbox) get large. Maildir is so much faster in that sort of environment.
(I'm a dinosaur, still using a CLI mail client, so I still prefer folder-based organization -- but I recognize I'm part of a small and shrinking minority.)
Are there any tools to convert procmailrc files to maildir compatible recipes?
Changing destination names, and adding closing '/' characters is really all that's needed. E.g.,
:0
- ^List-Id:.*<centos.centos.org>
mailinglists/centos
becomes
:0
- ^List-Id:.*<centos.centos.org>
.mailinglists.centos/
The closing '/' tells procmail to use Maildir.
And we did this in the global procmailrc file:
root@mail ~ # cat /etc/procmailrc DEFAULT="$HOME/Maildir/" MAILDIR="$HOME/Maildir/"
User .procmailrc can (but shouldn't) still put in mbox, but the inbox was the first to go to Maildir.
-- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- - - - Jason Pyeron PD Inc. http://www.pdinc.us - - Principal Consultant 10 West 24th Street #100 - - +1 (443) 269-1555 x333 Baltimore, Maryland 21218 - - - -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This message is copyright PD Inc, subject to license 20080407P00.
On Fri, 13 Jun 2014 12:50:52 -0400 Jason Pyeron wrote:
That's it. 15 users, with 20 2GB+ mbox files with a daily change of a 100k+ was killing our backup effort by having to backup .6TB every day.
*shudder*
Email isn't a database.
On 2014-06-13 1:00 pm, Frank Cox wrote:
On Fri, 13 Jun 2014 12:50:52 -0400 Jason Pyeron wrote:
That's it. 15 users, with 20 2GB+ mbox files with a daily change of a 100k+ was killing our backup effort by having to backup .6TB every day.
*shudder*
Email isn't a database.
Amen.
Even at home, where I own/control the whole shebang, I limit the inbox size to 250M. Get close to or exceed that size, and you won't receive email...period.
Mike Burger wrote:
On 2014-06-13 1:00 pm, Frank Cox wrote:
On Fri, 13 Jun 2014 12:50:52 -0400 Jason Pyeron wrote:
That's it. 15 users, with 20 2GB+ mbox files with a daily change of a 100k+ was killing our backup effort by having to backup .6TB every day.
*shudder*
Email isn't a database.
Amen.
Even at home, where I own/control the whole shebang, I limit the inbox size to 250M. Get close to or exceed that size, and you won't receive email...period.
I lost a bunch of stuff early this year... I hadn't broken out previous years into year-folders. Old stuff was in earlier ones, and that was ok. I really need to do that, and I can recover up until the beginning of the years, once I figure out how to import an older t-bird file.
I'd *like* to use mdir - been thinking about it, but now that I see that t-bird has problems with it.... Maybe I should go back to kmail....
mark
-----Original Message----- From: centos-bounces@centos.org [mailto:centos-bounces@centos.org] On Behalf Of Mike Burger Sent: Friday, June 13, 2014 13:51 To: CentOS mailing list Subject: Re: [CentOS] procmail and dovecot
On 2014-06-13 1:00 pm, Frank Cox wrote:
On Fri, 13 Jun 2014 12:50:52 -0400 Jason Pyeron wrote:
That's it. 15 users, with 20 2GB+ mbox files with a daily
change of a
100k+ was killing our backup effort by having to backup .6TB every day.
*shudder*
Email isn't a database.
No it is not. And databases are not for storing emails, I mean blobs.
Amen.
Even at home, where I own/control the whole shebang, I limit the inbox size to 250M. Get close to or exceed that size, and you won't receive email...period.
Well it works for us, and allows us to do our job and that is how we pay the bills. Limiting things is letting technology drive people.
-- Mike Burger http://www.bubbanfriends.org
"It's always suicide-mission this, save-the-planet that. No one ever just stops by to say 'hi' anymore." --Colonel Jack O'Neill, SG1
CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos
-- -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- - - - Jason Pyeron PD Inc. http://www.pdinc.us - - Principal Consultant 10 West 24th Street #100 - - +1 (443) 269-1555 x333 Baltimore, Maryland 21218 - - - -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- This message is copyright PD Inc, subject to license 20080407P00.
On Fri, Jun 13, 2014 at 1:51 PM, Mike Burger mburger@bubbanfriends.org wrote:
On 2014-06-13 1:00 pm, Frank Cox wrote:
On Fri, 13 Jun 2014 12:50:52 -0400 Jason Pyeron wrote:
That's it. 15 users, with 20 2GB+ mbox files with a daily change of a 100k+ was killing our backup effort by having to backup .6TB every day.
*shudder*
Email isn't a database.
Amen.
Even at home, where I own/control the whole shebang, I limit the inbox size to 250M. Get close to or exceed that size, and you won't receive email...period.
I take it you're using Dovecot and Maildir quotas [0] or something else [1]? I'm curious as to what solution you're using and any configuration snippets you feel like sharing.
Thanks!
[0] http://wiki2.dovecot.org/Quota/Maildir [1] http://wiki2.dovecot.org/Quota
On 06/14/2014 05:00 AM, Frank Cox wrote:
On Fri, 13 Jun 2014 12:50:52 -0400 Jason Pyeron wrote:
That's it. 15 users, with 20 2GB+ mbox files with a daily change of a 100k+ was killing our backup effort by having to backup .6TB every day.
*shudder*
Email isn't a database.
Convince google of that ....
On Fri, Jun 13, 2014 at 09:31:36AM -0700, Paul Heinlein wrote:
<snip>
(I'm a dinosaur, still using a CLI mail client, so I still prefer folder-based organization -- but I recognize I'm part of a small and shrinking minority.)
Long live the commandline!!!!!
Remember, "In The Beginning Was The Commandline"!
-- Paul Heinlein heinlein@madboa.com 45°38' N, 122°6' W
-
Chuck Campbell -
Frank Cox -
Fred Smith -
Jason Pyeron -
m.roth＠5-cent.us -
Mike Burger -
Paul Heinlein -
Rob Kampen -
SilverTip257