I was wondering if anyone had any ideas on how to scale policyd to about 65,000 email boxes (12m-ish emails a day). Here is our current setup

load balancers (x2): pIII/xeon 550mhz setup in failover and dns round robin (so both share load, but if one dies, the other takes over

policy servers (x3) 450mhz sparc processors with 3g ram running policyd-sf

mysql server (x1) 2.7ghz celron processor with 2g ram running mysql 5.0.51a

all are running freebsd 6.2 (with the exception of the mysql server, which is freebsd 7) and are all hooked up to a 100mbps adtran 1524.

we have 4 more of the sunfire servers that we are waiting to get loaded. and are planning on replacing the loadbalancers with 2 sun netra t1’s.

we’ve run into alot of problems scaling this; it seems to be related to the database, though. I am far from an expert in database administration, however, and most of what i can do seems to be a ‘tweek it until it’s less broke’.

Errors we see are mostly server configuration errors, but we also see slow (10+sec) response time when trying to telnet to the policyd-sf port (10031)

any help would be appricated, and if anyone knows a better way, let me know, i have an open mind.