Re: [logs] Apache Logs

From: Bill Burge (billat_private)
Date: Tue Jan 29 2002 - 17:01:21 PST

  • Next message: Greg Black: "Re: [logs] Re: syslogd / some analysis"

    We run 4 single CPU Sun Sparcs with hardware load balancing in front of that with logs of 1.4 to 1.9 million web log entries per day with an average log entry of about 350 bytes.  Average uncompressed log file:  550Meg
    
    Originally, they wanted e-v-e-r-y-t-h-i-n-g, including Cookies and the referring URL.  This created syslog messages in excess of 1024 bytes and truncation of log entries happened.  Now, the pipe to logger is preceeded by a pass through a sed script that weeds out some the state cookies (yes, we do that too) and backend process cookies that got quite large.
    
    Our backend syslog server is a P3 700 with 512M ram running OpenBSD 2.9.
    
    Bill Burge
    
    
    *********** REPLY SEPARATOR  ***********
    
    On 1/29/2002 at 2:53 PM rbfat_private wrote:
    
    >> I'm kind of curious about this: does anyone have any numbers they'd
    > > care to share about logging rates and server log rates? How many
    > > entries/second does a busy server's access log collect?
    >
    >Sure. Our main public web server, apache on a 2-cpu/1GB Sun 3500,
    >commonly gets up 700k-800k hits per day, with rates up to 125
    >hits/sec. Uncompressed log size is upwards of 110MB. At around
    >144 bytes/message, these are a bit longer than your normal syslog
    >things. (We have chosen to log most everything.)
    >
    >-- Rich Fuchs rbfat_private (*nix systems programmer, Research
    >Libraries Group)
    >
    >---------------------------------------------------------------------
    >To unsubscribe, e-mail: loganalysis-unsubscribeat_private
    >For additional commands, e-mail: loganalysis-helpat_private
    
    
    
    
    ---------------------------------------------------------------------
    To unsubscribe, e-mail: loganalysis-unsubscribeat_private
    For additional commands, e-mail: loganalysis-helpat_private
    



    This archive was generated by hypermail 2b30 : Tue Jan 29 2002 - 18:14:20 PST