RE: [logs] databasing log files

From: Brown, James (Jim) (JBrown@private)
Date: Wed Feb 11 2004 - 10:43:41 PST

  • Next message: Paul Robertson: "Re: [logs] databasing log files"

    I've stored the text records along the the MD5 hash and some other
    metadata.  It's possible to validate individual entries this way.
    For the group of messages as a whole, I've constructed a 'dataset'
    table with metadata about a collection containing log entries
    x through y.  The collection itself is also MD5 hashed.  This 
    prevents deleting or inserting entries over an entire collection.
    
    My $0.02USD,
    jpb
    ===
    
    
    -----Original Message-----
    From: Ron Sweeney
    To: loganalysis@private
    Sent: 2/10/04 9:40 PM
    Subject: [logs] databasing log files
    
    -----BEGIN PGP SIGNED MESSAGE-----
    Hash: SHA1
    
    
    
    Recently, I have gone down the road of writing "engines" to grep on huge
    amounts of log files and load them into a mysql instance to keep
    pertinent
    data.  It works out pretty slick this way for obvious reasons...
    
    My question to this list however, what are the legal ramifications of
    storing data externally and not keeping the log files in their native
    format? Does the validity of the exception in the log file get stunted
    when removed from its native format?
    
    
    
    
    
    - --
     ---  -sween
    | M | http://www.modelm.org
     ---  "force feedback computing since 1984."
    <meta name="MSSmartTagsPreventParsing" content="TRUE">
    
    -----BEGIN PGP SIGNATURE-----
    Version: GnuPG v1.2.1 (FreeBSD)
    
    iD8DBQFAKZY/43hoCoA0jEERAh/nAJ45dfd/ftTkVtvJ/8iKOL5gBLJ0ZgCg0DJ2
    xWc3qczm0pv/mq1szoVqBKQ=
    =xIFR
    -----END PGP SIGNATURE-----
    
    _______________________________________________
    LogAnalysis mailing list
    LogAnalysis@private
    http://lists.shmoo.com/mailman/listinfo/loganalysis
    
    
    Note:  The information contained in this message may be privileged and
    confidential and protected from disclosure.  If the reader of this message
    is not the intended recipient, or an employee or agent responsible for
    delivering this message to the intended recipient, you are hereby notified
    that any dissemination, distribution or copying of this communication is
    strictly prohibited.  If you have received this communication in error,
    please notify us immediately by replying to the message and deleting it from
    your computer. Thank you.  ThruPoint, Inc. 
    
    
    
    
    
    _______________________________________________
    LogAnalysis mailing list
    LogAnalysis@private
    http://lists.shmoo.com/mailman/listinfo/loganalysis
    



    This archive was generated by hypermail 2b30 : Wed Feb 11 2004 - 11:53:29 PST