Project Description
A completly automated Apache and IIS web log file scrubber. Reduces the amount of processing and storage capacity required for third party analytics software.

Project Requirements
  • Reduce the overall log size to meaningful data only.
    • Remove all image files. (.gif, .jpg, .bmp)
    • Remove all supporting files. (.css, .js, .swf, .fla)
    • Provide User Interface to add custom removal. (Regular Expression, String)
  • Run completely autonomously as a service
  • Move and compress scrubbed log files to stage for processing.
  • Technical Requirements

Project Drivers
  • Reduce time and cost associated with processing log files through third party Analytics software.
  • Reduce space requirements for storage of log data for compliance reasons.

Author
Bradley Foley http://www.blfoley.com/

Support This Project And Others
Donate Now

Last edited Jan 14, 2009 at 10:37 PM by blfoleyus, version 7