Saving http requests from production (similar to access log)
Using several types of web servers in production (i.e. Weblogic 8.1.5, Tomcat, Apache, even IPlanet 4.1) and we would like to capture all http traffic sent by clients (i.e. ServletRequest) into production portals.
With most web servers almost all http request data can be sent to the access log (by either extending the types of stated fields in the access log or defines custom field identifiers). The problem is that with web services like Weblogic any modifications to content in the access log requires a restart and exploded the actuall access log file with too much data. What I want is to save production http calls:
1) without requiring an application server restart
2) ability to start/stop recording as well configure types of identifies returned from ServletRequest objects dynamically
3) eventually playback recorded data into a non-production system to fake capacity
One option might be to use programs like Ethereal to capture traffic on a particular host/port and filter that data. Or write a simple ServletFilter that asynchronously pipes data to a warehouse.
Any suggestions?

