Tomcat server can be configured to use different type of logging systems, the server has default logging configuration and can be configured to use log4j. Tomcat can also create access logs based on the Access Log Valve.
...
For log type out and servlet, those logs can be name by default catalina.out, and will be located under the logs directory. Use the following XpoLog pattern for those logs
Example 1:
{date:Date,dd-MMM-yyyy HH:mm:ss.SSS} {priority:PriorirytPriority,ftype=severity,ALL;FINEST;FINER;FINE;INFO;CONFIG;WARNING;SEVERE;ERROR} [{text:thread,ftype=thread}] {text:Source,ftype=source} {string:Message,ftype=message}
...
- Add Log Data In XpoLog, When adding a log to XpoLog you can now select the Log Type (logtype) for Apache Tomcat Access with the following logtypes:
- tomcat
- in addition select the log type - access
- tomcat
Tomcat access logs are created with the AccessLogValve or with ExtendedAccessLogValve implementation.
For the configuration look into the server <TOMCAT-HOME/conf/server.xml> / (Linux "/etc/tomcat/conf/server.xml") or other webapp configuration files and search for the following:
<Engine name="Catalina" defaultHost="localhost">
<Host name="localhost" ...
<!-- Access log processes all example.
Documentation at: /docs/config/valve.html
Note: The pattern used is equivalent to using pattern="common"
<Valve className="org.apache.catalina.valves.AccessLogValve"
directory="logs"
prefix="localhost_access
...
Example
The _log."
suffix=".txt"
pattern="%h %l %u %t "%r" %s %b"
/>
</Host>
</Engine>
Thepattern field may defined also as below:
The shorthand pattern pattern="common"
corresponds to the Common Log Format defined by '%h %l %u %t "%r" %s %b'.
The shorthand pattern pattern="combined"
appends the values of the Referer
and User-Agent
headers, each in double quotes, to the common
pattern.
In the Apache Tomcat configuration file, usually server.xml or by default, located under the conf/ directory (Linux "/etc/tomcat/conf") search for the Access Log Valve element in the XML:
"%a %l %u %t \"%r\" %>s %b %D \"%{Referer}i\" \"%{User-Agent}i\"" combined
The following sequence is the log structure definition for the Httpd server %a %l %u %t \"%r\" %>s %b %D \"%{Referer}i\" \"%{User-Agent}i\"
In XpoLog such pattern (combined) will be translated into:
{iptext:Client IPRemoteHost,ftype=remoteip;type=;,} {stringtext:Remote Log Namelogname,ftype=remotelog;,} {stringtext:Remote User,ftype=remoteuser;,} [{date:Date,locale=en;,dd/MMM/yyyy:HH:mm:ss z}] "{choice:Method,ftype=reqmethod;,GET;POST;HEAD} {stringurl:URL,paramsFtype=querystring;ftype=requrl;paramsName=Query;,} {string:reqprotocol,ftype=reqprotocol;,}{block,start,emptiness=true}?{string:Query,ftype=querystring;,}{block,end,emptiness=true} {string:reqprotocol,ftype=reqprotocol;,}" {number:Status,ftype=respstatus;,} {number:Bytes Sent,ftype=bytesent;,} "{string:Referer,ftype=referer;,}" "{string:User Agent,ftype=useragent;,}"{eoe}" {number:ResponseStatus,ftype=respstatus} {number:Bytes Sent,ftype=bytesent} "{string:RefererQuery,ftype=refererquery;,}{regexp:Referer,ftype=referer;refName=RefererQuery,^([\w-]+://[^?]+|/[^?]+)}" "{string:User Agent,ftype=useragent;,}"{eoe}
In XpoLog such pattern (common) will be translated into:
{text:RemoteHost,ftype=remoteip} {text:logname,ftype=remotelog} {text:Remote User,ftype=remoteuser} [{date:Date,locale=en;,dd/MMM/yyyy:HH:mm:ss z}] "{choice:Method,ftype=reqmethod;,GET;POST;HEAD} {url:URL,paramsFtype=querystring;ftype=requrl;paramsName=Query;,} {string:reqprotocol,ftype=reqprotocol;,}" {number:ResponseStatus,ftype=respstatus} {number:Bytes Sent,ftype=bytesent}{eoe}
Apache Tomcat Access Log Format Conversion Table logtyep both for AccessLogValve and for ExtendedAccessLogValve
logtype should be set to: tomcat, access
...
Format String | Description | XpoLog Pattern | XpoLog ftype | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Remote IP-address | {ip:RemoteIPgeoip:Remote IP,ftype=remoteip} | remoteip | ||||||||||||
%{c}a | Underlying peer IP address and port of the connection | {geoip:Remote IP,ftype=remoteip} | remoteip | ||||||||||||
| Local IP-address | {ip:LocalIPLocal IP,ftype=localip} | localip | ||||||||||||
| Size of response in bytes, excluding HTTP headers. | {number:BytesSentBytes Sent,ftype=bytesent} | bytesent | ||||||||||||
| Bytes sentSize of response in bytes, excluding HTTP headers, or . In CLF format, i.e. a ' | {textnumber:BytesSentBytes Sent,ftype=bytesent} | bytesent | ||||||||||||
| The contents of cookie Foobar in the request sent to the server. Only version 0 cookies are fully supported. | {string:Cookie_< FOOBAR >} Replace < FOOBAR > with cookie name | |||||||||||||
| The time taken to serve the request, in microseconds. | {number:ResponseTimeMicroSecs,ftype=responsetimemicroprocessrequestmicrosecs} | responsetimemicro | %F | Time taken to commit the response, in millis | {number:ResponseTimeMilliSecs,ftype=responsetimemilli} | responsetimemilliprocessrequestmicrosecs | ||||||||
| The contents of the environment variable FOOBAR | {string:EnvVariable_< FOOBAR >} Replace < FOOBAR > with variable name | |||||||||||||
| Filename | {text:FileName}
| |||||||||||||
| Remote host name (or IP address if enableLookups for the connector is if | {text:Remotehost,ftype=remotehostremoteip} remotehost | remoteip | ||||||||||||
| The request protocol | {text:RequestProtocol,ftype=reqprotocol}
| reqprotocol | ||||||||||||
| The contents of Foobar affect this. If you're interested in what the request header was prior to when most modules would have modified it, use mod_setenvif to copy the header into an internal environment variable and log that value with the | {text:<FOOBAR>} https://en.wikipedia.org/wiki/List_of_HTTP_header_fields and and so on it goes for the different headers.
| |||||||||||||
| Referer | { textThe referer which is associated with the request | {string:RefererQuery,ftype=refererquery;,}{regexp:Referer,ftype=referer;refName=RefererQuery,^([\w-]+://[^?]+|/[^?]+)}
| referer | |||||||||||
| agentAgent | User-agentThe User Agent which is associated with the request | {text:User-agent,ftype=useragent} | useragent | |||||||||||
%{ X-Forwarded-For}i | X-Forwarded-For | Method for identifying the originating IP address of a client connecting to a web server through an HTTP proxy or load balancer. | {text:X-Forwarded-For,ftype=forwardforip}
| forwardforip | |||||||||||
| Current request thread name (can compare later with stacktraces) | {text:RequestThread,ftype=thread} | thread | ||||||||||||
| Remote logical username from identd (always returns '-') | {text:logicalname, ftype=logicalname} | logicalname
| Number of keepalive requests handled on this connection. Interesting if KeepAlive is being used, so that, for example, a '1' means the first keepalive request after the initial one, '2' the second, etc...; otherwise this is always 0 (indicating the initial request). Available in versions 2.2.11 and later. | {number:KeepAlive} | ||||||||||
| Remote logname (from identd, if supplied). This will return a dash unless mod_ident is present and IdentityCheck is set | {text:logname,ftype=remotelog} | remotelog | ||||||||||||
| The request method | {textchoice:RequestMethodMethod,ftype=reqmethod;,GET;POST;HEAD} | reqmethod | ||||||||||||
| The contents of note Foobar from another module. | {string:<FOOBAR>}
| |||||||||||||
| The contents of Foobar | {string:<FOOBAR>}
| |||||||||||||
| The canonical local port of the server serving the request | {number:ServerPort,ftype=serverport} | serverport | ||||||||||||
| The canonical local port of the server serving the request or the server's actual port or the client's actual port. Valid formats are
| {number:ServerPort,ftype=serverport} {number:LocalServerPort,ftype=localserverport} {number:RemotePort,ftype=remoteport} | serverport localserverporttlocalserverportt remoteport | ||||||||||||
| The process ID of the child that serviced the request. | {text:ProcessID,ftype=processid} | processid | ||||||||||||
| The process ID or thread id of the child that serviced the request. Valid formats are | {text:ProcessID,ftype=processid} Valid formats are | processid | ||||||||||||
%{pid}P | {text:ProcessID,ftype=processid} | processid | |||||||||||||
%{tid}P | {text:ThreadID,ftype=threadid} | threadid | |||||||||||||
%{hextid}P | {text:HexThreadID,ftype=hexthreadid} | hexthreadid | |||||||||||||
%q | The query string (prepended with a | {text:QueryString,ftype=querystring} OR Suggest a regexp that will build a list of parameters as cloumns. The query string (prepended with a | querystring | ||||||||||||
| First line of the request (method and request URI) | {text:FirstLine,ftype=reqfirstline} TBD - might be parsed to multiple value and types}
| reqfirstline |
| reqmethod requrl querystring reqprotocol | ||||||||||
| The handler generating the response (if any). | {text:ResponseHandler}
| |||||||||||||
| Status. For requests that got internally redirected, this is the status of the *original* request --- | {number:ResponseStatus,ftype=respstatus} . For requests that got internally redirected, this is the status of the *original* request --- %>s for the last. | respstatus | ||||||||||||
%S | User | sessionSession ID | {text: | UserSessionIdUserSessionID,ftype=sessionid} | sessionid | ||||||||||
| Time the request was received (standard english format) | {date:Date,locale=en,dd/MMM/yyyy:HH:mm:ss z}
| |||||||||||||
%{ format}t | The time, in the form given by format, which should be in an extended the time is taken at the beginning of the request processing. If it starts with processing. In addition to the formats supported by
These tokens can not be combined with each other or The extended | {date:Date,locale=en,dd/MMM/yyyy:HH:mm:ss z} sec number of seconds since the Epoch | |||||||||||||
| The time taken to serve the request, in seconds. | {number:ResponseTimeSecs,ftype=processrequestsecs} | processrequestsecs | ||||||||||||
| The time taken to serve the request, in a time unit given by | ftype=processrequestsec} same result as |
| processrequestmilli processrequestmicrosecs processrequestsecs | |||||||||||
| Remote user that was authenticated (if any), else '-'{text:from auth; may be bogus if return status ( | {string:Remote User,ftype=remoteuser;,} Remote user (from auth; may be bogus if return status ( | remoteuser | ||||||||||||
| The URL path requested, not including any query string. | {text:RequestURL,ftype=requrl} The URL path requested, not including any query string. | requrl | ||||||||||||
| The canonical ServerName of the server serving the request. | {text:ServerName,ftype=servername} | servername | ||||||||||||
| The server name according to the UseCanonicalName setting. | {text:ServerName,ftype=servername} The server name according to the UseCanonicalName setting. | servername | ||||||||||||
| Connection status when response is completed:
(This directive was | {text:ConnectionStatus} Connection status when response is completed:
(This directive was | |||||||||||||
| Bytes received, including request and headers, cannot be zero. You need to enable mod_logio to use this. | {number:TotalBytesWHeadersReceived,ftype=reqbyteswheaders} (with headers) | reqbyteswheaders | ||||||||||||
| Bytes sent, including headers, cannot be zero. You need to enable mod_logio to use this. | {number:TotalBytesWHeadersSent,ftype=respbyteswheaders} (with headers – can help compute header size) | respbyteswheaders | ||||||||||||
| The contents of VARNAME | {text:Req_<VARNAME>} The content of VARNAME: trailer line(s) in the request sent to the server. | |||||||||||||
| The contents of VARNAME | {text:Resp_<VARNAME>} The contents of VARNAME | |||||||||||||
|