Logs are added in old rotated file instead of new file - java

Below is my log4j2.xml file:
<?xml version="1.0" encoding="UTF-8"?>
<Configuration xmln="http //logging.apache.org/log4j/2.0/config">
<Appenders>
<RollingFile name="File" fileName="${path}/server.log"
filePattern="${path}/server.log.%d{yyyy-MM-dd-HH}-%i">
<PatternLayout>
<Pattern>%d %p %c [%t] %m%n</Pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="1 MB"/>
</Policies>
<DefaultRolloverStrategy fileIndex="nomax" />
</RollingFile>
</Appenders>
<RollingFile name="ExceptionLogs" fileName="${path}/ExceptionLogs.log"
filePattern="${path}/ExceptionLogs.log.%d{yyyy-MM-dd-HH}-%i">
<PatternLayout>
<Pattern>%d %p %c [%t] %m%n</Pattern>
</PatternLayout>
<Policies>
<SizeBasedTriggeringPolicy size="1 MB"/>
</Policies>
<DefaultRolloverStrategy fileIndex="nomax" />
</RollingFile>
</Appenders>
<Loggers>
<Logger name="com.x.aop.exception">
<AppenderRef ref="ExceptionLogs"/>
</Logger>
<Root level="ERROR">
<AppenderRef ref="File"/>
</Root>
</Loggers>
</Configuration>
Let's say my server started at 3:00 PM and I have 5 log files
server.log
server.log.2022-01-19-15-1 (1 MB)
server.log.2022-01-19-15-2 (1 MB)
server.log.2022-01-19-15-3 (1 MB)
server.log.2022-01-19-15-4 (1 MB)
server.log.2022-01-19-15-5 (1 MB)
Some time it will add in older file created (like server.log.2022-01-19-15-2, server.log.2022-01-19-15-1) instead of latest file
Why logs are added in already rotated file instead of latest highest number log file?

Related

migrating log4j.xml to log4j2.xml jdk8

Hello i am migrating to latest log4j version and migrated from 1.x to 2.x log4j. So here is my log4j2 config file. I am stuck with debug and error logs, maybe someone could see that if there should be something different.
<?xml version="1.0" encoding="UTF-8" ?>
<Configuration status="debug" packages="">
<Appenders>
<!-- System.out log -->
<Console name="console" target="SYSTEM_OUT">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
</Console>
<!-- debug log -->
<RollingFile name="debug" fileName="/var/logs/debug.log"
filePattern="/var/logs/%d{ddMMyyyy}_debug.log.gz">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/>
</Policies>
<LevelRangeFilter minLevel="debug" maxLevel="info" onMatch="accept"/>
</RollingFile>
<!-- error log -->
<RollingFile name="error" fileName="/var/logs/error.log"
filePattern="/var/logs/%d{ddMMyyyy}_error.log.gz">>
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/>
</Policies>
<LevelRangeFilter minLevel="warn" maxLevel="fatal" onMatch="accept"/>
</RollingFile>
<!-- info log -->
<RollingFile name="info" fileName="/var/logs/info.log"
filePattern="/var/logs/%d{ddMMyyyy}_info.log.gz">>
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB"/>
</Policies>
<LevelRangeFilter minLevel="info" maxLevel="info" onMatch="accept"/>
</RollingFile>
<!-- Special daily time log. Logib kui palju aega iga Request vytab -->
<RollingFile name="timelog" fileName="/var/logs/input_timing.log"
filePattern="'.'yyyy-MM-dd'.log'">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- accesslog log appender -->
<RollingFile name="accesslog" fileName="/var/logs/access_log.log"
filePattern="'_'yy_ww'.txt'">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<RollingFile name="todolog" fileName="/var/logs/todo.log"
filePattern="'.'yyyy-MM-dd'.log'" ignoreExceptions="false">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- Special redirections servlet log. Logib online_report servlet'i teated -->
<RollingFile name="redirectlog" fileName="/var/logs/redirect.log"
filePattern="'.'yyyy-MM-dd'.log'" ignoreExceptions="false">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- Asynchronous appender. Writes the log, when it has the time. -->
<Async name="asyncRoot" bufferSize="10" includeLocation="true">
<AppenderRef ref="info"/>
<AppenderRef ref="error" level="error" />
<AppenderRef ref="debug" level="debug" />
</Async>
</Appenders>
<Loggers>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="TIMING" additivity="false" level="info">
<AppenderRef ref="timelog"/>
</Logger>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="TODO" additivity="false" level="info">
<AppenderRef ref="todolog"/>
</Logger>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="ACCESS" additivity="false" level="info">
<AppenderRef ref="accesslog"/>
</Logger>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="REDIRECT" additivity="false" level="info">
<AppenderRef ref="redirectlog"/>
</Logger>
<!-- root logger -->
<Root level="debug">
<AppenderRef ref="asyncRoot"/>
</Root>
</Loggers>
</Configuration>
public class EffencyTests {
private static final Logger log = LogManager.getLogger(EffencyTests.class);
#Before
public void cos() {
log.info("hey");
log.debug("czesc");
log.error("smth");
}
#Test
public void cosata() {
log.info("hey");
log.info("hey");
log.info("hey");
log.info("hey");
log.info("hey");
log.info("hey");
log.debug("hey");
}
#Test
public void cosatae() {
int numberOne = 1;
int numberTwo = 2;
log.info("test");
try {
if(numberOne != numberTwo) {
throw new IllegalArgumentException();
}
}catch (Exception e){
log.error("error");
}
}
here is some output on info log :
error.log and debug.log are empty, i am really stuck for a long time can anyone help me with that ? I am struggling for over month and i feel like there is single letter in config is missing. Looking for any ideas and help thanks
if anyone would struggle it helped at my case :
<?xml version="1.0" encoding="UTF-8"?>
<Configuration status="debug">
<Appenders>
<!-- System.out log -->
<Console name="console" target="SYSTEM_OUT">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
</Console>
<!-- error log -->
<RollingFile name="error" fileName="./logs/errors.log"
filePattern="./logs/${date:yyyy-MM}/errors-%d{yyyy-MM-dd}-%i.log.gz"
filePermissions="rw-rw-r--">
<PatternLayout>
<Pattern>%d{ISO8601} [%t] %-5p %c{1} - %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy interval="6" modulate="true"/>
<SizeBasedTriggeringPolicy size="10 MB"/>
</Policies>
</RollingFile>
<!-- info log -->
<RollingFile name="info" fileName="./logs/info.log"
filePattern="./logs/${date:yyyy-MM}/info-%d{yyyy-MM-dd}-%i.log.gz"
filePermissions="rw-rw-r--">
<PatternLayout>
<Pattern>%d{ISO8601} [%t] %-5p %c{1} - %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy interval="6" modulate="true"/>
<SizeBasedTriggeringPolicy size="10 MB"/>
</Policies>
<LevelRangeFilter minLevel="info" maxLevel="info" onMatch="accept"/>
</RollingFile>
<!-- debug log -->
<RollingFile name="debug" fileName="./logs/debug.log"
filePattern="./logs/${date:yyyy-MM}/debug-%d{yyyy-MM-dd}-%i.log.gz"
filePermissions="rw-rw-r--">
<PatternLayout>
<Pattern>%d{ISO8601} [%t] %-5p %c{1} - %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy interval="6" modulate="true"/>
<SizeBasedTriggeringPolicy size="10 MB"/>
</Policies>
<LevelRangeFilter minLevel="debug" maxLevel="debug" onMatch="accept"/>
</RollingFile>
<!-- Special daily time log. Logib kui palju aega iga Request vytab -->
<RollingFile name="timelog" fileName="./logs/input_timing.log"
filePattern="'.'yyyy-MM-dd'.log'"
filePermissions="rw-rw-r--">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- accesslog log appender -->
<RollingFile name="accesslog" fileName="./logs/access_log.log"
filePattern="'_'yy_ww'.txt'"
filePermissions="rw-rw-r--">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- Special todo jobs log. Logib kõik genereeritud todo sõnumid -->
<RollingFile name="todolog" fileName="./logs/todo.log"
filePattern="'.'yyyy-MM-dd'.log'" ignoreExceptions="false"
filePermissions="rw-rw-r--">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- Special redirections servlet log. Logib online_report servlet'i teated -->
<RollingFile name="redirectlog" fileName="./logs/redirect.log"
filePattern="'.'yyyy-MM-dd'.log'" ignoreExceptions="false"
filePermissions="rw-rw-r--">
<PatternLayout pattern="%d{ISO8601} [%t] %-5p %c{1} - %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="20 MB"/>
</Policies>
</RollingFile>
<!-- Asynchronous appender. Writes the log, when it has the time. -->
<Async name="asyncRoot" bufferSize="10" includeLocation="true">
<AppenderRef ref="info"/>
<AppenderRef ref="error" level="error"/>
</Async>
</Appenders>
<Loggers>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="TIMING" additivity="false" level="info">
<AppenderRef ref="timelog"/>
</Logger>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="TODO" additivity="false" level="info">
<AppenderRef ref="todolog"/>
</Logger>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="ACCESS" additivity="false" level="info">
<AppenderRef ref="accesslog"/>
</Logger>
<!-- additivity false - do not log to other appenders as defined here -->
<Logger name="REDIRECT" additivity="false" level="info">
<AppenderRef ref="redirectlog"/>
</Logger>
<!-- Level order (low to high): TRACE < DEBUG < INFO < WARN < ERROR < FATAL -->
<Root level="DEBUG" includeLocation="true">
<!--AppenderRef Medium ref Values must be defined earlier appenders-->
<AppenderRef ref="asyncRoot"/>
<!-- <AppenderRef ref="debug" level="debug"/>-->
</Root>
</Loggers>
</Configuration>

Compress log files which are older than 5 days using log4j2

Currently, my logs are generating 1 file per day.
But I want to compress the log files older than 5 days and delete them after 10 days.
how can I achieve this?
<?xml version="1.0" encoding="UTF-8"?>
<Configuration status="debug" name="MyApp" packages="">
<Appenders>
<RollingFile name="RollingFile" fileName="logs/server.log"
filePattern="logs/server_%d{date:yyyy-MM-dd}.log">
<PatternLayout>
<Pattern>%d %p %c{1.} [%t] %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy interval="1" modulate="true" />
</Policies>
</RollingFile>
</Appenders>
<Loggers>
<Root level="info">
<AppenderRef ref="RollingFile"/>
</Root>
</Loggers>
</Configuration>

Daily rolling with limit for backup files with logj4

Im usign log4j2 for logging. I need daily logging with keeping a backup of 5 days logs. My log4j2.xml looks as below. My backup files keep on increasing in number eventhough ive limited the number to 5. Where did i go wrong??
<?xml version="1.0" encoding="UTF-8"?>
<Configuration status="trace" monitorInterval="300">
<Appenders>
<RollingFile name="roll-by-time-and-size"
fileName="C:\\Users\\ann\\logs\\testing.log"
filePattern="C:\\Users\\ann\\logs\\testing.%d{MM-dd-yyyy}.log.gz"
ignoreExceptions="false">
<PatternLayout>
<Pattern>%d{yyyy-MM-dd HH:mm:ss} %p %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy/>
</Policies>
<DefaultRolloverStrategy max="5"/>
<!-- <DefaultRolloverStrategy>
<Delete basePath="C:\\Users\\ann\\logs" maxDepth="1">
<IfFileName glob="C:\\Users\\ann\\logs\\test.*.log.gz" />
<IfLastModified age="3" />
</Delete>
</DefaultRolloverStrategy> -->
</RollingFile>
<Console name="Console" target="SYSTEM_OUT">
<PatternLayout pattern="%d{HH:mm:ss.SSS} [%t] %-5level %logger{36} - %msg%n">
</PatternLayout>
</Console>
</Appenders>
<Loggers>
<Root level="ALL">
<AppenderRef ref="roll-by-time-and-size"/>
<AppenderRef ref="Console"/>
</Root>
</Loggers>
</Configuration>
Instead of the max consider using the delete rule.

ImmediateFlush not working in Log4j2

I am getting this error:
ERROR asyncRoot contains an invalid element or attribute "immediateFlush"
When I use immediateFlush attribute in appender in log4j2.xml.
<Appenders>
<Console name="STDOUT" target="SYSTEM_OUT">
<PatternLayout pattern="%d{dd-MM-yy HH:mm:ss} [$${ctx:instId} - $${ctx:userId}] %c.%M(%L)- %m%n" />
</Console>
<RollingFile name="csroot"
fileName="${cslogs}/cslog.log" filePattern="${cslogs}/$${date:yyyy-MM}/cslog-%d{yyyy-MM-dd}-%i.log">
<PatternLayout pattern="%d{dd-MM-yy HH:mm:ss} [$${ctx:instId} - $${ctx:userId}] %c.%M(%L)- %m%n" immediateFlush="false"/>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB" />
</Policies>
<DefaultRolloverStrategy max="1000">
</DefaultRolloverStrategy>
</RollingFile>
</Appenders>
Try with this modification:
<RollingFile name="csroot"
fileName="${cslogs}/cslog.log" filePattern="${cslogs}/$${date:yyyy-MM}/cslog-%d{yyyy-MM-dd}-%i.log" immediateFlush="false">
<PatternLayout pattern="%d{dd-MM-yy HH:mm:ss} [$${ctx:instId} - $${ctx:userId}] %c.%M(%L)- %m%n"/>
<Policies>
<SizeBasedTriggeringPolicy size="100 MB" />
</Policies>
<DefaultRolloverStrategy max="1000">
</DefaultRolloverStrategy>
</RollingFile>
immediateFlush is not an attribute of PatternLayout.
I know its quite an old question but might help somebody.
RollingFile Appender Parameters points out the immediateFlush is the property of the appender. But you have it declared as an attribute for PatternLayout which is what is causing the error.
Sample RollingFile appender configuration:
<?xml version="1.0" encoding="UTF-8"?>
<Configuration status="warn" name="MyApp" packages="">
<Appenders>
<RollingFile name="RollingFile" fileName="logs/app.log"
filePattern="logs/$${date:yyyy-MM}/app-%d{MM-dd-yyyy}-%i.log.gz"
immediateFlush="false">
<PatternLayout>
<Pattern>%d %p %c{1.} [%t] %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy/>
<SizeBasedTriggeringPolicy size="250 MB"/>
</Policies>
</RollingFile>
</Appenders>
<Loggers>
<Root level="error">
<AppenderRef ref="RollingFile"/>
</Root>
</Loggers>
</Configuration>

How does RollingFileAppender work with log4j2?

I'm use to RollingFileAppender on normal log4j. Now I'm switching to log4j2, and cannot get the appender to work.
The File appender below works as expected. But the logging file for RollingFile is never created. Why?
<?xml version="1.0" encoding="UTF-8"?>
<Configuration>
<Appenders>
<File name="FILE" fileName="c:/logs.log">
<PatternLayout pattern="%d %p %c: %m%n" />
</File>
<RollingFile name="ROLLING" fileName="c:/logsroll.log">
<PatternLayout pattern="%d %p %c: %m%n"/>
<Policies>
<TimeBasedTriggeringPolicy />
<SizeBasedTriggeringPolicy size="0.001 MB"/>
</Policies>
<DefaultRolloverStrategy max="10"/>
</RollingFile>
</Appenders>
<Loggers>
<Root level="info">
<AppenderRef ref="FILE" />
<AppenderRef ref="ROLLING" />
</Root>
</Loggers>
</Configuration>
The RollingFile tag is missing a filePattern attribute.
<RollingFile name="ROLLING"
fileName="c:/logsroll.log"
filePattern="c:/logsroll-%i.log">
I used log4j2 version 2.0, in some cases it throws error if you do not set any date in file pattern, in this case you can use some thing like below:
<RollingFile name="MyFile" fileName="d:/log/bsi/admin/total/totalLog.log"
filePattern="d:/log/totalLog-%d{MM-dd-yyyy}-%i.log">
<PatternLayout>
<Pattern>%d %p %c [%t] %m%n</Pattern>
</PatternLayout>
<Policies>
<TimeBasedTriggeringPolicy />
<SizeBasedTriggeringPolicy size="1 MB"/>
</Policies>
<DefaultRolloverStrategy max="2000"/>
</RollingFile>

Categories