`
albert2012
  • 浏览: 14143 次
  • 性别: Icon_minigender_1
  • 来自: 南京
社区版块
存档分类
最新评论

log4j DailyRollingFileAppender支持保留最近n天,并且可以对一天的文件根据大小切分

阅读更多

log4j DailyRollingFileAppender不支持只保留最近n天的数据,时间一久导致日志文件很多,并且一天的文件有可能比较大,所以自己写了个appender,以解决这两个问题。

    具体代码实现如下:

package com.mytools.common.log4jext;

import java.io.File;
import java.io.FileFilter;
import java.io.IOException;
import java.io.Writer;
import java.text.SimpleDateFormat;
import java.util.Calendar;
import java.util.Date;
import java.util.GregorianCalendar;
import java.util.Locale;
import java.util.TimeZone;

import org.apache.log4j.FileAppender;
import org.apache.log4j.Layout;
import org.apache.log4j.Level;
import org.apache.log4j.Logger;
import org.apache.log4j.PatternLayout;
import org.apache.log4j.helpers.CountingQuietWriter;
import org.apache.log4j.helpers.LogLog;
import org.apache.log4j.spi.LoggingEvent;

/**
 * log4j appender扩展<br>
 * (1)按天并且只保留最近n天的 <br>
 * (2)如果一天的文件过大,可以按配置的大小将一天的文件进行切分
 * 
 * @author shaoqz
 * @since 2016-6-13
 */
public class MyDailyRollingFileAppender extends FileAppender
{

	// The code assumes that the following constants are in a increasing
	// sequence.
	static final int TOP_OF_TROUBLE = -1;
	static final int TOP_OF_MINUTE = 0;
	static final int TOP_OF_HOUR = 1;
	static final int HALF_DAY = 2;
	static final int TOP_OF_DAY = 3;
	static final int TOP_OF_WEEK = 4;
	static final int TOP_OF_MONTH = 5;

	/**
	 * The gmtTimeZone is used only in computeCheckPeriod() method.
	 */
	public static final TimeZone gmtTimeZone = TimeZone.getTimeZone("GMT");

	/**
	 * The default maximum file size is 10MB. , 10K for test
	 */
	protected long maxFileSize = 10 * 1024;

	/**
	 * The date pattern. By default, the pattern is set to "'.'yyyy-MM-dd" meaning daily
	 * rollover.
	 */
	private String datePattern = "'.'yyyy-MM-dd";

	/**
	 * There is one backup file by default.
	 */
	private int maxBackupIndex = 1;

	/**
	 * The log file will be renamed to the value of the scheduledFilename variable when
	 * the next interval is entered. For example, if the rollover period is one hour, the
	 * log file will be renamed to the value of "scheduledFilename" at the beginning of
	 * the next hour. The precise time when a rollover occurs depends on logging activity.
	 */
	private String scheduledFilename;

	/**
	 * The next time we estimate a rollover should occur.
	 */
	private long nextCheck = System.currentTimeMillis() - 1;

	private Date now = new Date();

	private SimpleDateFormat sdf;

	private MyRollingCalendar rollingCalendar = new MyRollingCalendar();

	public int checkPeriod = TOP_OF_TROUBLE;

	/**
	 * The default constructor does nothing.
	 */
	public MyDailyRollingFileAppender()
	{
	}

	/**
	 * Instantiate a <code>DailyRollingFileAppender</code> and open the file designated by
	 * <code>filename</code>. The opened filename will become the ouput destination for
	 * this appender.
	 */
	public MyDailyRollingFileAppender(Layout layout, String filename, String datePattern) throws IOException
	{
		super(layout, filename, true);
		this.datePattern = datePattern;
		activateOptions();
	}

	/**
	 * The <b>DatePattern</b> takes a string in the same format as expected by
	 * {@link SimpleDateFormat}. This options determines the rollover schedule.
	 */
	public void setDatePattern(String pattern)
	{
		datePattern = pattern;
	}

	/** Returns the value of the <b>DatePattern</b> option. */
	public String getDatePattern()
	{
		return datePattern;
	}

	/**
	 * 设置日志文件最大备份数
	 * <p>
	 * The <b>MaxBackupIndex</b> option determines how many backup files are kept before
	 * the oldest is erased. This option takes a positive integer value. If set to zero,
	 * then there will be no backup files and the log file will be renamed to the value of
	 * the scheduledFilename variable when the next interval is entered.
	 */
	public void setMaxBackupIndex(int maxBackups)
	{
		this.maxBackupIndex = maxBackups;
	}

	/**
	 * 返回日志文件最大备份数
	 */
	public int getMaxBackupIndex()
	{
		return maxBackupIndex;
	}

	public void activateOptions()
	{
		super.activateOptions();

		LogLog.debug("Max backup file kept: " + maxBackupIndex + ".");

		if (datePattern != null && fileName != null)
		{
			now.setTime(System.currentTimeMillis());
			sdf = new SimpleDateFormat(datePattern);
			int type = computeCheckPeriod();
			printPeriodicity(type);
			rollingCalendar.setType(type);
			File file = new File(fileName);
			scheduledFilename = fileName + sdf.format(new Date(file.lastModified()));
		}
		else
		{
			LogLog.error("Either File or DatePattern options are not set for appender [" + name + "].");
		}
	}

	void printPeriodicity(int type)
	{
		switch (type)
		{
			case TOP_OF_MINUTE:
				LogLog.debug("Appender [[+name+]] to be rolled every minute.");
				break;
			case TOP_OF_HOUR:
				LogLog.debug("Appender [" + name + "] to be rolled on top of every hour.");
				break;
			case HALF_DAY:
				LogLog.debug("Appender [" + name + "] to be rolled at midday and midnight.");
				break;
			case TOP_OF_DAY:
				LogLog.debug("Appender [" + name + "] to be rolled at midnight.");
				break;
			case TOP_OF_WEEK:
				LogLog.debug("Appender [" + name + "] to be rolled at start of week.");
				break;
			case TOP_OF_MONTH:
				LogLog.debug("Appender [" + name + "] to be rolled at start of every month.");
				break;
			default:
				LogLog.warn("Unknown periodicity for appender [[+name+]].");
		}
	}

	int computeCheckPeriod()
	{
		MyRollingCalendar rollingPastCalendar = new MyRollingCalendar(gmtTimeZone, Locale.ENGLISH);
		// set sate to 1970-01-01 00:00:00 GMT
		Date epoch = new Date(0);

		if (datePattern == null)
		{
			return TOP_OF_TROUBLE;
		}

		for (int i = TOP_OF_MINUTE; i <= TOP_OF_MONTH; i++)
		{
			SimpleDateFormat simpleDateFormat = new SimpleDateFormat(datePattern);
			simpleDateFormat.setTimeZone(gmtTimeZone); // do all date formatting in
														// GMT
			String r0 = simpleDateFormat.format(epoch);
			rollingPastCalendar.setType(i);
			Date next = new Date(rollingPastCalendar.getNextCheckMillis(epoch));
			String r1 = simpleDateFormat.format(next);

			// System.out.println("Type = "+i+", r0 = "+r0+", r1 = "+r1);
			if (r0 != null && r1 != null && !r0.equals(r1))
			{
				return i;
			}
		}

		return TOP_OF_TROUBLE; // Deliberately head for trouble...
	}

	/**
	 * Rollover the current file to a new file.
	 */
	void rollOver() throws IOException
	{
		/* Compute filename, but only if datePattern is specified */
		if (datePattern == null)
		{
			errorHandler.error("Missing DatePattern option in rollOver().");
			return;
		}

		String datedFilename = fileName + sdf.format(now);
		// It is too early to roll over because we are still within the
		// bounds of the current interval. Rollover will occur once the
		// next interval is reached.
		if (scheduledFilename.equals(datedFilename))
		{
			return;
		}

		// close current file, and rename it to datedFilename
		this.closeFile();

		File target = new File(scheduledFilename);
		if (target.exists())
		{
			target.delete();
		}

		File file = new File(fileName);
		boolean result = file.renameTo(target);
		if (result)
		{
			LogLog.debug(fileName + " -> " + scheduledFilename);

			// If maxBackups <= 0, then there is no file renaming to be done.
			if (maxBackupIndex > 0)
			{
				// Delete the oldest file, to keep system happy.
				file = new File(fileName + dateBefore());

				// 删除很久以前的历史log文件
				deleteAncientFilesIfExists(file);

				if (file.exists())
				{
					file.delete();
				}
			}
		}
		else
		{
			LogLog.error("Failed to rename [[+fileName+]] to [[+scheduledFilename+]].");
		}

		try
		{
			// This will also close the file. This is OK since multiple close operations
			// are safe.
			this.setFile(fileName, false, this.bufferedIO, this.bufferSize);
		}
		catch (IOException e)
		{
			errorHandler.error("setFile(" + fileName + ", false) call failed.");
		}

		scheduledFilename = datedFilename;
	}

	/**
	 * 删除很久以前没有删除的日志文件(如果存在的话)
	 * 
	 * @param oldestFile
	 */
	private void deleteAncientFilesIfExists(final File oldestFile)
	{
		// 找出久远日志文件列表
		File[] ancientfiles = oldestFile.getParentFile().listFiles(new FileFilter()
		{

			@Override
			public boolean accept(File pathname)
			{
				if (pathname.getPath().replaceAll("\\\\", "/").startsWith(fileName.replaceAll("\\\\", "/"))
						&& pathname.getName().compareTo(oldestFile.getName()) < 0)
				{
					return true;
				}
				else
				{
					return false;
				}
			}
		});

		// 删除久远日志文件列表
		for (File ancientfile : ancientfiles)
		{
			// 如果文件比配置的最老日期还老的话,删掉
			ancientfile.delete();
		}
	}

	private String dateBefore()
	{
		String dataAnte = "";

		if (datePattern != null)
		{
			SimpleDateFormat simpleDateFormat = new SimpleDateFormat(datePattern);

			dataAnte = simpleDateFormat
					.format(new Date(rollingCalendar.getPastCheckMillis(new Date(), maxBackupIndex)));
		}

		return dataAnte;
	}

	/**
	 * This method differentiates DailyRollingFileAppender from its super class.
	 * <p>
	 * Before actually logging, this method will check whether it is time to do a
	 * rollover. If it is, it will schedule the next rollover time and then rollover.
	 */
	protected void subAppend(LoggingEvent event)
	{
		// 根据文件大小roll over
		rollOverBySize();

		// 根据时间roll over
		rollOverByTime();

		super.subAppend(event);
	}

	/**
	 * 根据文件大小roll over
	 */
	private void rollOverBySize()
	{
		long currentTimeMillis = System.currentTimeMillis();
		now.setTime(currentTimeMillis);

		if (fileName != null && qw != null)
		{
			long size = ((CountingQuietWriter) qw).getCount();
			if (size >= maxFileSize)
			{
				// close current file, and rename it
				this.closeFile();

				String rollingFileName = fileName + sdf.format(now) + '.' + currentTimeMillis;
				new File(fileName).renameTo(new File(rollingFileName));

				try
				{
					// This will also close the file. This is OK since multiple close
					// operations
					// are safe.
					this.setFile(fileName, false, this.bufferedIO, this.bufferSize);
				}
				catch (IOException e)
				{
					errorHandler.error("setFile(" + fileName + ", false) call failed.");
				}
			}
		}
	}

	/**
	 * 根据时间roll over
	 */
	private void rollOverByTime()
	{
		long currentTime = System.currentTimeMillis();

		if (currentTime < nextCheck)
		{
			return;
		}

		now.setTime(currentTime);
		nextCheck = rollingCalendar.getNextCheckMillis(now);

		try
		{
			rollOver();
		}
		catch (IOException ioe)
		{
			LogLog.error("rollOver() failed.", ioe);
		}
	}

	@Override
	public synchronized void setFile(String fileName, boolean append, boolean bufferedIO, int bufferSize)
			throws IOException
	{
		super.setFile(fileName, append, this.bufferedIO, this.bufferSize);
		if (append)
		{
			File f = new File(fileName);
			((CountingQuietWriter) qw).setCount(f.length());
		}
	}

	@Override
	protected void setQWForFiles(Writer writer)
	{
		this.qw = new CountingQuietWriter(writer, errorHandler);
	}

	/**
	 * 测试方法
	 */
	public static void main(String args[])
	{
		String className = MyDailyRollingFileAppender.class.getName();

		MyDailyRollingFileAppender myAppender = new MyDailyRollingFileAppender();

		myAppender.setDatePattern("'.'yyyy-MM-dd-HH");
		myAppender.setFile("E:/test/mylogApender/test.log");
		myAppender.setMaxBackupIndex(3);

		PatternLayout patternLayout = new PatternLayout("%d [%-5p]-[%t]-[%c{1}] (%F:%L) %m%n");
		myAppender.setLayout(patternLayout);

		System.out.println("getMaxBackupIndex():" + myAppender.getMaxBackupIndex());

		myAppender.activateOptions();

		for (int i = 0; i < 50000; i++)
		{
			myAppender.subAppend(new LoggingEvent(className, Logger.getLogger(className), Level.INFO,
					"test,hello " + i, null));

			try
			{
				Thread.sleep(100);
			}
			catch (InterruptedException ex)
			{
				ex.printStackTrace();
			}

			System.out.println("Fine attesa");
		}
	}
}

/**
 * MyRollingCalendar is a helper class to DailyMaxRollingFileAppender. Given a periodicity
 * type and the current time, it computes the past maxBackupIndex date.
 */
class MyRollingCalendar extends GregorianCalendar
{

	private static final long serialVersionUID = 1L;

	public static final int TOP_OF_TROUBLE = -1;
	public static final int TOP_OF_MINUTE = 0;
	public static final int TOP_OF_HOUR = 1;
	public static final int HALF_DAY = 2;
	public static final int TOP_OF_DAY = 3;
	public static final int TOP_OF_WEEK = 4;
	public static final int TOP_OF_MONTH = 5;

	int type = TOP_OF_TROUBLE;

	MyRollingCalendar()
	{
		super();
	}

	MyRollingCalendar(TimeZone tz, Locale locale)
	{
		super(tz, locale);
	}

	public long getPastCheckMillis(Date now, int maxBackupIndex)
	{
		return getPastDate(now, maxBackupIndex).getTime();
	}

	public Date getPastDate(Date now, int maxBackupIndex)
	{
		this.setTime(now);

		switch (type)
		{
			case TOP_OF_MINUTE:
				this.set(Calendar.MINUTE, this.get(Calendar.MINUTE) - maxBackupIndex);
				break;

			case TOP_OF_HOUR:
				this.set(Calendar.HOUR_OF_DAY, this.get(Calendar.HOUR_OF_DAY) - maxBackupIndex);
				break;

			case HALF_DAY:
				int hour = get(Calendar.HOUR_OF_DAY);
				if (hour < 12)
				{
					this.set(Calendar.HOUR_OF_DAY, 12);
				}
				else
				{
					this.set(Calendar.HOUR_OF_DAY, 0);
				}
				this.set(Calendar.DAY_OF_MONTH, this.get(Calendar.DAY_OF_MONTH) - maxBackupIndex);
				break;

			case TOP_OF_DAY:
				this.set(Calendar.DATE, this.get(Calendar.DATE) - maxBackupIndex);
				break;

			case TOP_OF_WEEK:
				this.set(Calendar.DAY_OF_WEEK, getFirstDayOfWeek());
				this.set(Calendar.WEEK_OF_YEAR, this.get(Calendar.WEEK_OF_YEAR) - maxBackupIndex);
				break;

			case TOP_OF_MONTH:
				this.set(Calendar.MONTH, this.get(Calendar.MONTH) - maxBackupIndex);
				break;

			default:
				throw new IllegalStateException("Unknown periodicity type.");
		}

		return this.getTime();
	}

	public long getNextCheckMillis(Date now)
	{
		return getNextCheckDate(now).getTime();
	}

	public Date getNextCheckDate(Date now)
	{
		this.setTime(now);

		switch (type)
		{
			case TOP_OF_MINUTE:
				this.set(Calendar.SECOND, 0);
				this.set(Calendar.MILLISECOND, 0);
				this.add(Calendar.MINUTE, 1);
				break;
			case TOP_OF_HOUR:
				this.set(Calendar.MINUTE, 0);
				this.set(Calendar.SECOND, 0);
				this.set(Calendar.MILLISECOND, 0);
				this.add(Calendar.HOUR_OF_DAY, 1);
				break;
			case HALF_DAY:
				this.set(Calendar.MINUTE, 0);
				this.set(Calendar.SECOND, 0);
				this.set(Calendar.MILLISECOND, 0);
				int hour = get(Calendar.HOUR_OF_DAY);
				if (hour < 12)
				{
					this.set(Calendar.HOUR_OF_DAY, 12);
				}
				else
				{
					this.set(Calendar.HOUR_OF_DAY, 0);
					this.add(Calendar.DAY_OF_MONTH, 1);
				}
				break;
			case TOP_OF_DAY:
				this.set(Calendar.HOUR_OF_DAY, 0);
				this.set(Calendar.MINUTE, 0);
				this.set(Calendar.SECOND, 0);
				this.set(Calendar.MILLISECOND, 0);
				this.add(Calendar.DATE, 1);
				break;
			case TOP_OF_WEEK:
				this.set(Calendar.DAY_OF_WEEK, getFirstDayOfWeek());
				this.set(Calendar.HOUR_OF_DAY, 0);
				this.set(Calendar.MINUTE, 0);
				this.set(Calendar.SECOND, 0);
				this.set(Calendar.MILLISECOND, 0);
				this.add(Calendar.WEEK_OF_YEAR, 1);
				break;
			case TOP_OF_MONTH:
				this.set(Calendar.DATE, 1);
				this.set(Calendar.HOUR_OF_DAY, 0);
				this.set(Calendar.MINUTE, 0);
				this.set(Calendar.SECOND, 0);
				this.set(Calendar.MILLISECOND, 0);
				this.add(Calendar.MONTH, 1);
				break;
			default:
				throw new IllegalStateException("Unknown periodicity type.");
		}
		return getTime();
	}

	void setType(int type)
	{
		this.type = type;
	}
}

 

使用时在appender配置的地方增加MaxBackupIndex配置即可。



 

分享到:
评论

相关推荐

    log4j删除前N天日志

    本话题将深入探讨如何使用Log4j中的DailyRollingFileAppender配置来自动删除前N天的日志,以便保持日志文件的大小和数量在可控范围内。 首先,DailyRollingFileAppender是Log4j中的一个Appender实现,它按照日期...

    tomcat下用Log4j 按文件大小,生成catalina.out日志文件

    在Tomcat中配置Log4j,可以实现按照文件大小生成日志文件,如`catalina.out`,从而避免单个日志文件过大导致的管理不便。 首先,我们需要理解Log4j的工作原理。Log4j主要包括三个核心组件:Logger(日志器)、...

    log4j DailyRollingFileAppender 类不能正常重命名

    当tomcat的server.xml的配置内包含时 DailyRollingFileAppender 类不能正确重命名。 log4j DailyRollingFileAppender 类不能正常重命名

    Log4j日志包

    #log4j.appender.CONSOLE.layout.ConversionPattern=[start]%d{DATE}[DATE]%n%p[PRIORITY]%n%x[NDC]%n%t[THREAD] n%c[CATEGORY]%n%m[MESSAGE]%n%n ################### # 单个日子记录 ################### log4j...

    配置好log4j的eclipse简单工程,每天输出到一个日志文件中,该文件名为:“XXX_年月日时分.log”的形式

    本工程基于Eclipse IDE,配置了一个简单的Log4j设置,实现了每天自动将日志输出到一个特定命名格式的文件中,即“XXX_年月日时分.log”。下面我们将详细解析这个配置及其工作原理。 1. **Log4j介绍**: Log4j是一...

    log4j使用jar包和log4j.properties配置文件

    - `log4j.appender.R`配置了文件输出,使用`DailyRollingFileAppender`,每天生成一个新的日志文件,同样设置了输出格式。 ### 4. 日志级别与使用 Log4j提供了多种日志级别,从低到高依次是:TRACE、DEBUG、INFO、...

    log4j-1.2.17.jar及配置文件

    《log4j-1.2.17.jar及其配置文件详解》 在IT行业中,日志记录是一项至关重要的任务,它能帮助开发者追踪程序运行状况、定位错误和调试问题。Log4j,作为Apache软件基金会的一个开源项目,是Java平台上广泛使用的...

    log4j 写多个日志文件,按照日期每天都记

    通过上述配置,`log4j`就能够按照日期每天创建新的日志文件,并且可以根据需求定制不同类别的日志输出。这对于大型系统的监控和维护来说,是非常重要的功能。在实际开发中,根据项目规模和需求,可能还需要考虑日志...

    log4j及配置文件

    Log4j的核心理念是提供一种层次化的日志记录机制,可以方便地调整日志输出级别,同时支持多种输出方式,如控制台、文件、数据库等。它的主要组件包括Logger(日志器)、Appender(输出端)和Layout(格式化器)。 ...

    log4j示例项目

    在Log4j项目中,通常会有一个`log4j.properties`或`log4j.xml`配置文件,用于定义日志行为。例如: ```properties # log4j.properties 示例 log4j.rootLogger=DEBUG, stdout, FILE log4j.appender.stdout=org....

    log4j-1.2.11jar和log4j.properties配置文件

    `log4j.properties`是Log4j的配置文件,通过这个文件可以定制日志的输出级别、输出目的地和输出格式。下面是一个基础的`log4j.properties`配置示例: ```properties # 设置全局日志级别为INFO log4j.rootLogger=...

    log4j需要的jar以及properties文件

    例如,`log4j.appender.Console=org.apache.log4j.ConsoleAppender`配置了一个控制台Appender,而`log4j.appender.File=org.apache.log4j.DailyRollingFileAppender`则配置了一个每天滚动的日志文件Appender。...

    log4j中配置日志文件相对路径方法(PDF)

    ### Log4j中配置日志文件相对路径方法详解 #### 概述 在软件开发过程中,日志记录是一项重要的功能,它有助于开发者调试程序、监控应用程序的运行状态以及追踪问题。`Log4j`作为一款优秀的日志管理工具,被广泛应用...

    mybatis,log4j打印日志到后台和文件

    创建一个名为 `log4j.properties` 或 `log4j.xml` 的配置文件,放在项目的类路径下。以下是一个基本的 `log4j.properties` 示例,用于设置日志级别、输出目的地及格式: ``` log4j.rootLogger=DEBUG, Console, ...

    log4j.properties(完整版) log4j.properties(精简版)

    - **定义日志文件Appender**:如`log4j.appender.FILE=org.apache.log4j.DailyRollingFileAppender`,每天创建新的日志文件。 - **文件Appender属性**:`log4j.appender.FILE.File=logs/app.log`,指定日志文件的...

    log4j.properties配置详解

    - `org.apache.log4j.DailyRollingFileAppender`:根据日期滚动日志文件,每天生成一个新的日志文件。 - `org.apache.log4j.RollingFileAppender`:当文件大小达到指定值时,自动滚动日志文件,创建新文件。 - `...

    Log - Log4j - log4j.properties配置文件

    在实际应用中,`log4j.properties`的配置应根据项目需求进行调整,比如根据日志级别过滤不必要的信息,根据业务模块划分日志文件,或者添加日志监控系统等。记住,良好的日志管理能够极大地提升开发效率和系统稳定性...

    SpringBoot框架配置log4j和log4j2的配置代码

    log4j.appender.file=org.apache.log4j.DailyRollingFileAppender log4j.appender.file.File=app.log log4j.appender.file.Append=true log4j.appender.file.Threshold=DEBUG log4j.appender.file.layout=org.apache...

    log4j的eclipse工程,输出到文件的方式配置log4j

    在Log4j中,配置主要通过一个名为`log4j.properties`或`log4j.xml`的配置文件完成。这里我们假设工程中包含`log4j.properties`文件,其主要内容可能如下: ```properties # 设置root logger级别为DEBUG,并将输出...

    log4j使用jar文件

    Log4j是一款广泛使用的Java日志记录框架,它允许开发者以灵活的方式控制应用程序的日志输出。这个框架的主要目的是提供一种简单、高效的日志记录机制,帮助开发者调试代码、追踪问题,以及收集运行时信息。在Java...

Global site tag (gtag.js) - Google Analytics