Summary -

In this topic, we described about the below sections -

There are two event validation tools for the events available.

  1. File channel integrity tool
  2. Event Validator tool

Let us discuss about each tool in detail.

File channel integrity tool -

This tool verifies the reliability of individual Events in the File channel. And also removes corrupted Events from the File channel. The tools can be run as follows -

$bin/flume-ng tool --conf ./conf FCINTEGRITYTOOL -l ./datadir

datadir - Specifies the comma separated list of data directory to be verified.

Below are the lists of options available -

Option NameDescription
h/helpDisplays help
l/dataDirsComma-separated list of data directories

Event Validator tool -

This tool can be used to validate the File Channel Event’s in application specific way. This tool applies the user provider validation login on each event. This tool drops the event which do not confirm to the logic.

The tools can be run as follows -

$bin/flume-ng tool --conf ./conf FCINTEGRITYTOOL -l ./datadir -e 
			org.apache.flume.MyEventValidator -DmaxSize 2000

datadir - Specifies the comma separated list of data directory to be verified.

Below are the lists of options available -

Option NameDescription
h/helpDisplays help
l/dataDirsComma-separated list of data directories
e/eventValidatorFully Qualified Name of Event Validator Implementation