Tailr - A Recursive Log Forwarder

Tailr watches a folder recursively for files matching a specified pattern. If the file exists it will start reading the file contents and forwards the same in realtime to a remote server. Tailr can detect any new files/directories that gets created with in the watching directory. It will automatically start watching all dicrectories and files that gets created with in the new sub directories. It also automatically stops watching if a file/directory is removed.

Tailr also comes with an optional file offset feature where it keeps track of the file offset for each file that it keeps tracks off. If the file offset is enabled and application gets restarted, Tailr will start reading the files from where it stopped previously instead of re-reading the file from the begining.

Tailr also comes with a noop output option. If -noop flag is passed, Tailr will redirect all the forwarded logs to STDOUT instead of forwarding to the remote server.

$ tailr -h
Usage of tailr:
  -logDir string
        path to log directory (default "/tmp/logs")
  -logPattern string
        log pattern to look for (default "*.log")
  -noop
        prints the output to stdout
  -offsetFilePath string
        path to offset file store (default "/tmp/tailr-offset.json")
  -port string
        server port (default "9000")
  -protocol string
        tcp or udp (default "tcp")
  -server string
        server address (default "localhost")
  -useOffset
        whether to use file offset method or not (default true)

Installing

$ make
or
$ bazel build //:tailr

TODO

• Support to more remote output server like Redis/Elastisearch etc …