Zipped filewatching

[rajsahae]

Created a filewatch for gzipped text files. Necessary to implement the file_gz logstash plugin that I'm working on. Seems to be working well for me so far. Thought you may want it as part of the gem.

[jordansissel]

Howdy!

Thanks for your effort on this.

It might be helpful to know the future roadmap a bit for logstash to see how this all fits together.

In logstash 1.2.0 we added the codec system which allows us to decouple "where data comes from" from "how data is serialized". In my mind, the best way forward with this codec system is:

• fix filewatch to emit chunks of bytes read from a file instead emitting lines
• add a gzip_lines codec to logstash

This would allow filewatch to do what it is good at (stream file data) and a separate, small 'gzip' codec worry about decompression.

With that said, I think this patch is a step away from the codec system, not towards it.

[rajsahae]

Ok, that all sounds fine and dandy. Feel free to close this pull request then if you think it's a step backwards. I can just use it locally until codec is mature enough to handle this use case.

Thanks.