File input support for compressed files

Is this feature implemented? Or is there any work around to use this feature? May be, listen for zip files, netcat file from zip file and send it to a tcp port?

Is this being built into the s3 input or can I assume from the conversation and the documentation that a separate codec is being made available called gzip?

As the online documentation seems to indicate that this is being separated out in the credentials section.

So in my example, logs provided by Cloudfront which are dumped into an S3 bucket are gziped. The top of http://logstash.net/docs/1.2.1/inputs/s3 documentation sugests that in 1.2.1 the files ending in .gz are all ready process and each line with in the files ending in .gz will be an event.

Is this not true?

Regards

John

Eagerly looking for GZIP decompression support for file input. Is there a solution I could try?

is anyone working on the gzip codec? I've been looking at the existing codecs as examples. It looks like the gzip file read just needs to be implemented in the decode method of the base codec.

I'd like to fork and contribute, but don't want to duplicate if someone is already working on the gzip codec.

Hi, just wondering which way you are leaning on the gzip feature. There seems to be nice support for gzip in Ruby.
http://ruby-doc.org/stdlib-1.9.3/libdoc/zlib/rdoc/Zlib/GzipReader.html