I'm sending old log files to logstash. For that I am reading+uncompressing many gziped files on one machine, adding extra data to each line, compress the files with gzip --fast to send them over the wire to the logstash host.
As I'm transfering multiple gigabytes of compressed date, using comression makes things going faster. At the moment I'm using a socat/gunzip -c bridge to decompress the date before shipping it to logstash.
It would be nice if the tcp imput would be configurable to natively accept gziped data.
I'm sending old log files to logstash.
For that I am reading+uncompressing many gziped files on one machine, adding extra data to each line, compress the files with gzip --fast to send them over the wire to the logstash host.
As I'm transfering multiple gigabytes of compressed date, using comression makes things going faster. At the moment I'm using a socat/gunzip -c bridge to decompress the date before shipping it to logstash.
It would be nice if the tcp imput would be configurable to natively accept gziped data.