Unexpected / invalid UTF8 character in log input file causes logstash halt / infinite loop

Description

Unexpected / invalid UTF8 character in log causes logstash halt / infinite loop when file input is used. Sample log with invalid UTF8 character is attached. Expected behavior is to either skip event or quit process with an error messages rather than looping indefinitely.

Sample config:
input {
file {
type => "java"
path => "/tmp/problem.log"
start_position => 'beginning'
sincedb_path => "/dev/null"
codec => multiline {
pattern => "^%{YEAR}%{MONTHNUM}%{MONTHDAY} %{TIME}.*"
negate => "true"
what => "previous"
}
}
}
output {
stdout {
codec => rubydebug
}
}

Attachments

2

Gliffy Diagrams

Activity

Show:

Details

Assignee

Reporter

Affects versions

Created April 15, 2014 at 9:31 PM
Updated February 13, 2015 at 10:10 PM