Unexpected / invalid UTF8 character in log input file causes logstash halt / infinite loop
Description
Attachments
2
Gliffy Diagrams
Activity
Show:
Details
Details
Assignee

Reporter

Labels
Affects versions
Created April 15, 2014 at 9:31 PM
Updated February 13, 2015 at 10:10 PM
Unexpected / invalid UTF8 character in log causes logstash halt / infinite loop when file input is used. Sample log with invalid UTF8 character is attached. Expected behavior is to either skip event or quit process with an error messages rather than looping indefinitely.
Sample config:
input {
file {
type => "java"
path => "/tmp/problem.log"
start_position => 'beginning'
sincedb_path => "/dev/null"
codec => multiline {
pattern => "^%{YEAR}%{MONTHNUM}%{MONTHDAY} %{TIME}.*"
negate => "true"
what => "previous"
}
}
}
output {
stdout {
codec => rubydebug
}
}