1.1.10-dev amqp/rabbitmq output causes high CPU usage

Description

java -server -jar logstash/build/logstash-1.1.10.dev-monolithic.jar agent -v -f bug.logstash.conf # HEAD from github, java 6 on mac or linux

  1. logstash.conf - tcp input is never used, rabbitmq shows amqp connects fine.

logstash-bug:$ cat bug.logstash.conf

input {
tcp {
port => 1337
type => 'dummy'
}
}

output {

  1. same behaviour if you replace 'rabbitmq' with 'amqp'
    rabbitmq {
    exchange => "logstash"
    exchange_type => "topic"
    host => "amqpserver"
    vhost => "/logstash"
    user => "loguser"
    password => "logpass"
    }
    }

----------------------

After around 5 minutes, jvisualvm sampling shows 95% of cpu being used by:

RubyThread-12: jar:file:/Users/sisred/logstash-gc-hell/logstash/build/logstash-1.1.10.dev-monolithic.jar!/gems/bunny-0.9.0.pre7/lib/bunny/main_loop.rb:18 428513905000 428,513.905 (0.0%) 949.062

permgen and old generations are stable, but GCs of young gen. happen multiple times a second.

jvisualvm per-thread allocations show the same thread allocating 100Mb/sec:

RubyThread-12: jar:file:/Users/sisred/logstash-snmp-gc-hell/logstash/build/logstash-1.1.10.dev-monolithic.jar!/gems/bunny-0.9.0.pre7/lib/bunny/main_loop.rb:18 57059376016 57,059,376,016 (78.6%) 100,741,365

Environment

None

Status

Assignee

Logstash Developers

Reporter

DickD

Labels

None

Fix versions

Affects versions

Priority

Configure