Issues
- Using lumberjack to connect two logstash instances hangs after 4999 events are transmittedLOGSTASH-1570Logstash Developers
- Sincedb not updating correctlyLOGSTASH-1242Resolved issue: LOGSTASH-1242João Duarte
- UndefinedConversionError with EventLog and GELFLOGSTASH-1228Logstash Developers
- Logstash metrics filter example not working with Logstash v1.1.12 or v1.1.13LOGSTASH-1219Resolved issue: LOGSTASH-1219Logstash Developers
- RabbitMQ output does not correctly split large messages into multiple framesLOGSTASH-1174Resolved issue: LOGSTASH-1174Logstash Developers
- Solaris 10 syslog client servierity level interpretation wrongLOGSTASH-1161Logstash Developers
- IRC ping timeouts causing repeated messagesLOGSTASH-1146Logstash Developers
- rabbitmq input not working on WindowsLOGSTASH-1145Resolved issue: LOGSTASH-1145Jason Kendall
- COMBINEDAPACHELOG with QS/QUOTEDSTRING does not remove quotes from referrer and user agentLOGSTASH-1136Resolved issue: LOGSTASH-1136Philippe Weber
- "Output thread exception" shows up oftenLOGSTASH-1133Logstash Developers
- Input File cannot use backslash in path but "ruby-filewatch"LOGSTASH-1126Logstash Developers
- When I use output mongodb，The logstash will can't start.
LOGSTASH-1125Logstash Developers - Support ipv6 for geoipLOGSTASH-1124Resolved issue: LOGSTASH-1124Logstash Developers
- File input on Windows prevents log rolling because the handle is lockedLOGSTASH-1123Resolved issue: LOGSTASH-1123Jason Kendall
- SNMPTrap Input Dies RepeatedlyLOGSTASH-1120Resolved issue: LOGSTASH-1120Logstash Developers
- Grok pattern for IPv6LOGSTASH-1115Resolved issue: LOGSTASH-1115Logstash Developers
- logstash died/crashedLOGSTASH-1112Resolved issue: LOGSTASH-1112Logstash Developers
- Add optional destination field for geoip filterLOGSTASH-1107Resolved issue: LOGSTASH-1107Richard Pijnenburg
- If elasticsearch returns a fatal error, do not attempt to reindex the eventLOGSTASH-1105Resolved issue: LOGSTASH-1105Logstash Developers
- checksum filter does not clear @keysLOGSTASH-1104Logstash Developers
- logstash agent delay reading syslogLOGSTASH-1101Logstash Developers
- GeoIP input doesn't work with IPv6 addresses: crash with GeoIPCityv6.datLOGSTASH-1100Resolved issue: LOGSTASH-1100Logstash Developers
- can't start 1.1.10+ versionsLOGSTASH-1096Logstash Developers
- SSL errors using tcp ssl inputLOGSTASH-1095Logstash Developers
- Parsing failure for previously working config,LOGSTASH-1093Resolved issue: LOGSTASH-1093Logstash Developers
- Twitter input requires proxy settingsLOGSTASH-1089Resolved issue: LOGSTASH-1089Philippe Weber
- `clone` filter seems to loop the logs which is processed by itLOGSTASH-1088Resolved issue: LOGSTASH-1088Philippe Weber
- Logstash-1.1.12 says that a path is relative, when it means that the path is otherwise incorrectLOGSTASH-1087Philippe Weber
- web interface does not serve static resourcesLOGSTASH-1085Resolved issue: LOGSTASH-1085Logstash Developers
- relp input failed to loadLOGSTASH-1083Philippe Weber
- Nagios output "File does not exist" with commandfile as pipeLOGSTASH-1081Logstash Developers
- Log-Shipper: high cpu and heavy loadLOGSTASH-1079Resolved issue: LOGSTASH-1079Logstash Developers
- Same as 1015 for 1.1.12: Errno::ENOENT: No such file or directory - file:/root/logstash-1.1.12-flatjar.jar!/logstash/web/views/search/results.hamlLOGSTASH-1067Resolved issue: LOGSTASH-1067Jordan Sissel
- Logstash agent throws exception when starting on WindowsLOGSTASH-1066Resolved issue: LOGSTASH-1066Logstash Developers
- use local timezone instead of utc when creating elasticsearch indicesLOGSTASH-973Resolved issue: LOGSTASH-973Logstash Developers
- Missing 'unicode.data' issue with logstash-1.1.6.dev-flatjarLOGSTASH-715Resolved issue: LOGSTASH-715Jordan Sissel
- Logstash Agent win32ole error on WindowsLOGSTASH-605Resolved issue: LOGSTASH-605Logstash Developers
37 of 37
Using lumberjack to connect two logstash instances hangs after 4999 events are transmitted
Description
Gliffy Diagrams
Created November 6, 2013 at 10:01 PM
Updated November 7, 2013 at 7:17 AM
Activity
Show:
Boyd Meier November 7, 2013 at 7:17 AM
I was able to patch the flatjar by modifying the lumberjack client.rb file within the jar:
lumberjack/client.rb
--- logstash-1.2.2-original/lumberjack/client.rb 2013-10-22 18:32:08.000000000 -0500
+++ logstash-1.2.2/lumberjack/client.rb 2013-11-06 18:32:50.215927309 -0600
@@ -100,8 +100,8 @@
public
def write_hash(hash)
frame = to_frame(hash, inc)
- ack if (@sequence - @last_ack) >= @window_size
write frame
+ ack if (@sequence - @last_ack) >= @window_size
end
private
Original discussion in newsgroup
Logstash transmits only windows_size - 1 events from a lumberjack output to a lumberjack input. After that it hangs waiting for an ack message.
lumberjack/client.rb:103
public def write_hash(hash) frame = to_frame(hash, inc) -> ack if (@sequence - @last_ack) >= @window_size write frame endThis appears to be fixed in the latest code in https://github.com/elasticsearch/logstash-forwarder, but that code is not present in 1.2.2's flatjar.