multiline codec: logstash getting blocked

Description

I am running logstash 1.4.1 with 8 Gigs RAM and I am using multi line code to parser stack trace. Some times stack traces are more than 500 lines. With 1.3.3 I was quite happy as it was breaking after 2-3 days but whenwhen I upgraded to 1.4.1 it getting blocked somewhere taking up all resources.

Here are stack trace
Complete

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507 1508 1509 1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620 1621 1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637 1638 1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654 1655 1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688 1689 1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706 1707 1708 1709 1710 1711 1712 1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725 1726 1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817 1818 1819 1820 1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841 1842 1843 1844 Full thread dump Java HotSpot(TM) 64-Bit Server VM (24.60-b09 mixed mode): "Attach Listener" daemon prio=10 tid=0x00007fd9dc013800 nid=0x6e32 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "elasticsearch[Thor(App)][generic][T#5]" daemon prio=10 tid=0x0000000001aa9800 nid=0x3e08 waiting on condition [0x00007fd9e9491000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000006915f84c0> (a java.util.concurrent.SynchronousQueue$TransferStack) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:359) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:942) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][management][T#1]" daemon prio=10 tid=0x00007fd9d8083800 nid=0x3c57 waiting on condition [0x00007fd9e9450000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x0000000691525708> (a org.elasticsearch.common.util.concurrent.EsExecutors$ExecutorScalingQueue) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:706) at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.xfer(LinkedTransferQueue.java:615) at org.elasticsearch.common.util.concurrent.jsr166y.LinkedTransferQueue.take(LinkedTransferQueue.java:1109) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "Ruby-0-Thread-16: /u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:92" daemon prio=10 tid=0x00007fd9982cf800 nid=0x3b22 in Object.wait() [0x00007fd9e934b000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.jruby.RubyThread.sleep(RubyThread.java:1001) - eliminated <0x0000000691226460> (a org.jruby.RubyThread) - locked <0x0000000691226460> (a org.jruby.RubyThread) at org.jruby.RubyKernel.sleep(RubyKernel.java:848) at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen) at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130) at org.jruby.runtime.Block.yieldSpecific(Block.java:111) at org.jruby.RubyKernel.loop(RubyKernel.java:1521) at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][clusterService#updateTask][T#1]" daemon prio=10 tid=0x00007fd9c8084000 nid=0x3b21 waiting on condition [0x00007fd9e938d000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000006915f8418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:539) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_timer][T#1]{Hashed wheel timer #1}" daemon prio=10 tid=0x00007fd9b8006800 nid=0x3ae9 waiting on condition [0x00007fd9e940f000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:483) at org.elasticsearch.common.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:392) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_boss][T#1]{New I/O server boss #18}" daemon prio=10 tid=0x00007fd998a48800 nid=0x3ae6 runnable [0x00007fd9e94d2000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000069168fb20> (a sun.nio.ch.Util$2) - locked <0x000000069168fb38> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e260> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:102) at org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss.select(NioServerBoss.java:163) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.NioServerBoss.run(NioServerBoss.java:42) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#8]{New I/O worker #17}" daemon prio=10 tid=0x00007fd998a36000 nid=0x3ae5 runnable [0x00007fd9e9513000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000006915f84d8> (a sun.nio.ch.Util$2) - locked <0x00000006915f84f0> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069153ee30> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#7]{New I/O worker #16}" daemon prio=10 tid=0x00007fd998a0a800 nid=0x3ae4 runnable [0x00007fd9e9554000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000006915f8640> (a sun.nio.ch.Util$2) - locked <0x00000006915f8628> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069153eec0> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#6]{New I/O worker #15}" daemon prio=10 tid=0x00007fd9989df800 nid=0x3ae3 runnable [0x00007fd9e9595000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000069168fbb0> (a sun.nio.ch.Util$2) - locked <0x000000069168fbc8> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e338> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#5]{New I/O worker #14}" daemon prio=10 tid=0x00007fd9989b4800 nid=0x3ae2 runnable [0x00007fd9e95d6000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000069168fc40> (a sun.nio.ch.Util$2) - locked <0x000000069168fc58> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e3c8> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#4]{New I/O worker #13}" daemon prio=10 tid=0x00007fd998989800 nid=0x3ae1 runnable [0x00007fd9e9617000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000069168fcd0> (a sun.nio.ch.Util$2) - locked <0x000000069168fce8> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e458> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#3]{New I/O worker #12}" daemon prio=10 tid=0x00007fd99895e800 nid=0x3ae0 runnable [0x00007fd9e9658000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000069168fe38> (a sun.nio.ch.Util$2) - locked <0x000000069168fe20> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e4a0> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#2]{New I/O worker #11}" daemon prio=10 tid=0x00007fd998934000 nid=0x3adf runnable [0x00007fd9e9699000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x0000000691690330> (a sun.nio.ch.Util$2) - locked <0x0000000691690318> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e530> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_server_worker][T#1]{New I/O worker #10}" daemon prio=10 tid=0x00007fd9988ce000 nid=0x3ade runnable [0x00007fd9e96da000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x0000000691690bb8> (a sun.nio.ch.Util$2) - locked <0x0000000691690ba0> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e5c0> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_boss][T#1]{New I/O boss #9}" daemon prio=10 tid=0x00007fd9988cb000 nid=0x3add runnable [0x00007fd9e971b000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000006914021c0> (a sun.nio.ch.Util$2) - locked <0x00000006914021a8> (a java.util.Collections$UnmodifiableSet) - locked <0x000000069126e650> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#8]{New I/O worker #8}" daemon prio=10 tid=0x00007fd998720000 nid=0x3adc runnable [0x00007fd9e975c000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000069141a340> (a sun.nio.ch.Util$2) - locked <0x000000069141a328> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e7660> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#7]{New I/O worker #7}" daemon prio=10 tid=0x00007fd99871e000 nid=0x3adb runnable [0x00007fd9e979d000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000006914194d0> (a sun.nio.ch.Util$2) - locked <0x00000006914194b8> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e77c8> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#6]{New I/O worker #6}" daemon prio=10 tid=0x00007fd99871c000 nid=0x3ada runnable [0x00007fd9e97de000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000006911b6da0> (a sun.nio.ch.Util$2) - locked <0x00000006911b6d88> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e7a98> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#5]{New I/O worker #5}" daemon prio=10 tid=0x00007fd998719800 nid=0x3ad9 runnable [0x00007fd9e981f000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x000000068fe5af40> (a sun.nio.ch.Util$2) - locked <0x000000068fe5b078> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e7a08> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#4]{New I/O worker #4}" daemon prio=10 tid=0x00007fd998686000 nid=0x3ad8 runnable [0x00007fd9e9860000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x0000000691419db8> (a sun.nio.ch.Util$2) - locked <0x0000000691419e30> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e7738> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#3]{New I/O worker #3}" daemon prio=10 tid=0x00007fd998684800 nid=0x3ad7 runnable [0x00007fd9e98a1000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x00000006916428a8> (a sun.nio.ch.Util$2) - locked <0x0000000691642890> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e7978> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#2]{New I/O worker #2}" daemon prio=10 tid=0x00007fd998681000 nid=0x3ad6 runnable [0x00007fd9e98e2000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x0000000690fdd7d8> (a sun.nio.ch.Util$2) - locked <0x0000000690fdd8e0> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e78e8> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][transport_client_worker][T#1]{New I/O worker #1}" daemon prio=10 tid=0x00007fd99868d000 nid=0x3ad5 runnable [0x00007fd9e9923000] java.lang.Thread.State: RUNNABLE at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) - locked <0x0000000691418f78> (a sun.nio.ch.Util$2) - locked <0x0000000691418ff0> (a java.util.Collections$UnmodifiableSet) - locked <0x00000006912e7858> (a sun.nio.ch.EPollSelectorImpl) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.elasticsearch.common.netty.channel.socket.nio.SelectorUtil.select(SelectorUtil.java:68) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.select(AbstractNioSelector.java:415) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:212) at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][[ttl_expire]]" daemon prio=10 tid=0x00007fd99867a000 nid=0x3ad4 waiting on condition [0x00007fd9e9964000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x0000000691163898> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2176) at org.elasticsearch.indices.ttl.IndicesTTLService$Notifier.await(IndicesTTLService.java:324) at org.elasticsearch.indices.ttl.IndicesTTLService$PurgerThread.run(IndicesTTLService.java:146) "elasticsearch[Thor(App)][scheduler][T#1]" daemon prio=10 tid=0x00007fd998658000 nid=0x3ad3 waiting on condition [0x00007fd9e99a5000] java.lang.Thread.State: TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x00000006914d2fe0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "elasticsearch[Thor(App)][[timer]]" daemon prio=10 tid=0x00007fd9985a4800 nid=0x3ace waiting on condition [0x00007fd9e99e6000] java.lang.Thread.State: TIMED_WAITING (sleeping) at java.lang.Thread.sleep(Native Method) at org.elasticsearch.threadpool.ThreadPool$EstimatedTimeThread.run(ThreadPool.java:514) ">output" daemon prio=10 tid=0x00007fd9bc150800 nid=0x3aae waiting on condition [0x00007fd9e9fa3000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x000000076f0142a8> (a org.elasticsearch.common.util.concurrent.BaseFuture$Sync) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:994) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1303) at org.elasticsearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:274) at org.elasticsearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:113) at org.elasticsearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:45) at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.jruby.javasupport.JavaMethod.invokeDirectWithExceptionHandling(JavaMethod.java:440) at org.jruby.javasupport.JavaMethod.invokeDirect(JavaMethod.java:304) at org.jruby.java.invokers.InstanceMethodInvoker.call(InstanceMethodInvoker.java:52) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134) at rubyjit.LogStash::Outputs::Elasticsearch::Protocols::NodeClient$$bulk_85a197118cfc2705acb39253ec8cde18348edefb16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/elasticsearch/protocol.rb:207) at rubyjit.LogStash::Outputs::Elasticsearch::Protocols::NodeClient$$bulk_85a197118cfc2705acb39253ec8cde18348edefb16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/elasticsearch/protocol.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at rubyjit.LogStash::Outputs::ElasticSearch$$flush_35d15b3030d6bf20808191a038dd4c848e54739216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/elasticsearch.rb:321) at rubyjit.LogStash::Outputs::ElasticSearch$$flush_35d15b3030d6bf20808191a038dd4c848e54739216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/elasticsearch.rb) at org.jruby.ast.executable.AbstractScript.__file__(AbstractScript.java:46) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:221) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:202) at rubyjit.Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372.chained_1_rescue_1$RUBY$SYNTHETIC__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:219) at rubyjit.Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372.block_1$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:217) at rubyjit$Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372$block_1$RUBY$__file__.call(rubyjit$Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372$block_1$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyHash$13.visit(RubyHash.java:1352) at org.jruby.RubyHash.visitLimited(RubyHash.java:643) at org.jruby.RubyHash.visitAll(RubyHash.java:629) at org.jruby.RubyHash.iteratorVisitAll(RubyHash.java:1303) at org.jruby.RubyHash.each_pairCommon(RubyHash.java:1348) at org.jruby.RubyHash.each19(RubyHash.java:1339) at org.jruby.RubyHash$INVOKER$i$0$0$each19.call(RubyHash$INVOKER$i$0$0$each19.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372.chained_0_ensure_1$RUBY$__ensure__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:216) at rubyjit.Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:193) at rubyjit.Stud::Buffer$$buffer_flush_4401ae1aca06c0744dc462ba3f894b0c8056838e16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb) at org.jruby.ast.executable.AbstractScript.__file__(AbstractScript.java:38) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:141) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134) at rubyjit.Stud::Buffer$$buffer_receive_4cef003b0e9b7f72220ce105d0c3d4c4314c2d9a16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:159) at rubyjit.Stud::Buffer$$buffer_receive_4cef003b0e9b7f72220ce105d0c3d4c4314c2d9a16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb) at org.jruby.ast.executable.AbstractScript.__file__(AbstractScript.java:42) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at rubyjit.LogStash::Outputs::ElasticSearch$$receive_3a787483b060dd480cc08450e3d7764a2df4dd6c16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/elasticsearch.rb:317) at rubyjit.LogStash::Outputs::ElasticSearch$$receive_3a787483b060dd480cc08450e3d7764a2df4dd6c16138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/elasticsearch.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at rubyjit.LogStash::Outputs::Base$$handle_24adc2db41a9ae2c014e1d30a2db5c4e44c7836216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/base.rb:86) at rubyjit.LogStash::Outputs::Base$$handle_24adc2db41a9ae2c014e1d30a2db5c4e44c7836216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/outputs/base.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call19(RubyProc.java:271) at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i$0$0$call19.gen) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:210) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at rubyjit.LogStash::Pipeline$$output_025f2affa1e322b83a2f3b28e2c04e8a3f124af616138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/pipeline.rb:266) at rubyjit.LogStash::Pipeline$$output_025f2affa1e322b83a2f3b28e2c04e8a3f124af616138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/pipeline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at org.jruby.ast.VCallNode.interpret(VCallNode.java:88) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "Ruby-0-Thread-13: /u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/pipeline.rb:147" daemon prio=10 tid=0x00007fd9bc14e800 nid=0x3aad in Object.wait() [0x00007fd9e9fe5000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at org.jruby.RubyThread.sleep(RubyThread.java:1001) - eliminated <0x000000069036ac60> (a org.jruby.RubyThread) - locked <0x000000069036ac60> (a org.jruby.RubyThread) at org.jruby.RubyKernel.sleep(RubyKernel.java:848) at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen) at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:204) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:206) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:336) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:179) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188) at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "|worker" daemon prio=10 tid=0x00007fd9bc14c800 nid=0x3aac in Object.wait() [0x00007fd9ea026000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134) at org.jruby.ast.VCallNode.interpret(VCallNode.java:88) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "|worker" daemon prio=10 tid=0x00007fd9bc14a800 nid=0x3aab in Object.wait() [0x00007fd9ea067000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134) at org.jruby.ast.VCallNode.interpret(VCallNode.java:88) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "|worker" daemon prio=10 tid=0x00007fd9bc148800 nid=0x3aaa in Object.wait() [0x00007fd9ea0a9000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134) at org.jruby.ast.VCallNode.interpret(VCallNode.java:88) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "|worker" daemon prio=10 tid=0x00007fd9bc146000 nid=0x3aa9 in Object.wait() [0x00007fd9ea0ea000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690358400> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at org.jruby.ast.VCallNode.interpret(VCallNode.java:88) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "<file" daemon prio=10 tid=0x00007fd9bc142000 nid=0x3aa8 in Object.wait() [0x00007fd9ea129000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:135) at org.jruby.runtime.Block.yieldSpecific(Block.java:120) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:172) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:161) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:183) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:225) at org.jruby.RubyMethod.call(RubyMethod.java:132) at org.jruby.RubyMethod$INVOKER$i$call.call(RubyMethod$INVOKER$i$call.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:217) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:158) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188) at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_1$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:159) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:158) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_0$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:155) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yieldSpecificInternal(CompiledBlock19.java:117) at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:92) at org.jruby.runtime.Block.yieldSpecific(Block.java:111) at org.jruby.RubyKernel.loop(RubyKernel.java:1521) at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:183) at org.jruby.ast.FCallOneArgBlockPassNode.interpret(FCallOneArgBlockPassNode.java:32) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhenOneArgNode.when(WhenOneArgNode.java:49) at org.jruby.ast.CaseNode.interpret(CaseNode.java:133) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at org.jruby.ast.FCallNoArgBlockPassNode.interpret(FCallNoArgBlockPassNode.java:27) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:247) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:222) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:222) at org.jruby.ast.CallTwoArgBlockNode.interpret(CallTwoArgBlockNode.java:62) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "<file" daemon prio=10 tid=0x00007fd9bc140000 nid=0x3aa7 in Object.wait() [0x00007fd9ea169000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:135) at org.jruby.runtime.Block.yieldSpecific(Block.java:120) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:172) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:161) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:183) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:225) at org.jruby.RubyMethod.call(RubyMethod.java:132) at org.jruby.RubyMethod$INVOKER$i$call.call(RubyMethod$INVOKER$i$call.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:217) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:158) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188) at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_1$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:159) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:158) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_0$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:155) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yieldSpecificInternal(CompiledBlock19.java:117) at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:92) at org.jruby.runtime.Block.yieldSpecific(Block.java:111) at org.jruby.RubyKernel.loop(RubyKernel.java:1521) at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:183) at org.jruby.ast.FCallOneArgBlockPassNode.interpret(FCallOneArgBlockPassNode.java:32) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhenOneArgNode.when(WhenOneArgNode.java:49) at org.jruby.ast.CaseNode.interpret(CaseNode.java:133) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at org.jruby.ast.FCallNoArgBlockPassNode.interpret(FCallNoArgBlockPassNode.java:27) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:247) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:222) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:356) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:213) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:222) at org.jruby.ast.CallTwoArgBlockNode.interpret(CallTwoArgBlockNode.java:62) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "<file" daemon prio=10 tid=0x00007fd9bc02e800 nid=0x3aa6 in Object.wait() [0x00007fda0404d000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:135) at org.jruby.runtime.Block.yieldSpecific(Block.java:120) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:172) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:161) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:183) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:225) at org.jruby.RubyMethod.call(RubyMethod.java:132) at org.jruby.RubyMethod$INVOKER$i$call.call(RubyMethod$INVOKER$i$call.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:217) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:158) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188) at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_1$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:159) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:158) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_0$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:155) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yieldSpecificInternal(CompiledBlock19.java:117) at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:92) at org.jruby.runtime.Block.yieldSpecific(Block.java:111) at org.jruby.RubyKernel.loop(RubyKernel.java:1521) at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:183) at org.jruby.ast.FCallOneArgBlockPassNode.interpret(FCallOneArgBlockPassNode.java:32) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhenOneArgNode.when(WhenOneArgNode.java:49) at org.jruby.ast.CaseNode.interpret(CaseNode.java:133) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at org.jruby.ast.FCallNoArgBlockPassNode.interpret(FCallNoArgBlockPassNode.java:27) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:247) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:222) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:222) at org.jruby.ast.CallTwoArgBlockNode.interpret(CallTwoArgBlockNode.java:62) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "<file" daemon prio=10 tid=0x00007fd9bc02d000 nid=0x3aa5 in Object.wait() [0x00007fda0408d000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:135) at org.jruby.runtime.Block.yieldSpecific(Block.java:120) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:172) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:161) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:183) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:225) at org.jruby.RubyMethod.call(RubyMethod.java:132) at org.jruby.RubyMethod$INVOKER$i$call.call(RubyMethod$INVOKER$i$call.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:217) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:158) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188) at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_1$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:159) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:158) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_0$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:155) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yieldSpecificInternal(CompiledBlock19.java:117) at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:92) at org.jruby.runtime.Block.yieldSpecific(Block.java:111) at org.jruby.RubyKernel.loop(RubyKernel.java:1521) at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:183) at org.jruby.ast.FCallOneArgBlockPassNode.interpret(FCallOneArgBlockPassNode.java:32) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhenOneArgNode.when(WhenOneArgNode.java:49) at org.jruby.ast.CaseNode.interpret(CaseNode.java:133) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at org.jruby.ast.FCallNoArgBlockPassNode.interpret(FCallNoArgBlockPassNode.java:27) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:247) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:222) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:222) at org.jruby.ast.CallTwoArgBlockNode.interpret(CallTwoArgBlockNode.java:62) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "<file" daemon prio=10 tid=0x00007fd9bc083800 nid=0x3aa4 in Object.wait() [0x00007fda040ce000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:461) at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065) at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413) at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:127) - locked <0x0000000690807a28> (a org.jruby.ext.thread.SizedQueue) at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:135) at org.jruby.runtime.Block.yieldSpecific(Block.java:120) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:172) at rubyjit.LogStash::Codecs::Multiline$$flush_611e5e5c588a5269d62ce9396ae237e97a1cbd8216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:161) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:183) at rubyjit.LogStash::Codecs::Multiline$$do_previous_5722b5d09383b2bda7e131169698c6b8cf0befb216138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:225) at org.jruby.RubyMethod.call(RubyMethod.java:132) at org.jruby.RubyMethod$INVOKER$i$call.call(RubyMethod$INVOKER$i$call.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:217) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb:158) at rubyjit.LogStash::Codecs::Multiline$$decode_54b704fd7e4996300413b5d1a1e123b339716ee016138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/codecs/multiline.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188) at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_1$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:159) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_1$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:158) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.block_0$RUBY$__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:155) at rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__.call(rubyjit$FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372$block_0$RUBY$__file__) at org.jruby.runtime.CompiledBlock19.yieldSpecificInternal(CompiledBlock19.java:117) at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:92) at org.jruby.runtime.Block.yieldSpecific(Block.java:111) at org.jruby.RubyKernel.loop(RubyKernel.java:1521) at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb:154) at rubyjit.FileWatch::Tail$$_read_file_477ab4dfba8cabcd24e7fca36e21dcd45ba59b4916138372.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/filewatch-0.5.1/lib/filewatch/tail.rb) at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:183) at org.jruby.ast.FCallOneArgBlockPassNode.interpret(FCallOneArgBlockPassNode.java:32) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhenOneArgNode.when(WhenOneArgNode.java:49) at org.jruby.ast.CaseNode.interpret(CaseNode.java:133) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:177) at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:140) at org.jruby.runtime.Block.yieldSpecific(Block.java:129) at org.jruby.ast.YieldTwoNode.interpret(YieldTwoNode.java:31) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.IfNode.interpret(IfNode.java:116) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at org.jruby.ast.FCallNoArgBlockPassNode.interpret(FCallNoArgBlockPassNode.java:27) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.WhileNode.interpret(WhileNode.java:131) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:247) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:222) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:211) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:222) at org.jruby.ast.CallTwoArgBlockNode.interpret(CallTwoArgBlockNode.java:62) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:161) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:190) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168) at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170) at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "Ruby-0-Thread-3: /u001/logparser/tools/logstash-new/logstash-1.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/task.rb:10" daemon prio=10 tid=0x00007fda1c792000 nid=0x3a8e in Object.wait() [0x00007fda04111000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1289) - locked <0x0000000690a3f908> (a java.lang.Thread) at org.jruby.internal.runtime.NativeThread.join(NativeThread.java:75) at org.jruby.RubyThread.join(RubyThread.java:696) at org.jruby.RubyThread$INVOKER$i$0$1$join.call(RubyThread$INVOKER$i$0$1$join.gen) at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:677) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:286) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:81) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:85) at org.jruby.RubySymbol$1.yieldInner(RubySymbol.java:445) at org.jruby.RubySymbol$1.yield(RubySymbol.java:465) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149) at org.jruby.ast.CallNoArgBlockPassNode.interpret(CallNoArgBlockPassNode.java:53) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at org.jruby.ast.VCallNode.interpret(VCallNode.java:88) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at u001.logparser.tools.logstash_minus_new.logstash_minus_1_dot_4_dot_1.lib.logstash.runner.block_11$RUBY$run(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/runner.rb:168) at u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$block_11$RUBY$run.call(u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$block_11$RUBY$run) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:159) at org.jruby.runtime.CompiledBlock19.call(CompiledBlock19.java:87) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call19(RubyProc.java:271) at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i$0$0$call19.gen) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:202) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at org.jruby.ast.CallSpecialArgNode.interpret(CallSpecialArgNode.java:65) at org.jruby.ast.DAsgnNode.interpret(DAsgnNode.java:110) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221) at org.jruby.ast.RescueNode.interpret(RescueNode.java:116) at org.jruby.ast.BeginNode.interpret(BeginNode.java:83) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112) at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206) at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194) at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125) at org.jruby.runtime.Block.call(Block.java:101) at org.jruby.RubyProc.call(RubyProc.java:290) at org.jruby.RubyProc.call(RubyProc.java:228) at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99) at java.lang.Thread.run(Thread.java:745) "ReferenceReaper" daemon prio=10 tid=0x00007fda1c717000 nid=0x3a8a in Object.wait() [0x00007fda04154000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) - waiting on <0x0000000690823350> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135) - locked <0x0000000690823350> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151) at org.jruby.util.ReferenceReaper$1.run(ReferenceReaper.java:32) at java.lang.Thread.run(Thread.java:745) "Ruby-0-JIT-2" daemon prio=10 tid=0x00007fda1c6f3800 nid=0x3a84 waiting on condition [0x00007fda04195000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x000000068fac1418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "Ruby-0-JIT-1" daemon prio=10 tid=0x00007fda1c6ba800 nid=0x3a82 waiting on condition [0x00007fda041d6000] java.lang.Thread.State: WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to wait for <0x000000068fac1418> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) "Service Thread" daemon prio=10 tid=0x00007fda1c1e3800 nid=0x3a6c runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "C2 CompilerThread1" daemon prio=10 tid=0x00007fda1c1e0800 nid=0x3a68 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "C2 CompilerThread0" daemon prio=10 tid=0x00007fda1c1de800 nid=0x3a66 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Signal Dispatcher" daemon prio=10 tid=0x00007fda1c1dc000 nid=0x3a65 runnable [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007fda1c1da800 nid=0x3a64 waiting on condition [0x0000000000000000] java.lang.Thread.State: RUNNABLE "Finalizer" daemon prio=10 tid=0x00007fda1c1bb800 nid=0x3a5d in Object.wait() [0x00007fda18b9e000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135) - locked <0x000000068fac2368> (a java.lang.ref.ReferenceQueue$Lock) at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151) at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209) "Reference Handler" daemon prio=10 tid=0x00007fda1c1b9800 nid=0x3a5c in Object.wait() [0x00007fda18bdf000] java.lang.Thread.State: WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133) - locked <0x000000068fac0748> (a java.lang.ref.Reference$Lock) "LogStash::Runner" prio=10 tid=0x00007fda1c009000 nid=0x3a41 in Object.wait() [0x00007fda237a8000] java.lang.Thread.State: TIMED_WAITING (on object monitor) at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1289) - locked <0x0000000690910988> (a java.lang.Thread) at org.jruby.internal.runtime.NativeThread.join(NativeThread.java:75) at org.jruby.RubyThread.join(RubyThread.java:696) at org.jruby.RubyThread$INVOKER$i$0$1$join.call(RubyThread$INVOKER$i$0$1$join.gen) at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:661) at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:198) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60) at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105) at org.jruby.ast.BlockNode.interpret(BlockNode.java:71) at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74) at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139) at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:182) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136) at u001.logparser.tools.logstash_minus_new.logstash_minus_1_dot_4_dot_1.lib.logstash.runner.block_3$RUBY$main(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/runner.rb:98) at u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$block_3$RUBY$main.call(u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$block_3$RUBY$main) at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135) at org.jruby.runtime.Block.yield(Block.java:142) at org.jruby.RubyArray.eachCommon(RubyArray.java:1606) at org.jruby.RubyArray.each(RubyArray.java:1613) at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316) at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145) at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154) at u001.logparser.tools.logstash_minus_new.logstash_minus_1_dot_4_dot_1.lib.logstash.runner.method__7$RUBY$main(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/runner.rb:96) at u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$method__7$RUBY$main.call(u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$method__7$RUBY$main) at u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$method__7$RUBY$main.call(u001$logparser$tools$logstash_minus_new$logstash_minus_1_dot_4_dot_1$lib$logstash$runner$method__7$RUBY$main) at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326) at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170) at u001.logparser.tools.logstash_minus_new.logstash_minus_1_dot_4_dot_1.lib.logstash.runner.__file__(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/runner.rb:215) at u001.logparser.tools.logstash_minus_new.logstash_minus_1_dot_4_dot_1.lib.logstash.runner.load(/u001/logparser/tools/logstash-new/logstash-1.4.1/lib/logstash/runner.rb) at org.jruby.Ruby.runScript(Ruby.java:811) at org.jruby.Ruby.runScript(Ruby.java:804) at org.jruby.Ruby.runNormally(Ruby.java:673) at org.jruby.Ruby.runFromMain(Ruby.java:522) at org.jruby.Main.doRunFromMain(Main.java:395) at org.jruby.Main.internalRun(Main.java:290) at org.jruby.Main.run(Main.java:217) at org.jruby.Main.main(Main.java:197) "VM Thread" prio=10 tid=0x00007fda1c1b5000 nid=0x3a58 runnable "Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007fda1c01a000 nid=0x3a44 runnable "Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007fda1c01c000 nid=0x3a46 runnable "Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007fda1c01d800 nid=0x3a48 runnable "Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007fda1c01f800 nid=0x3a49 runnable "Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007fda1c0a0000 nid=0x3a57 runnable "VM Periodic Task Thread" prio=10 tid=0x00007fda1c1ee000 nid=0x3a6e waiting on condition JNI global references: 296

Environment

None

Status

Assignee

Jordan Sissel

Reporter

anand verma

Labels

None

Affects versions

1.4.1 (bugfix only)

Priority