Logstash 1.4.1 does not recognise new files in path using '*' wildcard.

Description

I want to setup logstash so that it polls a folder for new csv files. I have the input parameter within the config file setup as per following:

input {
file {
type => "typetest"
path => "C:/temp/*.csv"
sincedb_path => "C:/logstash-1.4.1/sincedb.*"
sincedb_write_interval => 15
}
}

If I set logstash to point to a specific file, e.g. path => "C:/temp/temp.csv" then it works fine. I only experience this issue when using the asterix wildcard.

I have it setup on a Windows 7 SP1 64-bit environment. Any help would be greatly appreciated, thanks.

Activity

Show:
Philippe Weber
May 27, 2014, 6:59 AM

Sorry but the file input on windows is suffering from a long-running set of issues (see linked examples)
As long as filewatch, the library used currently will be based on inode values, these won't be solved.

You should have a look into upcoming alternative like a Java based input as proposed on the contrib repository: https://github.com/elasticsearch/logstash-contrib/pull/35

MohammedB
May 28, 2014, 6:51 AM

Hi Philippe thanks for the prompt response.

Philippe Weber
August 8, 2014, 12:22 PM

Linking as duplicate and closing in favor of issues already in Confirmed state

Assignee

Logstash Developers

Reporter

MohammedB

Labels

None

Affects versions

Configure