Thanks for your response.

None of the processes are deleting any index files.
One data directory is only pointed by one core.

We are writing data at a high ingestion rate (100,000 records per second).
Commit happens once every 30 seconds.

Also a periodic service runs to backup the data to our backup data store.
This service starts by saving commit point & when its done, it released the
commit point.

Could this combination of these factors some how cause the deletion of

Sent from:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB