I have been re-architecting my elastic cluster from a wee fledgling to this:
2 coordinating nodes
3 master nodes
12 data nodes

In the process, I seem to have become the proud owner of 170 shards per index ! ... and at > 4000 indices, that's a lotta shards baby.

Obviously this is not right.

I have > 3500 shards that won't assign.

The stack is running normally, not as quick as it used to be, but not slow however I am concerned.

What have I missed.

Any help would be greatly appreciated.

Thanks in advance

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB