I have been re-architecting my elastic cluster from a wee fledgling to this:
2 coordinating nodes
3 master nodes
12 data nodes
In the process, I seem to have become the proud owner of 170 shards per index ! ... and at > 4000 indices, that's a lotta shards baby.
Obviously this is not right.
I have > 3500 shards that won't assign.
The stack is running normally, not as quick as it used to be, but not slow however I am concerned.
What have I missed.
Any help would be greatly appreciated.
Thanks in advance