I am seeing examples where people use Kafka or Redis. When should I be considering using kafka and when is it not necessary? I am looking to see what tradeoffs and potential pitfalls I have with my current setup?
Usually, if you want an ability to separate ingest and processing and allow for extended buffering while also guaranteeing that data is moved off the source host ASAP.
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext