Using Celery as an easy alternative for Logstash
<p>I'm developing a web application with Django+Celery, and I wish to add a simple stack that let me track events and get statistics. My first thought was Elasticsearch+Kibana, but I don't want to over complicate my deployment (I'm already using AWS Elasticsearch). So I was wonder why I need something like Logstash when I can send my events directly to Elasticsearch (in background with Celery).</p>

<p>If I, for instance, have to setup Redis or RabbitMQ to send messages to Logstash so it can sent to Elasticsearch, I could do the same with Celery, which I have already running.</p>

<p>My plan would be to call a Celery task from Django, with an array of events that would be sent to Elasticsearch. I'm using AWS SQS to connect with Celery.</p>

<p>I understand that with Logstash I can merge different sources, but this is not my problem right now. In fact, I'm already using AWS CloudWatch to centralize logs, which could do the same work as Logstash, but it's easier to send JSON events to Elasticsearch directly.</p>

<p>Surely I'm missing something, because I haven't found anyone using Celery like that. But I would like to know the reason.</p>

<p>My web it's very small at the moment and I should focus in other areas before complicate my deployment so much if it's not necessary.</p>