{"action":"closed","issue":{"url":"https://api.github.com/repos/mre/kafka-influxdb/issues/5","labels_url":"https://api.github.com/repos/mre/kafka-influxdb/issues/5/labels{/name}","comments_url":"https://api.github.com/repos/mre/kafka-influxdb/issues/5/comments","events_url":"https://api.github.com/repos/mre/kafka-influxdb/issues/5/events","html_url":"https://github.com/mre/kafka-influxdb/issues/5","id":106317229,"number":5,"title":"No messages read from kafka","user":{"login":"aglagla","id":8946621,"avatar_url":"https://avatars.githubusercontent.com/u/8946621?v=3","gravatar_id":"","url":"https://api.github.com/users/aglagla","html_url":"https://github.com/aglagla","followers_url":"https://api.github.com/users/aglagla/followers","following_url":"https://api.github.com/users/aglagla/following{/other_user}","gists_url":"https://api.github.com/users/aglagla/gists{/gist_id}","starred_url":"https://api.github.com/users/aglagla/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aglagla/subscriptions","organizations_url":"https://api.github.com/users/aglagla/orgs","repos_url":"https://api.github.com/users/aglagla/repos","events_url":"https://api.github.com/users/aglagla/events{/privacy}","received_events_url":"https://api.github.com/users/aglagla/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/mre/kafka-influxdb/labels/bug","name":"bug","color":"fc2929"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":18,"created_at":"2015-09-14T10:51:49Z","updated_at":"2015-10-18T18:50:55Z","closed_at":"2015-10-18T18:50:55Z","body":"Kafka jar : kafka_2.11-0.8.2.1.jar\r\nPython mods : \r\nkafka-influxdb==0.5.0\r\nkafka-python==0.9.4\r\nconfig.yaml : \r\n```\r\nkafka:\r\n  host: \"localhost\"\r\n  port: 9092\r\n  topic: \"mytopic\"\r\ninfluxdb:\r\n  host: \"localhost\"\r\n  port: 8086\r\n  user: \"myuser\"\r\n  password: \"mypwd\"\r\n  dbname: \"mydb\"\r\n  retention_policy: \"default\"\r\nencoder: \"collectd_graphite_encoder\"\r\nbenchmark: false\r\nbuffer_size: 1000\r\nverbose: false\r\nstatistics: true\r\n```\r\n\r\nOn a simple local configuration, kafka broker is on localhost:9092, influxdb and collectd running as well.\r\nCollectd is sending messages to kafka (checked with kafka-console-consumer.sh)\r\nInfluxdb accepting requests.\r\nHowever, when starting kafka_influxdb as follows (foreground mode)\r\nkafka_influxdb -c ./config.yaml -vvv\r\n```\r\nTraceback (most recent call last):\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 851, in emit\r\n    msg = self.format(record)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 724, in format\r\n    return fmt.format(record)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 464, in format\r\n    record.message = record.getMessage()\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 328, in getMessage\r\n    msg = msg % self.args\r\nTypeError: not all arguments converted during string formatting\r\nLogged from file kafka_influxdb.py, line 100\r\nTraceback (most recent call last):\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 851, in emit\r\n    msg = self.format(record)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 724, in format\r\n    return fmt.format(record)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 464, in format\r\n    record.message = record.getMessage()\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 328, in getMessage\r\n    msg = msg % self.args\r\nTypeError: not all arguments converted during string formatting\r\nLogged from file kafka_influxdb.py, line 118\r\nTraceback (most recent call last):\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 851, in emit\r\n    msg = self.format(record)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 724, in format\r\n    return fmt.format(record)\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 464, in format\r\n    record.message = record.getMessage()\r\n  File \"/usr/lib/python2.7/logging/__init__.py\", line 328, in getMessage\r\n    msg = msg % self.args\r\nTypeError: not all arguments converted during string formatting\r\nLogged from file kafka_influxdb.py, line 130\r\nINFO:root:Connecting to InfluxDB at localhost:8086...\r\nINFO:root:Creating database mydb if not exists\r\nINFO:root:Creating InfluxDB database if not exists: mydb\r\nINFO:urllib3.connectionpool:Starting new HTTP connection (1): localhost\r\nDEBUG:urllib3.connectionpool:Setting read timeout to None\r\nDEBUG:urllib3.connectionpool:\"GET /query?q=CREATE+DATABASE+mydb&db=mydb HTTP/1.1\" 200 72\r\nINFO:root:database already exists\r\nINFO:root:Listening for messages on Kafka topic mytopic...\r\n```\r\nlsof -nn on the process gives the following output : \r\n```\r\nCOMMAND     PID USER   FD   TYPE    DEVICE SIZE/OFF    NODE NAME\r\nkafka_inf 23950 root  txt    REG       8,2  3345416  131084 /usr/bin/python2.7\r\nkafka_inf 23950 root  mem    REG       8,2    47712 4722756 /lib/x86_64-linux-gnu/libnss_files-2.19.so\r\nkafka_inf 23950 root  mem    REG       8,2   194174 1449890 /usr/local/lib/python2.7/dist-packages/pandas/_testing.so\r\nkafka_inf 23950 root  mem    REG       8,2   589629 1449892 /usr/local/lib/python2.7/dist-packages/pandas/msgpack.so\r\nkafka_inf 23950 root  mem    REG       8,2   304666 1450056 /usr/local/lib/python2.7/dist-packages/pandas/json.so\r\nkafka_inf 23950 root  mem    REG       8,2  2005176 1449891 /usr/local/lib/python2.7/dist-packages/pandas/parser.so\r\nkafka_inf 23950 root  mem    REG       8,2  1437878 1450065 /usr/local/lib/python2.7/dist-packages/pandas/_sparse.so\r\nkafka_inf 23950 root  mem    REG       8,2  1653285 1450058 /usr/local/lib/python2.7/dist-packages/pandas/_period.so\r\nkafka_inf 23950 root  mem    REG       8,2  1054219 1450055 /usr/local/lib/python2.7/dist-packages/pandas/index.so\r\nkafka_inf 23950 root  mem    REG       8,2 12434880 1450136 /usr/local/lib/python2.7/dist-packages/pandas/algos.so\r\nkafka_inf 23950 root  mem    REG       8,2    34256  272801 /usr/lib/python2.7/lib-dynload/_csv.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2  4801036 1450057 /usr/local/lib/python2.7/dist-packages/pandas/lib.so\r\nkafka_inf 23950 root  mem    REG       8,2  5514790 1450137 /usr/local/lib/python2.7/dist-packages/pandas/tslib.so\r\nkafka_inf 23950 root  mem    REG       8,2  2128770  923406 /usr/local/lib/python2.7/dist-packages/numpy/random/mtrand.so\r\nkafka_inf 23950 root  mem    REG       8,2   135687 1063785 /usr/local/lib/python2.7/dist-packages/numpy/fft/fftpack_lite.so\r\nkafka_inf 23950 root  mem    REG       8,2     7632  272779 /usr/lib/python2.7/lib-dynload/future_builtins.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2   673678  923385 /usr/local/lib/python2.7/dist-packages/numpy/linalg/_umath_linalg.so\r\nkafka_inf 23950 root  mem    REG       8,2   244856  135734 /usr/lib/x86_64-linux-gnu/libquadmath.so.0.0.0\r\nkafka_inf 23950 root  mem    REG       8,2    90080 4722708 /lib/x86_64-linux-gnu/libgcc_s.so.1\r\nkafka_inf 23950 root  mem    REG       8,2  1153392  135335 /usr/lib/x86_64-linux-gnu/libgfortran.so.3.0.0\r\nkafka_inf 23950 root  mem    REG       8,2   511344  789219 /usr/lib/libblas/libblas.so.3.0\r\nkafka_inf 23950 root  mem    REG       8,2  5882272  792640 /usr/lib/lapack/liblapack.so.3.0\r\nkafka_inf 23950 root  mem    REG       8,2    51744  923391 /usr/local/lib/python2.7/dist-packages/numpy/linalg/lapack_lite.so\r\nkafka_inf 23950 root  mem    REG       8,2   102644 1207007 /usr/local/lib/python2.7/dist-packages/numpy/lib/_compiled_base.so\r\nkafka_inf 23950 root  mem    REG       8,2   625265 1063910 /usr/local/lib/python2.7/dist-packages/numpy/core/scalarmath.so\r\nkafka_inf 23950 root  mem    REG       8,2  2234567 1063884 /usr/local/lib/python2.7/dist-packages/numpy/core/umath.so\r\nkafka_inf 23950 root  mem    REG       8,2  7452726 1063879 /usr/local/lib/python2.7/dist-packages/numpy/core/multiarray.so\r\nkafka_inf 23950 root  mem    REG       8,2  1270596 1450138 /usr/local/lib/python2.7/dist-packages/pandas/hashtable.so\r\nkafka_inf 23950 root  mem    REG       8,2    18936 4722839 /lib/x86_64-linux-gnu/libuuid.so.1.3.0\r\nkafka_inf 23950 root  mem    REG       8,2    30944  139649 /usr/lib/x86_64-linux-gnu/libffi.so.6.0.1\r\nkafka_inf 23950 root  mem    REG       8,2   136232  272793 /usr/lib/python2.7/lib-dynload/_ctypes.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2    54064  272798 /usr/lib/python2.7/lib-dynload/_json.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2    33448  272783 /usr/lib/python2.7/lib-dynload/_multiprocessing.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2    77752  271801 /usr/lib/python2.7/lib-dynload/parser.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2   387256 4718682 /lib/x86_64-linux-gnu/libssl.so.1.0.0\r\nkafka_inf 23950 root  mem    REG       8,2    38480  272785 /usr/lib/python2.7/lib-dynload/_ssl.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2  1930528 4718681 /lib/x86_64-linux-gnu/libcrypto.so.1.0.0\r\nkafka_inf 23950 root  mem    REG       8,2    20664  271802 /usr/lib/python2.7/lib-dynload/_hashlib.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2   109232  272794 /usr/lib/python2.7/lib-dynload/datetime.x86_64-linux-gnu.so\r\nkafka_inf 23950 root  mem    REG       8,2  7476720  138263 /usr/lib/locale/locale-archive\r\nkafka_inf 23950 root  mem    REG       8,2  1071552 4722731 /lib/x86_64-linux-gnu/libm-2.19.so\r\nkafka_inf 23950 root  mem    REG       8,2   100728 4722844 /lib/x86_64-linux-gnu/libz.so.1.2.8\r\nkafka_inf 23950 root  mem    REG       8,2    10680 4722836 /lib/x86_64-linux-gnu/libutil-2.19.so\r\nkafka_inf 23950 root  mem    REG       8,2    14664 4722698 /lib/x86_64-linux-gnu/libdl-2.19.so\r\nkafka_inf 23950 root  mem    REG       8,2  1845024 4722681 /lib/x86_64-linux-gnu/libc-2.19.so\r\nkafka_inf 23950 root  mem    REG       8,2   141574 4722801 /lib/x86_64-linux-gnu/libpthread-2.19.so\r\nkafka_inf 23950 root  mem    REG       8,2   149120 4722657 /lib/x86_64-linux-gnu/ld-2.19.so\r\nkafka_inf 23950 root    0u   CHR     136,9      0t0      12 /dev/pts/9\r\nkafka_inf 23950 root    1u   CHR     136,9      0t0      12 /dev/pts/9\r\nkafka_inf 23950 root    2u   CHR     136,9      0t0      12 /dev/pts/9\r\nkafka_inf 23950 root    3u  IPv4 261900078      0t0     TCP 127.0.0.1:37828->127.0.0.1:8086 (EST\r\n```\r\nIt doesn't seem to be talking to kafka nor consuming any messages.\r\n\r\nAny help would be appreciated.\r\n\r\nRegards,\r\n\r\nAlexis\r\n\r\n\r\n"}}