{"action":"created","issue":{"url":"https://api.github.com/repos/crs4/pydoop/issues/154","labels_url":"https://api.github.com/repos/crs4/pydoop/issues/154/labels{/name}","comments_url":"https://api.github.com/repos/crs4/pydoop/issues/154/comments","events_url":"https://api.github.com/repos/crs4/pydoop/issues/154/events","html_url":"https://github.com/crs4/pydoop/issues/154","id":94478405,"number":154,"title":"cant find HADOOP_HOME when using pip to install pydoop","user":{"login":"OberstHorst","id":11874173,"avatar_url":"https://avatars.githubusercontent.com/u/11874173?v=3","gravatar_id":"","url":"https://api.github.com/users/OberstHorst","html_url":"https://github.com/OberstHorst","followers_url":"https://api.github.com/users/OberstHorst/followers","following_url":"https://api.github.com/users/OberstHorst/following{/other_user}","gists_url":"https://api.github.com/users/OberstHorst/gists{/gist_id}","starred_url":"https://api.github.com/users/OberstHorst/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/OberstHorst/subscriptions","organizations_url":"https://api.github.com/users/OberstHorst/orgs","repos_url":"https://api.github.com/users/OberstHorst/repos","events_url":"https://api.github.com/users/OberstHorst/events{/privacy}","received_events_url":"https://api.github.com/users/OberstHorst/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"mdrio","id":5130716,"avatar_url":"https://avatars.githubusercontent.com/u/5130716?v=3","gravatar_id":"","url":"https://api.github.com/users/mdrio","html_url":"https://github.com/mdrio","followers_url":"https://api.github.com/users/mdrio/followers","following_url":"https://api.github.com/users/mdrio/following{/other_user}","gists_url":"https://api.github.com/users/mdrio/gists{/gist_id}","starred_url":"https://api.github.com/users/mdrio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mdrio/subscriptions","organizations_url":"https://api.github.com/users/mdrio/orgs","repos_url":"https://api.github.com/users/mdrio/repos","events_url":"https://api.github.com/users/mdrio/events{/privacy}","received_events_url":"https://api.github.com/users/mdrio/received_events","type":"User","site_admin":false},"milestone":null,"comments":20,"created_at":"2015-07-11T14:32:15Z","updated_at":"2015-07-17T12:37:52Z","closed_at":null,"body":"I am trying to install pydoop using pip on CentOS 7. I have a working version of hadoop 2.6.0 installed, HADOOP_HOME variable is set correctly (used echo $HADOOP_HOME confirm this) (same is true for the JAVA_HOME variable, both are in .bashrc of all users including root) However when running sudo pip install pydoop i get the following error:\r\n\r\n\r\nCollecting pydoop\r\n  Using cached pydoop-1.0.0.tar.gz\r\n    Complete output from command python setup.py egg_info:\r\n    using setuptools version 18.0.1\r\n    Traceback (most recent call last):\r\n      File \"<string>\", line 20, in <module>\r\n      File \"/tmp/pip-build-gp0JuV/pydoop/setup.py\", line 59, in <module>\r\n        import pydoop.hdfs.core.impl as hdfsimpl\r\n      File \"pydoop/hdfs/__init__.py\", line 99, in <module>\r\n        init()\r\n      File \"pydoop/hdfs/__init__.py\", line 93, in init\r\n        pydoop.hadoop_classpath(), _ORIG_CLASSPATH, pydoop.hadoop_conf()\r\n      File \"pydoop/__init__.py\", line 106, in hadoop_classpath\r\n        return _PATH_FINDER.hadoop_classpath(hadoop_home)\r\n      File \"pydoop/hadoop_utils.py\", line 540, in hadoop_classpath\r\n        hadoop_home = self.hadoop_home()\r\n      File \"pydoop/hadoop_utils.py\", line 399, in hadoop_home\r\n        PathFinder.__error(\"hadoop home\", \"HADOOP_HOME\")\r\n      File \"pydoop/hadoop_utils.py\", line 385, in __error\r\n        raise ValueError(\"%s not found, try setting %s\" % (what, env_var))\r\n    ValueError: hadoop home not found, try setting HADOOP_HOME\r\n    \r\n    ----------------------------------------\r\nCommand \"python setup.py egg_info\" failed with error code 1 in /tmp/pip-build-gp0JuV/pydoop\r\n\r\nHowever when building from source it finds the correct hadoop file, but when i install it showes the following:\r\n[hadoop@localhost pydoop]$ sudo python setup.py install\r\nusing setuptools version 18.0.1\r\nTraceback (most recent call last):\r\n  File \"setup.py\", line 67, in <module>\r\n    import pydoop.hdfs.core.impl as hdfsimpl\r\n  File \"/home/hadoop/pydoop/pydoop/hdfs/__init__.py\", line 82, in <module>\r\n    from . import common, path\r\n  File \"/home/hadoop/pydoop/pydoop/hdfs/path.py\", line 28, in <module>\r\n    from . import common, fs as hdfs_fs\r\n  File \"/home/hadoop/pydoop/pydoop/hdfs/fs.py\", line 34, in <module>\r\n    from .core import core_hdfs_fs\r\n  File \"/home/hadoop/pydoop/pydoop/hdfs/core/__init__.py\", line 49, in <module>\r\n    _CORE_MODULE = init(backend=HDFS_CORE_IMPL)\r\n  File \"/home/hadoop/pydoop/pydoop/hdfs/core/__init__.py\", line 29, in init\r\n    jvm.load_jvm_lib()\r\n  File \"/home/hadoop/pydoop/pydoop/utils/jvm.py\", line 33, in load_jvm_lib\r\n    java_home = get_java_home()\r\n  File \"/home/hadoop/pydoop/pydoop/utils/jvm.py\", line 28, in get_java_home\r\n    raise RuntimeError(\"java home not found, try setting JAVA_HOME\")\r\nRuntimeError: java home not found, try setting JAVA_HOME\r\n\r\nOn building it shows::\r\n\r\nusing setuptools version 18.0.1\r\nrunning build\r\nhdfs core implementation: native\r\nrunning build_py\r\ncreating build\r\ncreating build/lib\r\ncreating build/lib/pydoop\r\ncopying pydoop/__init__.py -> build/lib/pydoop\r\ncopying pydoop/avrolib.py -> build/lib/pydoop\r\ncopying pydoop/hadoop_utils.py -> build/lib/pydoop\r\ncopying pydoop/hadut.py -> build/lib/pydoop\r\ncopying pydoop/jc.py -> build/lib/pydoop\r\ncopying pydoop/pipes.py -> build/lib/pydoop\r\ncopying pydoop/test_support.py -> build/lib/pydoop\r\ncopying pydoop/test_utils.py -> build/lib/pydoop\r\ncopying pydoop/config.py -> build/lib/pydoop\r\ncopying pydoop/version.py -> build/lib/pydoop\r\ncreating build/lib/pydoop/app\r\ncopying pydoop/app/__init__.py -> build/lib/pydoop/app\r\ncopying pydoop/app/argparse_types.py -> build/lib/pydoop/app\r\ncopying pydoop/app/main.py -> build/lib/pydoop/app\r\ncopying pydoop/app/script.py -> build/lib/pydoop/app\r\ncopying pydoop/app/script_template.py -> build/lib/pydoop/app\r\ncopying pydoop/app/submit.py -> build/lib/pydoop/app\r\ncreating build/lib/pydoop/hdfs\r\ncopying pydoop/hdfs/__init__.py -> build/lib/pydoop/hdfs\r\ncopying pydoop/hdfs/common.py -> build/lib/pydoop/hdfs\r\ncopying pydoop/hdfs/file.py -> build/lib/pydoop/hdfs\r\ncopying pydoop/hdfs/fs.py -> build/lib/pydoop/hdfs\r\ncopying pydoop/hdfs/path.py -> build/lib/pydoop/hdfs\r\ncreating build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/__init__.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/api.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/binary_streams.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/connections.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/environment_keys.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/jwritable_utils.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/pipes.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/simulator.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/streams.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/string_utils.py -> build/lib/pydoop/mapreduce\r\ncopying pydoop/mapreduce/text_streams.py -> build/lib/pydoop/mapreduce\r\ncreating build/lib/pydoop/utils\r\ncopying pydoop/utils/__init__.py -> build/lib/pydoop/utils\r\ncopying pydoop/utils/conversion_tables.py -> build/lib/pydoop/utils\r\ncopying pydoop/utils/jvm.py -> build/lib/pydoop/utils\r\ncopying pydoop/utils/misc.py -> build/lib/pydoop/utils\r\ncopying pydoop/utils/serialize.py -> build/lib/pydoop/utils\r\ncreating build/lib/pydoop/hdfs/core\r\ncopying pydoop/hdfs/core/__init__.py -> build/lib/pydoop/hdfs/core\r\ncopying pydoop/hdfs/core/api.py -> build/lib/pydoop/hdfs/core\r\ncopying pydoop/hdfs/core/impl.py -> build/lib/pydoop/hdfs/core\r\ncreating build/lib/pydoop/hdfs/core/bridged\r\ncopying pydoop/hdfs/core/bridged/__init__.py -> build/lib/pydoop/hdfs/core/bridged\r\ncopying pydoop/hdfs/core/bridged/common.py -> build/lib/pydoop/hdfs/core/bridged\r\ncopying pydoop/hdfs/core/bridged/hadoop.py -> build/lib/pydoop/hdfs/core/bridged\r\ncreating build/lib/pydoop/utils/bridge\r\ncopying pydoop/utils/bridge/__init__.py -> build/lib/pydoop/utils/bridge\r\ncopying pydoop/utils/bridge/factory.py -> build/lib/pydoop/utils/bridge\r\ncopying pydoop/utils/bridge/jpype_loader.py -> build/lib/pydoop/utils/bridge\r\ncopying pydoop/utils/bridge/pyjnius_loader.py -> build/lib/pydoop/utils/bridge\r\ncopying pydoop/pydoop.properties -> build/lib/pydoop\r\nrunning build_ext\r\nbuilding 'pydoop.sercore' extension\r\ncreating build/temp.linux-x86_64-2.7\r\ncreating build/temp.linux-x86_64-2.7/src\r\ncreating build/temp.linux-x86_64-2.7/src/serialize\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python2.7 -c src/serialize/protocol_codec.cc -o build/temp.linux-x86_64-2.7/src/serialize/protocol_codec.o -Wno-write-strings -O3\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python2.7 -c src/serialize/SerialUtils.cc -o build/temp.linux-x86_64-2.7/src/serialize/SerialUtils.o -Wno-write-strings -O3\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python2.7 -c src/serialize/StringUtils.cc -o build/temp.linux-x86_64-2.7/src/serialize/StringUtils.o -Wno-write-strings -O3\r\ng++ -pthread -shared -Wl,-z,relro build/temp.linux-x86_64-2.7/src/serialize/protocol_codec.o build/temp.linux-x86_64-2.7/src/serialize/SerialUtils.o build/temp.linux-x86_64-2.7/src/serialize/StringUtils.o -L/usr/lib64 -lpython2.7 -o build/lib/pydoop/sercore.so\r\nbuilding 'pydoop.native_core_hdfs' extension\r\ncreating build/temp.linux-x86_64-2.7/src/libhdfsV2\r\ncreating build/temp.linux-x86_64-2.7/src/libhdfsV2/common\r\ncreating build/temp.linux-x86_64-2.7/src/libhdfsV2/os\r\ncreating build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix\r\ncreating build/temp.linux-x86_64-2.7/src/native_core_hdfs\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/exception.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/exception.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/expect.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/expect.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/hdfs.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/hdfs.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/jni_helper.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/jni_helper.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/native_mini_dfs.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/native_mini_dfs.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/common/htable.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/common/htable.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/os/posix/mutexes.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix/mutexes.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/os/posix/thread.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix/thread.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/libhdfsV2/os/posix/thread_local_storage.c -o build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix/thread_local_storage.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/native_core_hdfs/hdfs_file.cc -o build/temp.linux-x86_64-2.7/src/native_core_hdfs/hdfs_file.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/native_core_hdfs/hdfs_fs.cc -o build/temp.linux-x86_64-2.7/src/native_core_hdfs/hdfs_fs.o -Wno-write-strings\r\ngcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DHADOOP_LIBHDFS_V2=1 -I/opt/jdk1.8.0_45/include -Inative/jni_include -I/opt/jdk1.8.0_45/lib -I/opt/jdk1.8.0_45/include/linux -Isrc/libhdfsV2 -Isrc/libhdfsV2/os/posix -I/usr/include/python2.7 -c src/native_core_hdfs/hdfs_module.cc -o build/temp.linux-x86_64-2.7/src/native_core_hdfs/hdfs_module.o -Wno-write-strings\r\ng++ -pthread -shared -Wl,-z,relro build/temp.linux-x86_64-2.7/src/libhdfsV2/exception.o build/temp.linux-x86_64-2.7/src/libhdfsV2/expect.o build/temp.linux-x86_64-2.7/src/libhdfsV2/hdfs.o build/temp.linux-x86_64-2.7/src/libhdfsV2/jni_helper.o build/temp.linux-x86_64-2.7/src/libhdfsV2/native_mini_dfs.o build/temp.linux-x86_64-2.7/src/libhdfsV2/common/htable.o build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix/mutexes.o build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix/thread.o build/temp.linux-x86_64-2.7/src/libhdfsV2/os/posix/thread_local_storage.o build/temp.linux-x86_64-2.7/src/native_core_hdfs/hdfs_file.o build/temp.linux-x86_64-2.7/src/native_core_hdfs/hdfs_fs.o build/temp.linux-x86_64-2.7/src/native_core_hdfs/hdfs_module.o -L/opt/jdk1.8.0_45/Libraries -L/opt/jdk1.8.0_45/jre/lib/amd64/server -L/usr/lib64 -ldl -ljvm -lpython2.7 -o build/lib/pydoop/native_core_hdfs.so -Wl,-rpath,/opt/jdk1.8.0_45/jre/lib/amd64/server\r\nhadoop_home: '/home/hadoop/hadoop'\r\nhadoop_version: '2.6.0'\r\njava_home: '/opt/jdk1.8.0_45'\r\nBuilding java code for hadoop-2.6.0\r\nCompiling Java classes\r\nNote: Some input files use or override a deprecated API.\r\nNote: Recompile with -Xlint:deprecation for details.\r\nNote: Some input files use unchecked or unsafe operations.\r\nNote: Recompile with -Xlint:unchecked for details.\r\nCopying properties file\r\nMaking Jar: build/lib/pydoop/pydoop.jar\r\nPackaging Java classes\r\nCommand: jar -cf build/lib/pydoop/pydoop.jar -C build/temp.linux-x86_64-2.7/pipes ./it\r\nBuild finished\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/crs4/pydoop/issues/comments/122262079","html_url":"https://github.com/crs4/pydoop/issues/154#issuecomment-122262079","issue_url":"https://api.github.com/repos/crs4/pydoop/issues/154","id":122262079,"user":{"login":"mdrio","id":5130716,"avatar_url":"https://avatars.githubusercontent.com/u/5130716?v=3","gravatar_id":"","url":"https://api.github.com/users/mdrio","html_url":"https://github.com/mdrio","followers_url":"https://api.github.com/users/mdrio/followers","following_url":"https://api.github.com/users/mdrio/following{/other_user}","gists_url":"https://api.github.com/users/mdrio/gists{/gist_id}","starred_url":"https://api.github.com/users/mdrio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mdrio/subscriptions","organizations_url":"https://api.github.com/users/mdrio/orgs","repos_url":"https://api.github.com/users/mdrio/repos","events_url":"https://api.github.com/users/mdrio/events{/privacy}","received_events_url":"https://api.github.com/users/mdrio/received_events","type":"User","site_admin":false},"created_at":"2015-07-17T12:37:52Z","updated_at":"2015-07-17T12:37:52Z","body":"Ok, the code in http://pastebin.com/RjXMkrQv successfully runs on my machine.\r\nUse the following line:\r\n\r\n```pydoop submit --avro-input v --upload-file-to-cache test.py --mrv2 test avro_test.avro data_out```"}}