{"action":"created","issue":{"url":"https://api.github.com/repos/spring-projects/spring-xd/issues/1526","labels_url":"https://api.github.com/repos/spring-projects/spring-xd/issues/1526/labels{/name}","comments_url":"https://api.github.com/repos/spring-projects/spring-xd/issues/1526/comments","events_url":"https://api.github.com/repos/spring-projects/spring-xd/issues/1526/events","html_url":"https://github.com/spring-projects/spring-xd/issues/1526","id":64621215,"number":1526,"title":"Issues writing to HDFS ","user":{"login":"thesynapses","id":8339634,"avatar_url":"https://avatars.githubusercontent.com/u/8339634?v=3","gravatar_id":"","url":"https://api.github.com/users/thesynapses","html_url":"https://github.com/thesynapses","followers_url":"https://api.github.com/users/thesynapses/followers","following_url":"https://api.github.com/users/thesynapses/following{/other_user}","gists_url":"https://api.github.com/users/thesynapses/gists{/gist_id}","starred_url":"https://api.github.com/users/thesynapses/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thesynapses/subscriptions","organizations_url":"https://api.github.com/users/thesynapses/orgs","repos_url":"https://api.github.com/users/thesynapses/repos","events_url":"https://api.github.com/users/thesynapses/events{/privacy}","received_events_url":"https://api.github.com/users/thesynapses/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2015-03-26T20:07:48Z","updated_at":"2015-03-30T19:02:36Z","closed_at":null,"body":"I am using SpringXD 1.1.0\r\nTried creating a simple stream to write data to a **remote hadoop cluster** with the command below:\r\n\r\n`stream create --name m2 --definition \"time | hdfs --fsUri=hdfs://PHD-HA.DOMAIN.COM --directory=/sysr/xd\" --deploy`\r\n\r\n**I get an error:**\r\n\r\n`2015-03-26 19:58:30,967 1.1.0.RELEASE  INFO DeploymentSupervisor-0 server.StreamDeploymentListener - Deploying stream Stream{name='m2'}\r\n2015-03-26 19:58:31,085 1.1.0.RELEASE  INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Path cache event: path=/deployments/modules/allocated/93e0cfcd-dc10-4966-b044-babdbea8ebdd/m2.sink.hdfs.1, type=CHILD_ADDED\r\n2015-03-26 19:58:31,086 1.1.0.RELEASE  INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module 'hdfs' for stream 'm2'\r\n2015-03-26 19:58:31,213 1.1.0.RELEASE  INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module [ModuleDescriptor@4b436f63 moduleName = 'hdfs', moduleLabel = 'hdfs', group = 'm2', sourceChannelName = [null], sinkChannelName = [null], index = 1, type = sink, parameters = map['directory' -> '/sysr/xd'], children = list[[empty]]]\r\n2015-03-26 19:58:31,858 1.1.0.RELEASE  WARN DeploymentsPathChildrenCache-0 util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable\r\n2015-03-26 19:58:32,913 1.1.0.RELEASE  INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Path cache event: path=/deployments/modules/allocated/93e0cfcd-dc10-4966-b044-babdbea8ebdd/m2.source.time.1, type=CHILD_ADDED\r\n2015-03-26 19:58:32,913 1.1.0.RELEASE  INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module 'time' for stream 'm2'\r\n2015-03-26 19:58:33,044 1.1.0.RELEASE  INFO DeploymentsPathChildrenCache-0 server.DeploymentListener - Deploying module [ModuleDescriptor@29c70b12 moduleName = 'time', moduleLabel = 'time', group = 'm2', sourceChannelName = [null], sinkChannelName = [null], index = 0, type = source, parameters = map[[empty]], children = list[[empty]]]\r\n2015-03-26 19:58:33,359 1.1.0.RELEASE  INFO DeploymentSupervisor-0 server.StreamDeploymentListener - Deployment status for stream 'm2': DeploymentStatus{state=deployed}\r\n2015-03-26 19:58:33,361 1.1.0.RELEASE  INFO DeploymentSupervisor-0 server.StreamDeploymentListener - Stream Stream{name='m2'} deployment attempt complete\r\n2015-03-26 19:58:33,452 1.1.0.RELEASE ERROR task-scheduler-1 handler.LoggingHandler - org.springframework.messaging.MessageHandlingException: failed to write Message payload to HDFS; nested exception is org.springframework.data.hadoop.store.StoreException: We've reached maxOpenAttempts=10 to find suitable output path. Last path tried was path=[/sysr/xd/m2-9.txt.tmp]\r\n        at org.springframework.xd.integration.hadoop.outbound.HdfsStoreMessageHandler.handleMessageInternal(HdfsStoreMessageHandler.java:129)\r\n        at org.springframework.integration.handler.AbstractMessageHandler.handleMessage(AbstractMessageHandler.java:78)\r\n        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\r\n        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\r\n        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n        at java.lang.reflect.Method.invoke(Method.java:606)\r\n        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)\r\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)\r\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)\r\n        at org.springframework.integration.monitor.SimpleMessageHandlerMetrics.handleMessage(SimpleMessageHandlerMetrics.java:107)\r\n        at org.springframework.integration.monitor.SimpleMessageHandlerMetrics.invoke(SimpleMessageHandlerMetrics.java:87)\r\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)\r\n        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:207)\r\n        at com.sun.proxy.$Proxy136.handleMessage(Unknown Source)`\r\n"},"comment":{"url":"https://api.github.com/repos/spring-projects/spring-xd/issues/comments/87792383","html_url":"https://github.com/spring-projects/spring-xd/issues/1526#issuecomment-87792383","issue_url":"https://api.github.com/repos/spring-projects/spring-xd/issues/1526","id":87792383,"user":{"login":"thesynapses","id":8339634,"avatar_url":"https://avatars.githubusercontent.com/u/8339634?v=3","gravatar_id":"","url":"https://api.github.com/users/thesynapses","html_url":"https://github.com/thesynapses","followers_url":"https://api.github.com/users/thesynapses/followers","following_url":"https://api.github.com/users/thesynapses/following{/other_user}","gists_url":"https://api.github.com/users/thesynapses/gists{/gist_id}","starred_url":"https://api.github.com/users/thesynapses/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thesynapses/subscriptions","organizations_url":"https://api.github.com/users/thesynapses/orgs","repos_url":"https://api.github.com/users/thesynapses/repos","events_url":"https://api.github.com/users/thesynapses/events{/privacy}","received_events_url":"https://api.github.com/users/thesynapses/received_events","type":"User","site_admin":false},"created_at":"2015-03-30T19:02:36Z","updated_at":"2015-03-30T19:02:36Z","body":"Not sure what name are you referring to here ?\n"}}