{"action":"created","issue":{"url":"https://api.github.com/repos/meltmedia/jgroups-aws/issues/8","labels_url":"https://api.github.com/repos/meltmedia/jgroups-aws/issues/8/labels{/name}","comments_url":"https://api.github.com/repos/meltmedia/jgroups-aws/issues/8/comments","events_url":"https://api.github.com/repos/meltmedia/jgroups-aws/issues/8/events","html_url":"https://github.com/meltmedia/jgroups-aws/issues/8","id":92247752,"number":8,"title":"Cannot get instances to form a cluster","user":{"login":"kenwdelong","id":6744405,"avatar_url":"https://avatars.githubusercontent.com/u/6744405?v=3","gravatar_id":"","url":"https://api.github.com/users/kenwdelong","html_url":"https://github.com/kenwdelong","followers_url":"https://api.github.com/users/kenwdelong/followers","following_url":"https://api.github.com/users/kenwdelong/following{/other_user}","gists_url":"https://api.github.com/users/kenwdelong/gists{/gist_id}","starred_url":"https://api.github.com/users/kenwdelong/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kenwdelong/subscriptions","organizations_url":"https://api.github.com/users/kenwdelong/orgs","repos_url":"https://api.github.com/users/kenwdelong/repos","events_url":"https://api.github.com/users/kenwdelong/events{/privacy}","received_events_url":"https://api.github.com/users/kenwdelong/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"ctrimble","id":614753,"avatar_url":"https://avatars.githubusercontent.com/u/614753?v=3","gravatar_id":"","url":"https://api.github.com/users/ctrimble","html_url":"https://github.com/ctrimble","followers_url":"https://api.github.com/users/ctrimble/followers","following_url":"https://api.github.com/users/ctrimble/following{/other_user}","gists_url":"https://api.github.com/users/ctrimble/gists{/gist_id}","starred_url":"https://api.github.com/users/ctrimble/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ctrimble/subscriptions","organizations_url":"https://api.github.com/users/ctrimble/orgs","repos_url":"https://api.github.com/users/ctrimble/repos","events_url":"https://api.github.com/users/ctrimble/events{/privacy}","received_events_url":"https://api.github.com/users/ctrimble/received_events","type":"User","site_admin":false},"milestone":null,"comments":7,"created_at":"2015-07-01T02:25:14Z","updated_at":"2015-07-01T18:38:48Z","closed_at":"2015-07-01T17:39:07Z","body":"I am following your instructions but cannot get my instances to join together.  Maybe I'm forgetting something?\r\n\r\nI'm using JGroups to distribute EhCache 2.6.8 http://ehcache.org/documentation/2.6/replication/jgroups-replicated-caching.  My ehcache.xml file looks like:\r\n\r\n\t<cacheManagerPeerProviderFactory\r\n\t\tclass=\"net.sf.ehcache.distribution.jgroups.JGroupsCacheManagerPeerProviderFactory\"\r\n\t\tproperties=\"connect=TCP(bind_port=7800):\r\n\t\t   com.meltmedia.jgroups.aws.AWS_PING(timeout=3000;port_number=7800;tags=Env,Role;log_aws_error_messages=true):         \r\n\t\t   MERGE2(min_interval=10000;max_interval=30000):\r\n\t\t   FD_SOCK:\r\n\t\t   FD(timeout=3000;max_tries=3):\r\n\t\t   VERIFY_SUSPECT(timeout=1500):\r\n\t\t   pbcast.NAKACK(retransmit_timeout=3000;use_mcast_xmit=false):\r\n\t\t   UNICAST:\r\n\t\t   pbcast.STABLE(stability_delay=1000;desired_avg_gossip=50000;max_bytes=4M):\r\n\t\t   pbcast.GMS(join_timeout=5000;print_local_addr=true;view_bundling=true):\r\n\t\t   pbcast.STATE_TRANSFER\"\r\n\t\tpropertySeparator=\"::\" />\r\n\r\n\r\nIn the logs, we see this upon startup:\r\n\r\n2015-07-01 00:58:57.889 DEBUG [localhost-startStop-1] [com.meltmedia.jgroups.aws.AWS_PING]\r\n\r\nConfigured with tags [[Env, Role]]\r\n\r\n\r\n2015-07-01 00:58:58.999 DEBUG [localhost-startStop-1] [com.meltmedia.jgroups.aws.AWS_PING] Describing AWS instances with the following filters [[{Name: tag:Rol\r\ne,Values: [API]}, {Name: tag:Env,Values: [PROD]}]]\r\n2015-07-01 00:58:58.999 DEBUG [localhost-startStop-1] [com.meltmedia.jgroups.aws.AWS_PING] Making AWS Request {{InstanceIds: [],Filters: [{Name: tag:Role,Value\r\ns: [API]}, {Name: tag:Env,Values: [PROD]}],}}\r\n2015-07-01 00:58:59.111 DEBUG [localhost-startStop-1] [com.meltmedia.jgroups.aws.AWS_PING] Instances found [[10.0.2.233, 10.0.3.188]]\r\n2015-07-01 00:59:02.147 DEBUG [localhost-startStop-1] [org.jgroups.protocols.pbcast.NAKACK]\r\n[prod-tomcat-api-2b-1-53235 setDigest()]\r\nexisting digest:  []\r\nnew digest:       prod-tomcat-api-2b-1-53235: [0 (0)]\r\nresulting digest: prod-tomcat-api-2b-1-53235: [0 (0)]\r\n2015-07-01 00:59:02.148 DEBUG [localhost-startStop-1] [org.jgroups.protocols.pbcast.GMS] prod-tomcat-api-2b-1-53235: installing view [prod-tomcat-api-2b-1-53235|0] [prod-tomcat-api-2b-1-53235]\r\n2015-07-01 00:59:02.154 DEBUG [localhost-startStop-1] [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection\r\n2015-07-01 00:59:02.154 DEBUG [localhost-startStop-1] [org.jgroups.protocols.FD_SOCK] VIEW_CHANGE received: [prod-tomcat-api-2b-1-53235]\r\n2015-07-01 00:59:02.190 DEBUG [localhost-startStop-1] [org.jgroups.protocols.pbcast.STABLE] [ergonomics] setting max_bytes to 4MB (1 members)\r\n2015-07-01 00:59:02.191 DEBUG [localhost-startStop-1] [org.jgroups.protocols.pbcast.STABLE] resuming message garbage collection\r\n2015-07-01 00:59:02.196 DEBUG [localhost-startStop-1] [org.jgroups.protocols.pbcast.GMS] created group (first member). My view is [prod-tomcat-api-2b-1-53235|0], impl is org.jgroups.protocols.pbcast.CoordGmsImpl\r\n2015-07-01 00:59:02.336 INFO  [localhost-startStop-1] [net.sf.ehcache.distribution.jgroups.JGroupsCacheManagerPeerProvider] JGroups Replication started for 'hatch-api'. JChannel: local_addr=prod-tomcat-api-2b-1-53235\r\ncluster_name=hatch-api\r\nmy_view=[prod-tomcat-api-2b-1-53235|0] [prod-tomcat-api-2b-1-53235]\r\nconnected=true\r\nclosed=false\r\ndiscard_own_messages=true\r\nstate_transfer_supported=true\r\nprops=TCP(discard_incompatible_packets=true;thread_pool_max_threads=10;ergonomics=true;enable_unicast_bundling=false;port_range=50;conn_expire_time=0;recv_buf_size=150000;thread_naming_pattern=cl;send_buf_size=150000;tcp_nodelay=true;stats=true;oob_thread_pool_enabled=true;oob_thread_pool_rejection_policy=discard;id=22;thread_pool_rejection_policy=Discard;logical_addr_cache_max_size=500;use_send_queues=true;loopback=true;timer_rejection_policy=run;sock_conn_timeout=2000;oob_thread_pool_min_threads=2;send_queue_size=10000;max_bundle_timeout=20;enable_diagnostics=true;external_port=0;oob_thread_pool_max_threads=10;log_discard_msgs=true;name=TCP;oob_thread_pool_keep_alive_time=30000;bind_addr=/fe80:0:0:0:9d:eeff:fee5:c543%eth0;wheel_size=200;bundler_capacity=200000;tick_time=50;timer_max_threads=10;thread_pool_queue_enabled=true;enable_bundling=true;oob_thread_pool_queue_enabled=true;thread_pool_keep_alive_time=30000;bind_port=7800;thread_pool_min_threads=2;reaper_interval=0;bind_interface_str=;diagnostics_ttl=8;logical_addr_cache_expiration=120000;peer_addr_read_timeout=1000;oob_thread_pool_queue_max_size=500;linger=-1;diagnostics_addr=/ff0e:0:0:0:0:0:75:75;receive_on_all_interfaces=false;timer_queue_max_size=500;thread_pool_queue_max_size=500;max_bundle_size=64000;timer_min_threads=4;thread_pool_enabled=true;bundler_type=new;timer_keep_alive_time=5000;timer_type=new;diagnostics_port=7500)\r\n:com.meltmedia.jgroups.aws.AWS_PING(credentials_provider_class=com.amazonaws.auth.DefaultAWSCredentialsProviderChain;ergonomics=true;port_range=50;stagger_timeout=0;timeout=3000;tags=Env,Role;log_aws_error_messages=true;num_initial_srv_members=0;break_on_coord_rsp=true;stats=true;port_number=7800;num_initial_members=10;name=AWS_PING;id=600;return_entire_cache=false)\r\n:MERGE2(merge_fast=true;merge_fast_delay=1000;stats=true;min_interval=10000;ergonomics=true;name=MERGE2;id=0;max_interval=30000;inconsistent_view_threshold=1)\r\n:FD_SOCK(get_cache_timeout=1000;sock_conn_timeout=1000;client_bind_port=0;ergonomics=true;start_port=0;port_range=50;suspect_msg_interval=5000;num_tries=3;bind_interface_str=;stats=true;external_port=0;name=FD_SOCK;bind_addr=/fe80:0:0:0:9d:eeff:fee5:c543%eth0;keep_alive=true;id=3)\r\n:FD(stats=true;ergonomics=true;name=FD;max_tries=3;id=2;timeout=3000)\r\n:VERIFY_SUSPECT(num_msgs=1;bind_interface_str=;stats=true;ergonomics=true;name=VERIFY_SUSPECT;bind_addr=/fe80:0:0:0:9d:eeff:fee5:c543%eth0;id=13;timeout=1500;use_icmp=false)\r\n:pbcast.NAKACK(use_mcast_xmit=false;ergonomics=true;xmit_table_msgs_per_row=10000;xmit_table_max_compaction_time=600000;xmit_stagger_timeout=200;print_stability_history_on_failed_xmit=false;retransmit_timeouts=3000;discard_delivered_msgs=true;max_msg_batch_size=100;exponential_backoff=300;xmit_table_num_rows=5;stats=true;xmit_from_random_member=false;log_discard_msgs=true;log_not_found_msgs=true;xmit_table_resize_factor=1.2;name=NAKACK;id=15;max_rebroadcast_timeout=2000;use_mcast_xmit_req=false;use_range_based_retransmitter=true)\r\n:UNICAST(ergonomics=true;xmit_table_msgs_per_row=1000;xmit_table_max_compaction_time=600000;max_retransmit_time=60000;xmit_interval=2000;timeout=400,800,1600,3200;max_msg_batch_size=500;conn_expiry_timeout=60000;xmit_table_num_rows=100;stats=true;xmit_table_resize_factor=1.2;name=UNICAST;id=12;segment_capacity=1000)\r\n:pbcast.STABLE(cap=0.1;stability_delay=1000;stats=true;ergonomics=true;name=STABLE;desired_avg_gossip=50000;max_bytes=4000000;id=16)\r\n:pbcast.GMS(max_join_attempts=0;print_local_addr=true;handle_concurrent_startup=true;view_bundling=true;leave_timeout=1000;log_view_warnings=true;ergonomics=true;resume_task_timeout=20000;use_flush_if_present=true;print_physical_addrs=true;join_timeout=5000;view_ack_collection_timeout=2000;stats=true;num_prev_views=20;merge_timeout=5000;max_bundling_time=50;name=GMS;num_prev_mbrs=50;id=14;log_collect_msgs=true)\r\n:pbcast.STATE_TRANSFER(stats=true;ergonomics=true;name=STATE_TRANSFER;id=17)\r\n\r\nMy security group has all ports open to itself over TCP.\r\n\r\nAs you can see, the call to AWS succeeds and finds the two servers.  But the server identities somehow don't seem to make it over to JGroups.\r\n\r\nAny ideas?"},"comment":{"url":"https://api.github.com/repos/meltmedia/jgroups-aws/issues/comments/117791358","html_url":"https://github.com/meltmedia/jgroups-aws/issues/8#issuecomment-117791358","issue_url":"https://api.github.com/repos/meltmedia/jgroups-aws/issues/8","id":117791358,"user":{"login":"ctrimble","id":614753,"avatar_url":"https://avatars.githubusercontent.com/u/614753?v=3","gravatar_id":"","url":"https://api.github.com/users/ctrimble","html_url":"https://github.com/ctrimble","followers_url":"https://api.github.com/users/ctrimble/followers","following_url":"https://api.github.com/users/ctrimble/following{/other_user}","gists_url":"https://api.github.com/users/ctrimble/gists{/gist_id}","starred_url":"https://api.github.com/users/ctrimble/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ctrimble/subscriptions","organizations_url":"https://api.github.com/users/ctrimble/orgs","repos_url":"https://api.github.com/users/ctrimble/repos","events_url":"https://api.github.com/users/ctrimble/events{/privacy}","received_events_url":"https://api.github.com/users/ctrimble/received_events","type":"User","site_admin":false},"created_at":"2015-07-01T18:38:48Z","updated_at":"2015-07-01T18:38:48Z","body":"@kenwdelong This is great news.  Perhaps an info level log about `-Djava.net.preferIPv4Stack=true` is in order."}}