{"action":"created","issue":{"url":"https://api.github.com/repos/alces-software/clusterware/issues/30","labels_url":"https://api.github.com/repos/alces-software/clusterware/issues/30/labels{/name}","comments_url":"https://api.github.com/repos/alces-software/clusterware/issues/30/comments","events_url":"https://api.github.com/repos/alces-software/clusterware/issues/30/events","html_url":"https://github.com/alces-software/clusterware/issues/30","id":121866911,"number":30,"title":"Compute node memory limits","user":{"login":"ste78","id":503613,"avatar_url":"https://avatars.githubusercontent.com/u/503613?v=3","gravatar_id":"","url":"https://api.github.com/users/ste78","html_url":"https://github.com/ste78","followers_url":"https://api.github.com/users/ste78/followers","following_url":"https://api.github.com/users/ste78/following{/other_user}","gists_url":"https://api.github.com/users/ste78/gists{/gist_id}","starred_url":"https://api.github.com/users/ste78/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ste78/subscriptions","organizations_url":"https://api.github.com/users/ste78/orgs","repos_url":"https://api.github.com/users/ste78/repos","events_url":"https://api.github.com/users/ste78/events{/privacy}","received_events_url":"https://api.github.com/users/ste78/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-12-12T17:10:41Z","updated_at":"2015-12-17T10:53:59Z","closed_at":null,"body":"The AlcesHPC puppet modules used to set ulimits typical for compute type jobs, we don't do this with clusterware - I'm not sure if this should be something we do with the image or with clusterware (at least the SGE EL7 change below will need to be clusterware at least I think...) maybe needs more discussion about where it should go - but logging here anyway\r\n\r\nBefore the limits:\r\n```\r\n[alces-cluster@headnode1(edi-build) ~]$ echo 'ulimit -l' | qsub -q *@node2i01\r\nYour job 21 (\"STDIN\") has been submitted\r\n[alces-cluster@headnode1(edi-build) ~]$ cat STDIN.o21\r\n64\r\n```\r\nAfter on EL7 with the both below patches:\r\n```\r\n[alces-cluster@headnode1(edi-build) ~]$ echo \"ulimit -l\" | qsub -q *@node2i01\r\nYour job 29 (\"STDIN\") has been submitted\r\n[alces-cluster@headnode1(edi-build) ~]$ cat STDIN.o29\r\nunlimited\r\n```\r\n\r\nEL6 + EL7 for (qrsh):\r\n```\r\ncat << EOF > /etc/security/limits.d/99-clusterware.conf\r\n#Allow all users to lock all memory\r\n* soft memlock unlimited\r\n* hard memlock unlimited\r\nEOF\r\n```\r\n\r\nEL7:\r\nAdd:\r\n```\r\nLimitMEMLOCK=infinity\r\n```\r\nto the [service] section of /etc/systemd/system/clusterware-gridscheduler-execd.service\r\n"},"comment":{"url":"https://api.github.com/repos/alces-software/clusterware/issues/comments/165421280","html_url":"https://github.com/alces-software/clusterware/issues/30#issuecomment-165421280","issue_url":"https://api.github.com/repos/alces-software/clusterware/issues/30","id":165421280,"user":{"login":"mjtko","id":206834,"avatar_url":"https://avatars.githubusercontent.com/u/206834?v=3","gravatar_id":"","url":"https://api.github.com/users/mjtko","html_url":"https://github.com/mjtko","followers_url":"https://api.github.com/users/mjtko/followers","following_url":"https://api.github.com/users/mjtko/following{/other_user}","gists_url":"https://api.github.com/users/mjtko/gists{/gist_id}","starred_url":"https://api.github.com/users/mjtko/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mjtko/subscriptions","organizations_url":"https://api.github.com/users/mjtko/orgs","repos_url":"https://api.github.com/users/mjtko/repos","events_url":"https://api.github.com/users/mjtko/events{/privacy}","received_events_url":"https://api.github.com/users/mjtko/received_events","type":"User","site_admin":false},"created_at":"2015-12-17T10:53:59Z","updated_at":"2015-12-17T10:53:59Z","body":"Yup, I think this should go in Clusterware (specifically in the Serviceware for GridScheduler).  Is there an equivalent for `LimitMEMLOCK=infinity` that needs adding the the EL6 SysV init script -- perhaps a `ulimit` command?\r\n"}}