{"action":"created","issue":{"url":"https://api.github.com/repos/orientechnologies/orientdb/issues/3319","labels_url":"https://api.github.com/repos/orientechnologies/orientdb/issues/3319/labels{/name}","comments_url":"https://api.github.com/repos/orientechnologies/orientdb/issues/3319/comments","events_url":"https://api.github.com/repos/orientechnologies/orientdb/issues/3319/events","html_url":"https://github.com/orientechnologies/orientdb/issues/3319","id":53237953,"number":3319,"title":"(Client=55) Crash causes lingering lock on \"internal.pcl\", can't use staging database","user":{"login":"garrett-gottlieb","id":1219054,"avatar_url":"https://avatars.githubusercontent.com/u/1219054?v=3","gravatar_id":"","url":"https://api.github.com/users/garrett-gottlieb","html_url":"https://github.com/garrett-gottlieb","followers_url":"https://api.github.com/users/garrett-gottlieb/followers","following_url":"https://api.github.com/users/garrett-gottlieb/following{/other_user}","gists_url":"https://api.github.com/users/garrett-gottlieb/gists{/gist_id}","starred_url":"https://api.github.com/users/garrett-gottlieb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/garrett-gottlieb/subscriptions","organizations_url":"https://api.github.com/users/garrett-gottlieb/orgs","repos_url":"https://api.github.com/users/garrett-gottlieb/repos","events_url":"https://api.github.com/users/garrett-gottlieb/events{/privacy}","received_events_url":"https://api.github.com/users/garrett-gottlieb/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/orientechnologies/orientdb/labels/client","name":"client","color":"0052cc"},{"url":"https://api.github.com/repos/orientechnologies/orientdb/labels/wontfix","name":"wontfix","color":"ffffff"}],"state":"closed","locked":false,"assignee":{"login":"laa","id":105066,"avatar_url":"https://avatars.githubusercontent.com/u/105066?v=3","gravatar_id":"","url":"https://api.github.com/users/laa","html_url":"https://github.com/laa","followers_url":"https://api.github.com/users/laa/followers","following_url":"https://api.github.com/users/laa/following{/other_user}","gists_url":"https://api.github.com/users/laa/gists{/gist_id}","starred_url":"https://api.github.com/users/laa/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/laa/subscriptions","organizations_url":"https://api.github.com/users/laa/orgs","repos_url":"https://api.github.com/users/laa/repos","events_url":"https://api.github.com/users/laa/events{/privacy}","received_events_url":"https://api.github.com/users/laa/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/orientechnologies/orientdb/milestones/33","labels_url":"https://api.github.com/repos/orientechnologies/orientdb/milestones/33/labels","id":897335,"number":33,"title":"2.0 Final","description":"2.0 Final version after the 2.0-RC","creator":{"login":"lvca","id":312606,"avatar_url":"https://avatars.githubusercontent.com/u/312606?v=3","gravatar_id":"","url":"https://api.github.com/users/lvca","html_url":"https://github.com/lvca","followers_url":"https://api.github.com/users/lvca/followers","following_url":"https://api.github.com/users/lvca/following{/other_user}","gists_url":"https://api.github.com/users/lvca/gists{/gist_id}","starred_url":"https://api.github.com/users/lvca/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lvca/subscriptions","organizations_url":"https://api.github.com/users/lvca/orgs","repos_url":"https://api.github.com/users/lvca/repos","events_url":"https://api.github.com/users/lvca/events{/privacy}","received_events_url":"https://api.github.com/users/lvca/received_events","type":"User","site_admin":false},"open_issues":41,"closed_issues":47,"state":"open","created_at":"2014-12-09T14:13:06Z","updated_at":"2015-01-02T19:01:08Z","due_on":"2015-01-05T23:00:00Z","closed_at":null},"comments":13,"created_at":"2015-01-02T05:14:06Z","updated_at":"2015-01-02T22:58:11Z","closed_at":"2015-01-02T06:37:29Z","body":"After the database crashed due to OOM, I tried closing with `./shutdown` after which it got stuck at:\r\n```\r\n2015-01-02 02:10:40:361 INFO  Shutting down databases: [OServer]\r\n2015-01-02 02:10:40:361 INFO  - storage: pumpup... [Orient]\r\n```\r\n\r\nSo I did a `kill -3 <pid>`:\r\n```\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:216)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57491)\" #6408 daemon prio=5 os_prio=0 tid=0x00007fb6882fc000 nid=0x40f8 runnable [0x00007fa473ffe000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb82c5194d0> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57490)\" #6407 daemon prio=5 os_prio=0 tid=0x00007fb6882fa000 nid=0x40f7 runnable [0x00007fa4f8b0a000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb82c500840> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57489)\" #6406 daemon prio=5 os_prio=0 tid=0x00007fb6882f9800 nid=0x40f6 runnable [0x00007fa4f8807000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb82c5c2750> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/127.0.0.1:59064)\" #6321 daemon prio=5 os_prio=0 tid=0x00007fb6882d5000 nid=0x39c4 waiting on condition [0x00007fa4f8503000]\r\n   java.lang.Thread.State: WAITING (parking)\r\n        at sun.misc.Unsafe.park(Native Method)\r\n        - parking to wait for  <0x00007fb759601c58> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)\r\n        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)\r\n        at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptive.acquireSharedLock(OSharedResourceAdaptive.java:167)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptiveExternal.acquireSharedLock(OSharedResourceAdaptiveExternal.java:44)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1419)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:690)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeReadRecord(ODatabaseDocumentTx.java:1568)\r\n        at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:80)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:1433)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:117)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearchRecord(OCommandExecutorSQLSelect.java:485)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.fetchFromTarget(OCommandExecutorSQLSelect.java:1303)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.fetchValuesFromIndexCursor(OCommandExecutorSQLSelect.java:1655)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.optimizeSort(OCommandExecutorSQLSelect.java:1636)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.tryOptimizeSort(OCommandExecutorSQLSelect.java:1418)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.searchForIndexes(OCommandExecutorSQLSelect.java:1543)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.searchInClasses(OCommandExecutorSQLSelect.java:741)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLResultsetAbstract.assignTarget(OCommandExecutorSQLResultsetAbstract.java:193)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.assignTarget(OCommandExecutorSQLSelect.java:439)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)\r\n        at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptive.acquireSharedLock(OSharedResourceAdaptive.java:167)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptiveExternal.acquireSharedLock(OSharedResourceAdaptiveExternal.java:44)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1419)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:690)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeReadRecord(ODatabaseDocumentTx.java:1568)\r\n        at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:80)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:1433)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:117)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearchRecord(OCommandExecutorSQLSelect.java:485)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.fetchFromTarget(OCommandExecutorSQLSelect.java:1303)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearch(OCommandExecutorSQLSelect.java:434)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.execute(OCommandExecutorSQLSelect.java:392)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLDelegate.execute(OCommandExecutorSQLDelegate.java:64)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.executeCommand(OAbstractPaginatedStorage.java:1172)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.command(OAbstractPaginatedStorage.java:1161)\r\n        at com.orientechnologies.orient.core.sql.query.OSQLQuery.run(OSQLQuery.java:71)\r\n        at com.orientechnologies.orient.core.query.OQueryAbstract.execute(OQueryAbstract.java:33)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.command(ONetworkProtocolBinary.java:1179)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.executeRequest(ONetworkProtocolBinary.java:385)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:216)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:33886)\" #6287 daemon prio=5 os_prio=0 tid=0x00007fb6882e8000 nid=0x33ff waiting on condition [0x00007fa4f8f0e000]\r\n   java.lang.Thread.State: WAITING (parking)\r\n        at sun.misc.Unsafe.park(Native Method)\r\n        - parking to wait for  <0x00007fb759601c58> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)\r\n        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)\r\n        at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptive.acquireSharedLock(OSharedResourceAdaptive.java:167)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptiveExternal.acquireSharedLock(OSharedResourceAdaptiveExternal.java:44)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1419)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:690)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeReadRecord(ODatabaseDocumentTx.java:1568)\r\n        at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:80)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:1433)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:117)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearchRecord(OCommandExecutorSQLSelect.java:485)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.fetchFromTarget(OCommandExecutorSQLSelect.java:1303)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearch(OCommandExecutorSQLSelect.java:434)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.execute(OCommandExecutorSQLSelect.java:392)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLDelegate.execute(OCommandExecutorSQLDelegate.java:64)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.executeCommand(OAbstractPaginatedStorage.java:1172)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.command(OAbstractPaginatedStorage.java:1161)\r\n        at com.orientechnologies.orient.core.sql.query.OSQLQuery.run(OSQLQuery.java:71)\r\n        at com.orientechnologies.orient.core.query.OQueryAbstract.execute(OQueryAbstract.java:33)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.command(ONetworkProtocolBinary.java:1179)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.executeRequest(ONetworkProtocolBinary.java:385)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:216)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:42253)\" #6286 daemon prio=5 os_prio=0 tid=0x00007fb6882e6000 nid=0x33fe runnable [0x00007fa4f900f000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb8266560f8> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:40847)\" #6285 daemon prio=5 os_prio=0 tid=0x00007fb6882e4800 nid=0x33fd runnable [0x00007fa4f9110000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb826640a50> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:34218)\" #6284 daemon prio=5 os_prio=0 tid=0x00007fb6882e3000 nid=0x33fc runnable [0x00007fa4f9211000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb8267d2c30> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:37016)\" #6283 daemon prio=5 os_prio=0 tid=0x00007fb6882e2000 nid=0x33fb runnable [0x00007fa4f9312000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb8266c1e78> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:48308)\" #6282 daemon prio=5 os_prio=0 tid=0x00007fb6882e1000 nid=0x33fa waiting on condition [0x00007fa4f9412000]\r\n   java.lang.Thread.State: WAITING (parking)\r\n        at sun.misc.Unsafe.park(Native Method)\r\n        - parking to wait for  <0x00007fb759601c58> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)\r\n        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)\r\n        at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptive.acquireSharedLock(OSharedResourceAdaptive.java:167)\r\n        at com.orientechnologies.common.concur.resource.OSharedResourceAdaptiveExternal.acquireSharedLock(OSharedResourceAdaptiveExternal.java:44)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:1419)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.readRecord(OAbstractPaginatedStorage.java:690)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.executeReadRecord(ODatabaseDocumentTx.java:1568)\r\n        at com.orientechnologies.orient.core.tx.OTransactionNoTx.loadRecord(OTransactionNoTx.java:80)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.load(ODatabaseDocumentTx.java:1433)\r\n        - locked <0x00007fb821c10d60> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57475)\" #6259 daemon prio=5 os_prio=0 tid=0x00007fb6882a8800 nid=0x33dd runnable [0x00007fa4fa928000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb8218cdcf0> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57474)\" #6258 daemon prio=5 os_prio=0 tid=0x00007fb6882c9000 nid=0x33dc runnable [0x00007fa4fae2d000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb821813328> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57473)\" #6257 daemon prio=5 os_prio=0 tid=0x00007fb6882b9800 nid=0x33db runnable [0x00007fa4fb433000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb821818e80> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57472)\" #6255 daemon prio=5 os_prio=0 tid=0x00007fb6882a6800 nid=0x33d9 runnable [0x00007fa4fab2a000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb82142f140> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57471)\" #6253 daemon prio=5 os_prio=0 tid=0x00007fb6882c7000 nid=0x33d7 runnable [0x00007fa4fa120000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb821702ad0> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57470)\" #6252 daemon prio=5 os_prio=0 tid=0x00007fb6882b4800 nid=0x33d6 runnable [0x00007fa4fa322000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb821660cf8> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57469)\" #6251 daemon prio=5 os_prio=0 tid=0x00007fb6882ce800 nid=0x33d5 runnable [0x00007fa4fbc3b000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb82165fc88> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/54.69.228.49:57468)\" #6250 daemon prio=5 os_prio=0 tid=0x00007fb6882d0000 nid=0x33d4 runnable [0x00007fa4fa827000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb821660350> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:37419)\" #6219 daemon prio=5 os_prio=0 tid=0x00007fb6882c5800 nid=0x33b5 runnable [0x00007fa4f9a19000]\r\n   java.lang.Thread.State: RUNNABLE\r\n        at java.net.SocketInputStream.socketRead0(Native Method)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:150)\r\n        at java.net.SocketInputStream.read(SocketInputStream.java:121)\r\n        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)\r\n        - locked <0x00007fb821046870> (a java.io.BufferedInputStream)\r\n        at java.io.DataInputStream.readByte(DataInputStream.java:265)\r\n        at com.orientechnologies.orient.enterprise.channel.binary.OChannelBinary.readByte(OChannelBinary.java:73)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:203)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB <- BinaryClient (/206.223.160.138:46007)\" #6218 daemon prio=5 os_prio=0 tid=0x00007fb6882c2000 nid=0x33b4 runnable [0x00007fa4f9615000]\r\nrator.readCurrentRecord(OIdentifiableIterator.java:278)\r\n        at com.orientechnologies.orient.core.iterator.ORecordIteratorClusters.hasNext(ORecordIteratorClusters.java:147)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.fetchFromTarget(OCommandExecutorSQLSelect.java:1288)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.executeSearch(OCommandExecutorSQLSelect.java:434)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLSelect.execute(OCommandExecutorSQLSelect.java:392)\r\n        at com.orientechnologies.orient.core.sql.OCommandExecutorSQLDelegate.execute(OCommandExecutorSQLDelegate.java:64)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.executeCommand(OAbstractPaginatedStorage.java:1172)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.command(OAbstractPaginatedStorage.java:1161)\r\n        at com.orientechnologies.orient.core.command.OCommandRequestTextAbstract.execute(OCommandRequestTextAbstract.java:63)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.command(ONetworkProtocolBinary.java:1179)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.executeRequest(ONetworkProtocolBinary.java:385)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:216)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\n\r\n\"OrientDB Write Cache Flush Task (pumpup)\" #31 daemon prio=5 os_prio=0 tid=0x00007fb680090000 nid=0x14cf runnable [0x00007fb71817d000]\r\n   java.lang.Thread.State: TIMED_WAITING (parking)\r\n        at sun.misc.Unsafe.park(Native Method)\r\n        - parking to wait for  <0x00007fb75902d080> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)\r\n        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)\r\n        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)\r\n        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)\r\n        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)\r\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)\r\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)\r\n        at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Thread-5\" #30 daemon prio=5 os_prio=0 tid=0x00007fb68006b000 nid=0x14ce waiting on condition [0x00007fb71827e000]\r\n   java.lang.Thread.State: TIMED_WAITING (parking)\r\n        at sun.misc.Unsafe.park(Native Method)\r\n        - parking to wait for  <0x00007fb75903bed8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)\r\n        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)\r\n        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)\r\n        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)\r\n        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)\r\n        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)\r\n        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)\r\n        at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"DestroyJavaVM\" #26 prio=5 os_prio=0 tid=0x00007fbf6800d000 nid=0x14a7 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"Timer-0\" #19 daemon prio=5 os_prio=0 tid=0x00007fbf68705000 nid=0x14c7 waiting on condition [0x00007fb718fa3000]\r\n   java.lang.Thread.State: WAITING (parking)\r\n        at sun.misc.Unsafe.park(Native Method)\r\n        - parking to wait for  <0x00007fb7592757e8> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)\r\n        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)\r\n        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)\r\n        at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)\r\n        at com.orientechnologies.orient.core.Orient.getStorages(Orient.java:463)\r\n        at com.orientechnologies.common.profiler.OAbstractProfiler$1.run(OAbstractProfiler.java:267)\r\n        at java.util.TimerThread.mainLoop(Timer.java:555)\r\n        at java.util.TimerThread.run(Timer.java:505)\r\n\r\n\"Service Thread\" #17 daemon prio=9 os_prio=0 tid=0x00007fbf680f0000 nid=0x14c5 runnable [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C1 CompilerThread11\" #16 daemon prio=9 os_prio=0 tid=0x00007fbf680e2800 nid=0x14c4 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C1 CompilerThread10\" #15 daemon prio=9 os_prio=0 tid=0x00007fbf680e0800 nid=0x14c3 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C1 CompilerThread9\" #14 daemon prio=9 os_prio=0 tid=0x00007fbf680de800 nid=0x14c2 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C1 CompilerThread8\" #13 daemon prio=9 os_prio=0 tid=0x00007fbf680dc000 nid=0x14c1 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread7\" #12 daemon prio=9 os_prio=0 tid=0x00007fbf680da000 nid=0x14c0 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread6\" #11 daemon prio=9 os_prio=0 tid=0x00007fbf680d8000 nid=0x14bf waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread5\" #10 daemon prio=9 os_prio=0 tid=0x00007fbf680d5800 nid=0x14be waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread4\" #9 daemon prio=9 os_prio=0 tid=0x00007fbf680cb800 nid=0x14bd waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread3\" #8 daemon prio=9 os_prio=0 tid=0x00007fbf680c7800 nid=0x14bc waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread2\" #7 daemon prio=9 os_prio=0 tid=0x00007fbf680c5000 nid=0x14bb waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread1\" #6 daemon prio=9 os_prio=0 tid=0x00007fbf680c3800 nid=0x14ba waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread0\" #5 daemon prio=9 os_prio=0 tid=0x00007fbf680c0800 nid=0x14b9 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"Signal Dispatcher\" #4 daemon prio=9 os_prio=0 tid=0x00007fbf680be800 nid=0x14b8 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"Finalizer\" #3 daemon prio=8 os_prio=0 tid=0x00007fbf68091000 nid=0x14b7 in Object.wait() [0x00007fb71ab87000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n        at java.lang.Object.wait(Native Method)\r\n        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:142)\r\n        - locked <0x00007fb75903e4c0> (a java.lang.ref.ReferenceQueue$Lock)\r\n        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:158)\r\n        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)\r\n\r\n\"Reference Handler\" #2 daemon prio=10 os_prio=0 tid=0x00007fbf6808f000 nid=0x14b6 in Object.wait() [0x00007fb71ac88000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n        at java.lang.Object.wait(Native Method)\r\n        at java.lang.Object.wait(Object.java:502)\r\n        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)\r\n        - locked <0x00007fb75903ca80> (a java.lang.ref.Reference$Lock)\r\n\r\n\"VM Thread\" os_prio=0 tid=0x00007fbf68088000 nid=0x14b5 runnable\r\n\r\n\"GC task thread#0 (ParallelGC)\" os_prio=0 tid=0x00007fbf68022000 nid=0x14a8 runnable\r\n\r\n\"GC task thread#1 (ParallelGC)\" os_prio=0 tid=0x00007fbf68024000 nid=0x14a9 runnable\r\n\r\n\"GC task thread#2 (ParallelGC)\" os_prio=0 tid=0x00007fbf68025800 nid=0x14aa runnable\r\n\r\n PSYoungGen      total 7560704K, used 5377666K [0x00007fbcae580000, 0x00007fbed2b80000, 0x00007fbf59000000)\r\n  eden space 7536128K, 71% used [0x00007fbcae580000,0x00007fbdf515c328,0x00007fbe7a500000)\r\n  from space 24576K, 99% used [0x00007fbe7a500000,0x00007fbe7bcc4738,0x00007fbe7bd00000)\r\n  to   space 722432K, 0% used [0x00007fbea6a00000,0x00007fbea6a00000,0x00007fbed2b80000)\r\n ParOldGen       total 14394368K, used 3497998K [0x00007fb759000000, 0x00007fbac7900000, 0x00007fbcae580000)\r\n  object space 14394368K, 24% used [0x00007fb759000000,0x00007fb82e803940,0x00007fbac7900000)\r\n Metaspace       used 25642K, capacity 26537K, committed 26880K, reserved 28672K\r\n\r\n^C\r\n2015-01-02 02:16:53:309 INFO  Received signal: SIGINT [OSignalHandler]\r\n```\r\n\r\n\r\n\r\n\r\n\r\nThen starting it up again, it tries to restore from a checkpoint and throws an integer error once:\r\n```\r\n2015-01-02 02:17:43:674 INFO  OrientDB auto-config DISKCACHE=91,777MB (heap=29,127MB os=122,952MB disk=218,129MB) [orientechnologies]\r\n2015-01-02 02:17:43:677 INFO  Loading configuration from: /odbdisk/pumpup/server/libs/orientdb-current/config/orientdb-server-config.xml... [OServerConfigurationLoaderXml]\r\n2015-01-02 02:17:43:844 INFO  OrientDB Server v2.0-SNAPSHOT (build UNKNOWN@r; 2014-12-04 22:29:22-0500) is starting up... [OServer]\r\n2015-01-02 02:17:43:862 INFO  Databases directory: /odbdisk/pumpup/server/libs/orientdb-current/databases [OServer]\r\n2015-01-02 02:17:43:889 INFO  Listening binary connections on 0.0.0.0:2424 (protocol v.28, socket=default) [OServerNetworkListener]\r\n2015-01-02 02:17:43:890 INFO  Listening http connections on 0.0.0.0:2480 (protocol v.10, socket=default) [OServerNetworkListener]\r\n2015-01-02 02:17:43:901 INFO  Installing dynamic plugin 'studio-2.0.zip'... [OServerPluginManager]\r\n2015-01-02 02:17:43:953 INFO  Installing GREMLIN language v.2.6.0 - graph.pool.max=50 [OGraphServerHandler]\r\n2015-01-02 02:17:43:954 INFO  [OVariableParser.resolveVariables] Error on resolving property: distributed [orientechnologies]\r\n2015-01-02 02:17:43:955 INFO  Installing Script interpreter. WARN: authenticated clients can execute any kind of code into the server by using the following allowed languages: [sql] [OServerSideScriptInterpreter]\r\n2015-01-02 02:17:43:956 INFO  OrientDB Server v2.0-SNAPSHOT is active. [OServer]\r\n2015-01-02 02:17:47:603 WARNING segment file 'database.ocf' was not closed correctly last time [OSingleFileSegment]\r\n2015-01-02 02:17:47:936 WARNING Storage pumpup was not closed properly. Will try to restore from write ahead log. [OLocalPaginatedStorage]\r\n2015-01-02 02:17:47:936 INFO  Looking for last checkpoint... [OLocalPaginatedStorage]\r\n2015-01-02 02:17:47:946 INFO  Found FUZZY checkpoint. [OLocalPaginatedStorage]\r\n2015-01-02 02:17:47:947 INFO  Data restore procedure from FUZZY checkpoint is started. [OLocalPaginatedStorage]Exception during storage data restore.\r\njava.lang.IllegalArgumentException: Invalid integer format.\r\n        at com.orientechnologies.orient.core.storage.impl.local.paginated.wal.OPageChanges.deserializeCompressedInteger(OPageChanges.java:180)\r\n        at com.orientechnologies.orient.core.storage.impl.local.paginated.wal.OPageChanges.fromStream(OPageChanges.java:102)\r\n        at com.orientechnologies.orient.core.storage.impl.local.paginated.wal.OUpdatePageRecord.fromStream(OUpdatePageRecord.java:86)\r\n        at com.orientechnologies.orient.core.storage.impl.local.paginated.wal.OWALRecordsFactory.fromStream(OWALRecordsFactory.java:111)\r\n        at com.orientechnologies.orient.core.storage.impl.local.paginated.wal.ODiskWriteAheadLog.read(ODiskWriteAheadLog.java:942)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.restoreFrom(OAbstractPaginatedStorage.java:2330)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.restoreFromFuzzyCheckPoint(OAbstractPaginatedStorage.java:2308)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.restoreFromCheckPoint(OAbstractPaginatedStorage.java:2281)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.restoreFromWAL(OAbstractPaginatedStorage.java:2210)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.restoreIfNeeded(OAbstractPaginatedStorage.java:1558)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.open(OAbstractPaginatedStorage.java:203)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.open(ODatabaseDocumentTx.java:243)\r\n        at com.orientechnologies.orient.server.OServer.openDatabase(OServer.java:611)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.openDatabase(ONetworkProtocolBinary.java:651)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.executeRequest(ONetworkProtocolBinary.java:282)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:216)\r\n```\r\n\r\n\r\n\r\n\r\nThen repetitively throws the lock error whenever I try to access the database via the ETL:\r\n```\r\n2015-01-02 02:20:13:168 WARNING segment file 'database.ocf' was not closed correctly last time [OSingleFileSegment]Sent run-time exception to the client /127.0.0.1:59582: com.orientechnologies.orient.core.exception.OStorageException: Cannot open local storage '/odbdisk/pumpup/server/libs/orientdb-current/databases/pumpup' with mode=rw\r\ncom.orientechnologies.orient.core.exception.OStorageException: Cannot open local storage '/odbdisk/pumpup/server/libs/orientdb-current/databases/pumpup' with mode=rw\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.open(OAbstractPaginatedStorage.java:209)\r\n        at com.orientechnologies.orient.core.db.document.ODatabaseDocumentTx.open(ODatabaseDocumentTx.java:243)\r\n        at com.orientechnologies.orient.server.OServer.openDatabase(OServer.java:611)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.openDatabase(ONetworkProtocolBinary.java:651)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.ONetworkProtocolBinary.executeRequest(ONetworkProtocolBinary.java:282)\r\n        at com.orientechnologies.orient.server.network.protocol.binary.OBinaryNetworkProtocolAbstract.execute(OBinaryNetworkProtocolAbstract.java:216)\r\n        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:65)\r\nCaused by: com.orientechnologies.common.concur.lock.OLockException: File '/odbdisk/pumpup/server/libs/orientdb-current/databases/pumpup/internal.pcl' is locked by another process, maybe the database is in use by another process. Use the remote mode with a OrientDB server to allow multiple access to the same database.\r\n        at com.orientechnologies.orient.core.storage.fs.OAbstractFile.lock(OAbstractFile.java:385)\r\nother process. Use the remote mode with a OrientDB server to allow multiple access to the same database.\r\n        at com.orientechnologies.orient.core.storage.fs.OAbstractFile.lock(OAbstractFile.java:385)\r\n        at com.orientechnologies.orient.core.storage.fs.OAbstractFile.openChannel(OAbstractFile.java:646)\r\n        at com.orientechnologies.orient.core.storage.fs.OAbstractFile.open(OAbstractFile.java:144)\r\n        at com.orientechnologies.orient.core.index.hashindex.local.cache.OWOWCache.openFile(OWOWCache.java:767)\r\n        at com.orientechnologies.orient.core.index.hashindex.local.cache.OWOWCache.openFile(OWOWCache.java:261)\r\n        at com.orientechnologies.orient.core.index.hashindex.local.cache.OReadWriteDiskCache.openFile(OReadWriteDiskCache.java:147)\r\n        at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.open(OPaginatedCluster.java:186)\r\n        at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.open(OAbstractPaginatedStorage.java:181)\r\n        ... 6 more\r\n```"},"comment":{"url":"https://api.github.com/repos/orientechnologies/orientdb/issues/comments/68570940","html_url":"https://github.com/orientechnologies/orientdb/issues/3319#issuecomment-68570940","issue_url":"https://api.github.com/repos/orientechnologies/orientdb/issues/3319","id":68570940,"user":{"login":"garrett-gottlieb","id":1219054,"avatar_url":"https://avatars.githubusercontent.com/u/1219054?v=3","gravatar_id":"","url":"https://api.github.com/users/garrett-gottlieb","html_url":"https://github.com/garrett-gottlieb","followers_url":"https://api.github.com/users/garrett-gottlieb/followers","following_url":"https://api.github.com/users/garrett-gottlieb/following{/other_user}","gists_url":"https://api.github.com/users/garrett-gottlieb/gists{/gist_id}","starred_url":"https://api.github.com/users/garrett-gottlieb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/garrett-gottlieb/subscriptions","organizations_url":"https://api.github.com/users/garrett-gottlieb/orgs","repos_url":"https://api.github.com/users/garrett-gottlieb/repos","events_url":"https://api.github.com/users/garrett-gottlieb/events{/privacy}","received_events_url":"https://api.github.com/users/garrett-gottlieb/received_events","type":"User","site_admin":false},"created_at":"2015-01-02T22:58:11Z","updated_at":"2015-01-02T22:58:11Z","body":"This seems to have fixed itself oddly enough :/ Weird"}}