{"action":"created","issue":{"url":"https://api.github.com/repos/owncloud/core/issues/17145","labels_url":"https://api.github.com/repos/owncloud/core/issues/17145/labels{/name}","comments_url":"https://api.github.com/repos/owncloud/core/issues/17145/comments","events_url":"https://api.github.com/repos/owncloud/core/issues/17145/events","html_url":"https://github.com/owncloud/core/issues/17145","id":90706728,"number":17145,"title":"Swift Backend Mapping URN:OID to original file names","user":{"login":"razyr","id":8116645,"avatar_url":"https://avatars.githubusercontent.com/u/8116645?v=3","gravatar_id":"","url":"https://api.github.com/users/razyr","html_url":"https://github.com/razyr","followers_url":"https://api.github.com/users/razyr/followers","following_url":"https://api.github.com/users/razyr/following{/other_user}","gists_url":"https://api.github.com/users/razyr/gists{/gist_id}","starred_url":"https://api.github.com/users/razyr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/razyr/subscriptions","organizations_url":"https://api.github.com/users/razyr/orgs","repos_url":"https://api.github.com/users/razyr/repos","events_url":"https://api.github.com/users/razyr/events{/privacy}","received_events_url":"https://api.github.com/users/razyr/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/owncloud/core/labels/app:objectstore","name":"app:objectstore","color":"02d7e1"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-06-24T15:19:27Z","updated_at":"2015-06-24T15:42:23Z","closed_at":null,"body":"OwnCloud 8.0.4 with Swift object storage on the back end.\r\n\r\nWe had a hiccup on Friday with our upstream provider's Swift environment.  Since then OwnCloud is spitting several thousand errors similar to the following\r\n\r\n`ownCloud[8165]: {objectstore} Could not get object: urn:oid:10641 could not be found.`\r\n\r\nI've done a \"swift list\" on the container and dumped the output to a text file.   I can confirm that all of the urn:oid:xxxx errors are consistent in that there are no such files.\r\n\r\nWe have just over 5,000 files in Swift, which I believe would be consistent with the number of files our customer is storing on their OwnCloud server.\r\n\r\nWe also have 2,000+ errors showing mismatched/missing URNs.\r\n\r\nWhere does the mapping live between the URN and original file/path name?  I've looked in the OwnCloud database, but if it's there, it's well disguised.   I thought oc_file_map might be an obvious place, but that table is empty.\r\n\r\nIs there any way to check the consistency and/or repair this data? "},"comment":{"url":"https://api.github.com/repos/owncloud/core/issues/comments/114917310","html_url":"https://github.com/owncloud/core/issues/17145#issuecomment-114917310","issue_url":"https://api.github.com/repos/owncloud/core/issues/17145","id":114917310,"user":{"login":"butonic","id":956847,"avatar_url":"https://avatars.githubusercontent.com/u/956847?v=3","gravatar_id":"","url":"https://api.github.com/users/butonic","html_url":"https://github.com/butonic","followers_url":"https://api.github.com/users/butonic/followers","following_url":"https://api.github.com/users/butonic/following{/other_user}","gists_url":"https://api.github.com/users/butonic/gists{/gist_id}","starred_url":"https://api.github.com/users/butonic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/butonic/subscriptions","organizations_url":"https://api.github.com/users/butonic/orgs","repos_url":"https://api.github.com/users/butonic/repos","events_url":"https://api.github.com/users/butonic/events{/privacy}","received_events_url":"https://api.github.com/users/butonic/received_events","type":"User","site_admin":false},"created_at":"2015-06-24T15:42:23Z","updated_at":"2015-06-24T15:42:23Z","body":"the [URN](https://de.wikipedia.org/wiki/Uniform_Resource_Name) consists of `urn:<NID>:<NID specific part>`, eg. `urn:isbn:3827370191` In this case the namespace is the object id or `oid`. Since we are talking about file objects the NID specific part is the fileid, eg `urn:oid:10641`.\r\n\r\nAll entries in the filecache table should have a matching object in the objectstore: fileid column in filecache -> oid in `urn:oid:<oid>`.\r\n\r\nThe reason is that with this no trip to the objectstore is necessary for stat, rename and move operations.\r\n\r\nIt seems that your provider either lost some objects or the connection is only working sporadically. Currently, there is no automatic check that removes entries from the filecache that are no longer in the objectstore.\r\n\r\nDoes that clear it up?"}}