{"action":"opened","issue":{"url":"https://api.github.com/repos/stellar/stellar-core/issues/717","labels_url":"https://api.github.com/repos/stellar/stellar-core/issues/717/labels{/name}","comments_url":"https://api.github.com/repos/stellar/stellar-core/issues/717/comments","events_url":"https://api.github.com/repos/stellar/stellar-core/issues/717/events","html_url":"https://github.com/stellar/stellar-core/issues/717","id":103154436,"number":717,"title":"sqlite wal file takes too much space","user":{"login":"codeck","id":1709667,"avatar_url":"https://avatars.githubusercontent.com/u/1709667?v=3","gravatar_id":"","url":"https://api.github.com/users/codeck","html_url":"https://github.com/codeck","followers_url":"https://api.github.com/users/codeck/followers","following_url":"https://api.github.com/users/codeck/following{/other_user}","gists_url":"https://api.github.com/users/codeck/gists{/gist_id}","starred_url":"https://api.github.com/users/codeck/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/codeck/subscriptions","organizations_url":"https://api.github.com/users/codeck/orgs","repos_url":"https://api.github.com/users/codeck/repos","events_url":"https://api.github.com/users/codeck/events{/privacy}","received_events_url":"https://api.github.com/users/codeck/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-08-26T02:08:56Z","updated_at":"2015-08-26T02:08:56Z","closed_at":null,"body":"the .db-wal file grows too much while replaying in \"Catchup\" state.\r\nmy measurement, .db-wal file cost 10k+/ledger meanwhile .db file cost about 1k/ledger.\r\nso in current testnet (about 400k ledgers), a fresh node will need 4GB+ for WAL for a complete catchup.\r\nIt's not clear whether the WAL file size is bounded.\r\n\r\nsimilar issues in other project:\r\nhttps://github.com/couchbaselabs/TouchDB-iOS/issues/189\r\nhttps://wiki.mozilla.org/Performance/Avoid_SQLite_In_Your_Next_Firefox_Feature#Storage_Footprint\r\n\r\nmy config file:\r\n```\r\nPEER_PORT= 39133\r\nRUN_STANDALONE=false\r\nLOG_FILE_PATH=\"log/stellar-core.log\"\r\nHTTP_PORT=39132\r\nPUBLIC_HTTP_PORT=false\r\nCATCHUP_COMPLETE=true\r\nUNSAFE_QUORUM=true\r\nFAILURE_SAFETY=0\r\nTARGET_PEER_CONNECTIONS=20\r\nMAX_PEER_CONNECTIONS=30\r\nPREFERRED_PEERS=[\r\n  \"core-testnet1.stellar.org\",\r\n  \"core-testnet2.stellar.org\",\r\n  \"core-testnet3.stellar.org\"\r\n]\r\nKNOWN_PEERS=[]\r\nDATABASE=\"sqlite3:///stellar.db\"\r\n[QUORUM_SET]\r\nVALIDATORS=[\r\n\"GDKXE2OZMJIPOSLNA6N6F2BVCI3O777I2OOC4BV7VOYUEHYX7RTRYA7Y\",\r\n\"GCUCJTIYXSOXKBSNFGNFWW5MUQ54HKRPGJUTQFJ5RQXZXNOLNXYDHRAP\",\r\n\"GC2V2EFSXN6SQTWVYA5EPJPBWWIMSD2XQNKUOHGEKB535AQE2I6IXV2Z\"]\r\n\r\n[HISTORY.local]\r\nget=\"cp history/{0} {1}\"\r\nput=\"cp {0} history/{1}\"\r\nmkdir=\"mkdir -p history/{0}\"\r\n[HISTORY.core_testnet1]\r\nget=\"curl -sf https://s3-eu-west-1.amazonaws.com/history.stellar.org/prd/core-testnet/core-testnet-001/{0} -o {1}\"\r\n[HISTORY.core_testnet2]\r\nget=\"curl -sf https://s3-eu-west-1.amazonaws.com/history.stellar.org/prd/core-testnet/core-testnet-002/{0} -o {1}\"\r\n[HISTORY.core_testnet3]\r\nget=\"curl -sf https://s3-eu-west-1.amazonaws.com/history.stellar.org/prd/core-testnet/core-testnet-003/{0} -o {1}\"\r\n```"}}