{"action":"created","issue":{"url":"https://api.github.com/repos/nilmtk/nilmtk/issues/201","labels_url":"https://api.github.com/repos/nilmtk/nilmtk/issues/201/labels{/name}","comments_url":"https://api.github.com/repos/nilmtk/nilmtk/issues/201/comments","events_url":"https://api.github.com/repos/nilmtk/nilmtk/issues/201/events","html_url":"https://github.com/nilmtk/nilmtk/issues/201","id":48684964,"number":201,"title":"New summary statistics ","user":{"login":"JackKelly","id":460756,"avatar_url":"https://avatars.githubusercontent.com/u/460756?v=3","gravatar_id":"","url":"https://api.github.com/users/JackKelly","html_url":"https://github.com/JackKelly","followers_url":"https://api.github.com/users/JackKelly/followers","following_url":"https://api.github.com/users/JackKelly/following{/other_user}","gists_url":"https://api.github.com/users/JackKelly/gists{/gist_id}","starred_url":"https://api.github.com/users/JackKelly/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JackKelly/subscriptions","organizations_url":"https://api.github.com/users/JackKelly/orgs","repos_url":"https://api.github.com/users/JackKelly/repos","events_url":"https://api.github.com/users/JackKelly/events{/privacy}","received_events_url":"https://api.github.com/users/JackKelly/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/nilmtk/nilmtk/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/nilmtk/nilmtk/labels/Statistics+and+correlations","name":"Statistics and correlations","color":"006b75"}],"state":"open","locked":false,"assignee":{"login":"JackKelly","id":460756,"avatar_url":"https://avatars.githubusercontent.com/u/460756?v=3","gravatar_id":"","url":"https://api.github.com/users/JackKelly","html_url":"https://github.com/JackKelly","followers_url":"https://api.github.com/users/JackKelly/followers","following_url":"https://api.github.com/users/JackKelly/following{/other_user}","gists_url":"https://api.github.com/users/JackKelly/gists{/gist_id}","starred_url":"https://api.github.com/users/JackKelly/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JackKelly/subscriptions","organizations_url":"https://api.github.com/users/JackKelly/orgs","repos_url":"https://api.github.com/users/JackKelly/repos","events_url":"https://api.github.com/users/JackKelly/events{/privacy}","received_events_url":"https://api.github.com/users/JackKelly/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/nilmtk/nilmtk/milestones/4","labels_url":"https://api.github.com/repos/nilmtk/nilmtk/milestones/4/labels","id":862184,"number":4,"title":"v1.0","description":"","creator":{"login":"nipunreddevil","id":60985,"avatar_url":"https://avatars.githubusercontent.com/u/60985?v=3","gravatar_id":"","url":"https://api.github.com/users/nipunreddevil","html_url":"https://github.com/nipunreddevil","followers_url":"https://api.github.com/users/nipunreddevil/followers","following_url":"https://api.github.com/users/nipunreddevil/following{/other_user}","gists_url":"https://api.github.com/users/nipunreddevil/gists{/gist_id}","starred_url":"https://api.github.com/users/nipunreddevil/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nipunreddevil/subscriptions","organizations_url":"https://api.github.com/users/nipunreddevil/orgs","repos_url":"https://api.github.com/users/nipunreddevil/repos","events_url":"https://api.github.com/users/nipunreddevil/events{/privacy}","received_events_url":"https://api.github.com/users/nipunreddevil/received_events","type":"User","site_admin":false},"open_issues":26,"closed_issues":2,"state":"open","created_at":"2014-11-11T18:10:40Z","updated_at":"2014-12-11T18:45:11Z","due_on":"2015-05-31T23:00:00Z","closed_at":null},"comments":10,"created_at":"2014-11-13T20:02:00Z","updated_at":"2015-01-10T09:24:30Z","closed_at":null,"body":"I'm working on a new version of my [UK-DALE dataset paper](http://arxiv.org/abs/1404.0284) and I want to include a bunch of new tables and figures which summarise the dataset.  I figure I might as well try to make the code to generate these figures into general-purpose functions in NILMTK.\r\n\r\n### Summary stats for entire dataset\r\n\r\n- [x] Dataset summary table (returned as DataFrame).  Each column is a building.  Print out `store.window`.  Rows:\r\n  - [x] building number\r\n  - [x] information from metadata:\r\n    - [x] building type (flat / detached / factory / office / etc)\r\n    - [x] ownership\r\n    - [x] number of occupants \r\n    - [x] description of occupants (number of kids, adults, pensioners etc) socio-demographics\r\n    - [x] elec or gas heated?\r\n    - [x] construction year\r\n    - [x] energy improvements\r\n  - [x] number of sub meters\r\n  - [x] `correlation(sum(submeters), mains)` (after resampling to minutely data)\r\n  - [x] mains sample rate\r\n  - [x] submeter sample rate\r\n  - [x] time span\r\n  - [x] uptime\r\n  - [ ] filesize on disk\r\n  - [x] proportion of energy submetered\r\n  - [x] min, mean, max dropout rates\r\n  - [x] min, mean, max aggregate energy consumption per day (kWh)\r\n\r\n\r\n- [x] Stacked bars showing breakdown of energy used by top-k appliances (similar to the Figure 5 in [our NILMTK e-Energy paper](http://arxiv.org/abs/1404.3878)).  Produce a single figure with a stacked bar for each building in the dataset. Use consistent mapping of colours to appliance types.  Group appliances by type (e.g. if there are 2 fridges then group them).  Put all lights into a single category.\r\n\r\n- [x] Histograms of aggregate power demand per building.\r\n\r\n- [x] Global plot of time periods when each house has valid recordings for the mains data.  Very similar to this plot from [Oli's blog](http://blog.oliverparson.co.uk/2011/12/redd-statistics.html): ![](http://1.bp.blogspot.com/-6dmFKa2axCw/TtepWaExVtI/AAAAAAAACTA/Cqbh7aFD-DA/s1600/uptime.png).  Show all channels.  Use common x-axis (time).\r\n\r\n\r\n### Summary stats for a single `MeterGroup`\r\n\r\n- [x] Appliance usage (hour of day or day of week) histograms of multiple appliances.  User can select which appliances to show. Default is to show all.\r\n\r\n- [x] Histograms of appliance power demand.  User can select which appliances, default is to show all.  User can select grid layout.  User can select whether to include histogram of aggregate power usage.\r\n\r\n- [x] Stacked area chart of all meters.  (Should be an option of `MeterGroup.plot()`)\r\n\r\n\r\n### For a single `ElecMeter`\r\n\r\n- [x] Plot example 'activation'.  Use `on_power_threshold` and `min_on_duration` to select activation.\r\n\r\n\r\n\r\nAny comments?!"},"comment":{"url":"https://api.github.com/repos/nilmtk/nilmtk/issues/comments/69449674","html_url":"https://github.com/nilmtk/nilmtk/issues/201#issuecomment-69449674","issue_url":"https://api.github.com/repos/nilmtk/nilmtk/issues/201","id":69449674,"user":{"login":"JackKelly","id":460756,"avatar_url":"https://avatars.githubusercontent.com/u/460756?v=3","gravatar_id":"","url":"https://api.github.com/users/JackKelly","html_url":"https://github.com/JackKelly","followers_url":"https://api.github.com/users/JackKelly/followers","following_url":"https://api.github.com/users/JackKelly/following{/other_user}","gists_url":"https://api.github.com/users/JackKelly/gists{/gist_id}","starred_url":"https://api.github.com/users/JackKelly/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JackKelly/subscriptions","organizations_url":"https://api.github.com/users/JackKelly/orgs","repos_url":"https://api.github.com/users/JackKelly/repos","events_url":"https://api.github.com/users/JackKelly/events{/privacy}","received_events_url":"https://api.github.com/users/JackKelly/received_events","type":"User","site_admin":false},"created_at":"2015-01-10T09:24:30Z","updated_at":"2015-01-10T09:24:30Z","body":"pretty much all of these plots are now implemented.  Example plots are in my [new revision of my UK-DALE paper](http://jack-kelly.com/updated_version_of_our_ukdale_dataset_paper) and the scripts to create those plots are in my [ukdale_plots repository](https://github.com/JackKelly/ukdale_plots).\r\n\r\nI'll leave this issue open for now because, if I get time, it would be good to copy over some of the code from ukdale_plots into NILMTK for prettifying plots.  And I also need to copy over some of the code for `MeterGroup.plot(kind='energy bar')`"}}