{"action":"opened","issue":{"url":"https://api.github.com/repos/nupic-community/nupic.visualizations/issues/43","labels_url":"https://api.github.com/repos/nupic-community/nupic.visualizations/issues/43/labels{/name}","comments_url":"https://api.github.com/repos/nupic-community/nupic.visualizations/issues/43/comments","events_url":"https://api.github.com/repos/nupic-community/nupic.visualizations/issues/43/events","html_url":"https://github.com/nupic-community/nupic.visualizations/issues/43","id":121695689,"number":43,"title":"Preprocess/Compress when too much data, so the presentation is clear","user":{"login":"breznak","id":2166111,"avatar_url":"https://avatars.githubusercontent.com/u/2166111?v=3","gravatar_id":"","url":"https://api.github.com/users/breznak","html_url":"https://github.com/breznak","followers_url":"https://api.github.com/users/breznak/followers","following_url":"https://api.github.com/users/breznak/following{/other_user}","gists_url":"https://api.github.com/users/breznak/gists{/gist_id}","starred_url":"https://api.github.com/users/breznak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/breznak/subscriptions","organizations_url":"https://api.github.com/users/breznak/orgs","repos_url":"https://api.github.com/users/breznak/repos","events_url":"https://api.github.com/users/breznak/events{/privacy}","received_events_url":"https://api.github.com/users/breznak/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/nupic-community/nupic.visualizations/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/nupic-community/nupic.visualizations/labels/UI/UX","name":"UI/UX","color":"eb6420"},{"url":"https://api.github.com/repos/nupic-community/nupic.visualizations/labels/user","name":"user","color":"207de5"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-12-11T11:59:12Z","updated_at":"2015-12-11T11:59:12Z","closed_at":null,"body":"Another user feedback, when plotting too much data (eg 100k+), the graph becomes polluted, the points are too close together and we don't see any differences. \r\n\r\nAn example is when rendering the `examples/CSV/sine_huge_100k.csv`, the `sine` looks like a green horizontal stripe. \r\n\r\nMy proposal:\r\n- [ ] set a max number of (logical) points that should be rendered on a graph (`resolution=10k`)\r\n- [ ] if the number of actual data points (eg. `size=100k`) is bigger, \r\n - [ ] compute reduction ratio (`resolution/size`)\r\n - [ ] subsample (choose every nth, average, ...?) the data\r\n - [ ] plot the subsampled graph\r\n\r\nWhat are the statistics/preprocessing frameworks for JS? Do you have any favourites? \r\n* I just learned about vega (preprocessing & presentation)\r\n - it could look like this: http://vega.github.io/vega-editor/index.html?mode=vega&spec=bar \r\n\r\nWhat do you think? "}}