{"forkee":{"id":42544561,"name":"Distributed_spider_pku_java","full_name":"liangkai/Distributed_spider_pku_java","owner":{"login":"liangkai","id":2932341,"avatar_url":"https://avatars.githubusercontent.com/u/2932341?v=3","gravatar_id":"","url":"https://api.github.com/users/liangkai","html_url":"https://github.com/liangkai","followers_url":"https://api.github.com/users/liangkai/followers","following_url":"https://api.github.com/users/liangkai/following{/other_user}","gists_url":"https://api.github.com/users/liangkai/gists{/gist_id}","starred_url":"https://api.github.com/users/liangkai/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liangkai/subscriptions","organizations_url":"https://api.github.com/users/liangkai/orgs","repos_url":"https://api.github.com/users/liangkai/repos","events_url":"https://api.github.com/users/liangkai/events{/privacy}","received_events_url":"https://api.github.com/users/liangkai/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/liangkai/Distributed_spider_pku_java","description":"1. 主要分为三个模块，一个爬虫抓取模块，一个是数据处理模块，一个是用户模块。 2. 爬虫抓取模块主要是从直播吧、新浪体育、网易体育上爬取有关足球的新闻和用户关于足球的评论，利用集群HADOOP抓取网页，分析得出URL集，提取特征URL 3. 网页linux脚本过滤得到原始网页，然后二次过滤得到文本，并使用分布式储存。 4. 处理模块主要是根据训练集规则一和规则二，得到分词器，然后对文本进行操作，得出训练结果。 5. 通过特征脚本得到训练结果的特征词分类，然后提取出球队模糊集和球星模糊集。 6. 过滤得到球队精确集和球星精确集，并存入MYSQL数据库。 7. 从数据库中提取球星和球队的信息进行图表分析，并动态显示WIKI信息，调入显示模块中和用户进行交换 ","fork":true,"url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java","forks_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/forks","keys_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/keys{/key_id}","collaborators_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/teams","hooks_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/hooks","issue_events_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/issues/events{/number}","events_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/events","assignees_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/assignees{/user}","branches_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/branches{/branch}","tags_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/tags","blobs_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/git/refs{/sha}","trees_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/git/trees{/sha}","statuses_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/statuses/{sha}","languages_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/languages","stargazers_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/stargazers","contributors_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/contributors","subscribers_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/subscribers","subscription_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/subscription","commits_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/commits{/sha}","git_commits_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/git/commits{/sha}","comments_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/comments{/number}","issue_comment_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/issues/comments{/number}","contents_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/contents/{+path}","compare_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/compare/{base}...{head}","merges_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/merges","archive_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/downloads","issues_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/issues{/number}","pulls_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/pulls{/number}","milestones_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/milestones{/number}","notifications_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/labels{/name}","releases_url":"https://api.github.com/repos/liangkai/Distributed_spider_pku_java/releases{/id}","created_at":"2015-09-15T20:25:23Z","updated_at":"2015-09-15T20:25:24Z","pushed_at":"2015-01-05T16:28:28Z","git_url":"git://github.com/liangkai/Distributed_spider_pku_java.git","ssh_url":"git@github.com:liangkai/Distributed_spider_pku_java.git","clone_url":"https://github.com/liangkai/Distributed_spider_pku_java.git","svn_url":"https://github.com/liangkai/Distributed_spider_pku_java","homepage":null,"size":29503,"stargazers_count":0,"watchers_count":0,"language":"Java","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master","public":true}}