• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    公众号

meibenjin/GoogleSearchCrawler: a tool for crawl Google search results

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称(OpenSource Name):

meibenjin/GoogleSearchCrawler

开源软件地址(OpenSource Url):

https://github.com/meibenjin/GoogleSearchCrawler

开源编程语言(OpenSource Language):

Python 100.0%

开源软件介绍(OpenSource Introduction):

Google Search Crawler

This is a simple google search results crawler. Before use this tool, please read these tips below.

Requirements

You may find requirements in requirements.txt which can be installed using pip install -r requirements.txt

More info:

  1. Python

    python should be installed in your computer. here is the official website: http://www.python.org

  2. BeautifulSoup

    A html parser to extract search results from Google. BeautifulSoup(version 4) is better.

    For more information about BeautifuleSoup, please visit: http://www.crummy.com/software/BeautifulSoup/

  3. dotenv (python-dotenv)

How to Use?

  1. Rename or copy .env.example into .env. Apply your own config in this file only.

  2. single key word

    python gsearch.py 'your query key words'

    It will return about 10 extracted results by default. if you need more results, just change the expect_num value.

  3. list of key words

    python gsearch.py

    First create a file named keywords, put your key words list into this file, one key word per line.

If there are any problems or bugs about this tool, please open an issue.




鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap