开源软件名称(OpenSource Name):meibenjin/GoogleSearchCrawler
开源软件地址(OpenSource Url):https://github.com/meibenjin/GoogleSearchCrawler
开源编程语言(OpenSource Language):
Python
100.0%
开源软件介绍(OpenSource Introduction):Google Search Crawler
This is a simple google search results crawler. Before use this tool, please read these tips below.
Requirements
You may find requirements in requirements.txt which can be installed using pip install -r requirements.txt
More info:
-
Python
python should be installed in your computer. here is the official website: http://www.python.org
-
BeautifulSoup
A html parser to extract search results from Google. BeautifulSoup(version 4) is better.
For more information about BeautifuleSoup, please visit: http://www.crummy.com/software/BeautifulSoup/
-
dotenv (python-dotenv)
How to Use?
-
Rename or copy .env.example into .env . Apply your own config in this file only.
-
single key word
python gsearch.py 'your query key words'
It will return about 10 extracted results by default. if you need more results, just change the expect_num value.
-
list of key words
python gsearch.py
First create a file named keywords, put your key words list into this file, one key word per line.
If there are any problems or bugs about this tool, please open an issue.
|
请发表评论