File tree Expand file tree Collapse file tree 1 file changed +43
-0
lines changed Expand file tree Collapse file tree 1 file changed +43
-0
lines changed Original file line number Diff line number Diff line change
1
+ # free-http-proxy
2
+
3
+ > 一些免费的** 高匿名** HTTP代理采集加验证爬虫,采用` bottle ` 做web interface输出代理,供其他爬虫调用。
4
+
5
+
6
+ ## Run on CentOS 7
7
+
8
+ 1.Install packages
9
+ ``` bash
10
+ pip install -r requirements.txt
11
+ ```
12
+
13
+ 2.Install mysql
14
+ ``` bash
15
+ rpm -Uvh http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm
16
+ yum install -y mysql-community-server
17
+ systemctl enable mysqld
18
+ systemctl start mysqld
19
+ ```
20
+
21
+ 3.Init scheme
22
+ ``` bash
23
+ echo -n " Enter new mysql root password and press [ENTER]: "
24
+ read -s newpass
25
+ oldpass=` grep ' temporary password' /var/log/mysqld.log | awk ' {print $NF}' `
26
+ mysql -u root -p ${oldpass} << EOF
27
+ ALTER USER 'root'@'localhost' IDENTIFIED BY '$newpass ';
28
+ EOF
29
+ mysql -u root -p < db.sql
30
+ ```
31
+
32
+ 4.Web Interface
33
+ ``` bash
34
+ nohup python app.py > /dev/null 2>&1 &
35
+ ```
36
+
37
+ 5.crawling service
38
+ ``` bash
39
+ nohup python service.py fetch > /dev/null 2>&1 &
40
+ nohup python service.py check > /dev/null 2>&1 &
41
+ ```
42
+
43
+ For detailed explanation on how things work, checkout the [ code] ( https://github.com/yoker/free-http-proxy.git )
You can’t perform that action at this time.
0 commit comments