This is a forum crawler that only crawls Index, Thread and Page Flipping URLs using some of methods described in IEEE paper (http://ieeexplore.ieee.org/document/6165295/). However it is not the exact same implementation of the paper.
- phpBB
- Discuz
- MyBB
- FluxBB
- Change database server credentials from Crawl_URL.java, Posts_Window.java and Question_Window.java
- Then run below SQL statements in mysql client :
create database crawler; use crawler; create table records(id int,question varchar(5000),answer longblob,answer_url varchar(1000));