WPI Graduate Course: DS503 - Big Data Management
In this project, I wrote map-reduce jobs in Java language and Apache Pig scripts, then ran them on the Hadoop system.
I performed four activities in this project:
- Created datasets
- Uploaded the datasets into Hadoop HDFS
- Queried the data by writing map-reduce Java code
- Queried the data using Pig scripts
For more details on the project implementation, please see the Readme.pdf