Skip to content

Commit 1a0671b

Browse files
author
Thomas Weise
committed
Added Hadoop to Software Requirements
1 parent 1050a64 commit 1a0671b

2 files changed

Lines changed: 5 additions & 1 deletion

File tree

README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -120,6 +120,10 @@ In order to build and compile our [examples](http://github.com/thomasWeise/distr
120120

121121
Under Linux, you can install the required files via `sudo apt-get install mpich libmpich-dev`.
122122

123+
### 2.9. Hadoop (also `ssh` and `rsync`)
124+
125+
In order to test our Hadoop examples, we now need to set up a single-node Hadoop cluster. We therefore follow the guide given at [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html](http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html). We need to install pre-requisits such as `ssh` and `rsync`. In the [Hadoop example readme](http://github.com/thomasWeise/distributedComputingExamples/tree/master/hadoop/README.md), we provide the installation guide for Hadoop 2.7.2 Linux / Ubuntu. It boils down to downloading and installing Hadoop from one of the mirrors provided at [http://www.apache.org/dyn/closer.cgi/hadoop/common/](http://www.apache.org/dyn/closer.cgi/hadoop/common/), plus following the guidelines of the linked tutorial.
126+
123127
## 3. Licensing
124128

125129
This work has purely educational purposes. Besides everything mentioned below, for anything in this repository, I impose one additional licensing condition: The code must never be used for anything which might violate the laws of Germany, China, or the USA. This also holds for any other file or resource provided here.

hadoop/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@ Under Linux, you can also simply run `make_linux.sh` in this project's folder to
5454

5555
### 2.4. Setting Up a Single-Node Hadoop Cluster
5656

57-
In order to test our example, we now need to set up a single-node hadoop cluster. We therefore follow the guide given at [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html](http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html). Here we provide the installation guide for Hadoop 2.7.2 Linux / Ubuntu.
57+
In order to test our example, we now need to set up a single-node Hadoop cluster. We therefore follow the guide given at [http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html](http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html). Here we provide the installation guide for Hadoop 2.7.2 Linux / Ubuntu.
5858

5959
#### 2.4.1. Download, Unpacking, and Setup
6060

0 commit comments

Comments
 (0)