Yi's Notes

⟨Data Scientist|Photographer⟩

0%

RasPi Cluster (1): Cluster Design

Motivation

Having working on a Raspberry Pi B+ version, I have found that the real limitation is the memory shortage and CPU performance.

With the release of new Raspberry Pi 2, the little board is equipped with ARM-v7 (ARM Cortex-A7) 900MHz (Quad-core), and 1GB memory (shared with GPU), here is documented specification. By purchasing an MicroSD-HC UHS-I card, we can get a 40MB/s reading speed and around 15-20MB/s writing speed. That is very close to at least a low-end computer.

Therefore, it is possible to create somehow a 3 nodes cluster with low cost (around 200€). The real motivation is to learn how a cluster works and to do some PoC (Proof of Concept) thing.

Shopping list

Next step is to find out what we need to build the cluster:

Here is the shopping list:

  • 3 × Raspberry Pi 2
  • 3 × MicroSD 16GB
  • 1 × Ethernet Switch / Router
  • 3 × USB to Micro USB cable
  • 1 × Power Supply
  • 1 × Stackable Raspberry Pi Case

Arrival of Raspberry Pi B second generation:

Arrival of MicroSD 16GB Toshiba:

Assembling

The steps are really simple with the instruction from this post.

Next Step

Burn OS image in Micro SD card, install cluster manager (Mesos/Yarn/…), distributed computing framework (Spark, R, Python, H2O)