RESEARCH: Building a Super Computer using Cluster of Computers
What is a Super Computer? Is it like a Quantum Computer that solves mathematical problem magically fast? Can we build a Super Computer using bunch of cheap low power computers like Raspberry Pi?
What is a Cluster?
People try to solve very complex problem using computers. The problem may be trying to model millions of water molecules to simulate natural movements of waves, or serve dynamic webpage that is tailored to millions of individual users.
Traditional computers (aka von Neumann architecture) tries to solve this using “Vertical Scaling” which uses ever faster CPU and lots of RAM. Old Super Computer leveraged this type of model costing millions of dollars.
Another approach is using “Horizontal Scaling” which splits up the task and use multiple computers to solve the smaller problems in parallel. Depending on the problem, Horizontal Scaling is more practical and economical solution.
The Horizontal Scaling introduces a unique problem. As the individual computers (aka Nodes) grows in numbers, management of the hardwares and conducting simples tasks like rebooting each computers requires complex coordination.
STATUS:
This page is being used for me to jot down the research questions and findings as I continue with my learning related to super computing and cluster computing. As such, the content of this posting will change over time as I discover new things and change my mind about different things (or more likely, correct myself as I knowledge and thinking matures).
