A Simple Explanation of Paxos, from 2PC
The explanation is from Vineet Gupta on Quora. Read Vineet Gupta's answer to What is a simple explanation of the …
Tag: framework
March 2015
PageRank using Pregel API or GraphX
GraphX provides PageRank API for users to calculate the PageRank of a graph conveniently. The API is defined in [[lib/PageRank.scala]]. …
Pregel and Shortest Path Algorithm in GraphX
If you pay enough attention to Graph.scala, you may find cache function. It can cache the graph at specific storage …
Graph Operators in GraphX – Part 2
Besides the operations mentioned in Part One, GraphX also defines a special data structure for node degree in GraphOps.scala, stored …
Graph Operators in GraphX – Part 1
GraphX defines several operators which can process graph information. As introduced before, some operators are defined in Graph.scala, such as …
Partition Strategy in GraphX
To process the graph in a distributed style, the graph needs to be represented in a distributed scheme. Normally, there …
December 2014
Review of Yarn: Hadoop MapReduce v2
Apache Hadoop has released version 2.6.0, which splits the job scheduler and resource management in old versions. The structure in …