@Kingwulf The first thing we did in hopsfs was replace zk in hdfs with a distributed shared memory solution. It took a couple of students about 12 months to get right (with help on algorithms). Every engineer wants to write their own version of paxos. htt
2,392 followers
145 followers
RT @jim_dowling: @gwenshap HopsFS is a next gen HDFS and one of the first things we did was to remove zookeeper (still used by HDFS for HA)…
3,770 followers
RT @jim_dowling: @gwenshap HopsFS is a next gen HDFS and one of the first things we did was to remove zookeeper (still used by HDFS for HA)…
2,392 followers
@gwenshap HopsFS is a next gen HDFS and one of the first things we did was to remove zookeeper (still used by HDFS for HA). We use hopsfs' Metadata layer as shared memory for leader election of namenodes https://t.co/t3unVCRcjU