文档章节

论文阅读 - Optimizing Graph Algorithms on Pregel-like

wdfnst
 wdfnst
发布于 2016/05/15 08:55
字数 245
阅读 4
收藏 0
  • Highlight, page 1
    Standard graph algorithms in this setting can incur unnecessary in- efficiencies such as slow convergence or high communication or computation cost

  • Highlight, page 1
    Standard graph algorithms in this setting can incur unnecessary in- efficiencies such as slow convergence or high communication or computation cost

  • Highlight, page 1
    large diameters or skew in component sizes.

  • Highlight, page 1
    performing some serial computation on a tiny fraction of the in- put graph

  • Underline, page 1
    complementing

  • Highlight, page 1
    our open-source Pregel implementation

  • Highlight, page 2
    FCS monitors the size of the “active” graph on which the computation is executing. If the active graph becomes small enough, FCS sends it to the master, which performs the end of the computation serially inside master.compute(), then sends the results back to the workers.

  • Highlight, page 2
    sets of vertices (called subvertices) are merged to form supervertices.

  • Highlight, page 6
    FCS monitors the size the active- subgraph. Once the size of the active-subgraph is below a threshold (5M edges by default), it sends the active-subgraph to the mas- ter, which performs the rest of the computation serially, and sends the results back to the workers.

  • Highlight, page 8
    Our SEAS optimiza- tion instead stores the edges of a supervertex s in a distributed fash- ion among all of its subvertices.

  • Highlight, page 8
    In our implementation of SEAS, subvertices store a pointer to their latest supervertices.

© 著作权归作者所有

共有 人打赏支持
wdfnst
粉丝 2
博文 27
码字总数 22859
作品 1
宁波
私信 提问
Spark GraphX Pregel API: An Example

GraphX Pregel API Graph data and graph processing is getting more and more attention lately in various fields. It has become apparent that a large number of real world problems ......

openthings
2016/09/02
98
1
Spark GraphX 编程指南

GraphX编程指南 (根据原文编辑:http://udn.yyuap.com/doc/spark-programming-guide-zh-cn/graphx-programming-guide/index.html) GraphX是一个新的(alpha)Spark API,它用于图和并行图(gr......

openthings
2016/08/29
50
0
GraphX Programming Guide

GraphX Overview GraphX is a new component in Spark for graphs and graph-parallel computation. At a high level, GraphX extends the Spark RDD by introducing a new Graph abstractio......

openthings
2016/08/29
10
0
100 open source Big Data architecture papers

Big Data technology has been extremely disruptive with open source playing a dominant role in shaping its evolution. While on one hand it has been disruptive, on the other it ha......

naughty
2016/04/05
55
0
Pregel:基于图分割的图结构数据并行处理

Pregel设计在google的计算机集群结构之上。一个计算机集群(cluster)就是通用PC按rack(一组PC机)构成,Rack之间具有较高的数据传输速度。集群中通常包含一个域名服务器(namenode),采用...

jhonephone
2014/01/17
0
0

没有更多内容

加载失败,请刷新页面

加载更多

数据库篇多表操作

第1章 多表操作 实际开发中,一个项目通常需要很多张表才能完成。例如:一个商城项目就需要分类表(category)、商品表(products)、订单表(orders)等多张表。且这些表的数据之间存在一定的关系...

stars永恒
40分钟前
2
0
nginx日志自动切割

1.日志配置(Nginx 日志) access.log----记录哪些用户,哪些页面以及用户浏览器,IP等访问信息;error.log------记录服务器错误的日志 #配置日志存储路径:location / {      a...

em_aaron
昨天
3
0
java 反射

基本概念 RTTI,即Run-Time Type Identification,运行时类型识别。RTTI能在运行时就能够自动识别每个编译时已知的类型。   要想理解反射的原理,首先要了解什么是类型信息。Java让我们在运...

细节探索者
昨天
1
0
推荐转载连接

https://www.cnblogs.com/ysocean/p/7409779.html#_label0

小橙子的曼曼
昨天
3
0
雷军亲自打造的套餐了解下:用多少付多少

12月28日消息,小米科技创始人兼CEO雷军微博表示,小米移动任我行套餐方案,原则上就是明明白白消费,用多少付多少,不用不花钱!上网、电话和短信都是一毛钱,上网0.1元/M,电话0.1元/分钟,...

linuxCool
昨天
6
0

没有更多内容

加载失败,请刷新页面

加载更多

返回顶部
顶部