文档章节

Release Notes - Apache Storm - Version 0.9.2-incub

悟性
 悟性
发布于 2014/12/12 13:12
字数 719
阅读 132
收藏 0
Release Notes - Apache Storm - Version 0.9.2-incubating

Sub-task

  • [STORM-207] - Add storm-starter as a module
  • [STORM-208] - Add storm-kafka as a module
  • [STORM-223] - Safe YAML Parsing
  • [STORM-232] - ship JNI dependencies with the storm jar
  • [STORM-233] - Avoid worker killed on startup because of heavy ZK load
  • [STORM-235] - Registering a null metric should blow up early
  • [STORM-318] - storm-kafka curator.version fix

Bug

  • [STORM-86] - KafkaSpout in storm 0.9.0_rc2 does not work
  • [STORM-113] - TridentUtils.thriftDeserialize() is used unsafely when running in local mode.
  • [STORM-146] - Unit test regression when storm is compiled with 3.4.5 zookeeper
  • [STORM-186] - Milliseconds level tick tuple is broken
  • [STORM-187] - From ZMQ to Netty "java.lang.IllegalArgumentException: timeout value is negative"
  • [STORM-194] - Workers don't launch properly when the topology name has a space in it
  • [STORM-196] - When JVM_OPTS are set, storm jar fails to detect storm.jar from environment
  • [STORM-238] - LICENSE and NOTICE files are duplicated in storm-core jar
  • [STORM-244] - DRPC timeout can return null instead of throwing an exception
  • [STORM-259] - Netty Client IllegalArgumentException reconnecting after 30 retries
  • [STORM-260] - Race condition in backtype.storm.utils.Time
  • [STORM-264] - Remove deprecated topology.optimize config?
  • [STORM-267] - storm.yaml references invalid package for LoggingMetricsConsumer
  • [STORM-269] - Any readable file exposed via UI log viewer
  • [STORM-273] - Error while running storm topologies on Windows using "storm jar"
  • [STORM-275] - Topologies, Spouts and Bolts with special characters in name cannot be viewed in ui
  • [STORM-277] - Kafka-Spout does not support parallelism(unpredictable behaviour)
  • [STORM-280] - storm unit tests are failing on windows
  • [STORM-281] - Leaking fd's when reading config files
  • [STORM-285] - Fix storm-core shade plugin config
  • [STORM-286] - Use URLEncoder#encode with the encoding specified.
  • [STORM-287] - Fix the position of documentation strings
  • [STORM-289] - Trident DRPC memory leak
  • [STORM-290] - Exclude log4j and slf4j-log4j from curator dependency.
  • [STORM-291] - Upgrade http-client dependency to 4.3.3
  • [STORM-294] - Commas not escaped in command line
  • [STORM-295] - Add storm configuration to define JAVA_HOME
  • [STORM-296] - Storm kafka unit tests are failing on windows
  • [STORM-297] - Storm Performance cannot be scaled up by adding more CPU cores
  • [STORM-298] - Logback file does not include full path for metrics appender fileNamePattern
  • [STORM-303] - Forward port of storm-kafka work
  • [STORM-313] - remove log-level-page from logviewer
  • [STORM-326] - task metric send repeatedly
  • [STORM-331] - storm-kafka: bump Kafka version dependency to 0.8.1.1
  • [STORM-335] - Test for cleaning up timed-out DRPC Requests
  • [STORM-338] - Move towards idiomatic Clojure style
  • [STORM-342] - Contention in Disruptor Queue which may cause message loss or out of order
  • [STORM-352] - [storm-kafka] PartitionManager does not save offsets to ZooKeeper
  • [STORM-384] - Storm UI showing incorrect number of workers and executors

Documentation

  • [STORM-317] - Add SECURITY.md to release binaries
  • [STORM-559] - ZkHosts in README should use 2181 as port
  • [STORM-560] - ZkHosts in README should use 2181 as port

Improvement

  • [STORM-12] - Reduce Thread Usage of Netty Transport
  • [STORM-63] - timeout request stay in queue of drpc server
  • [STORM-70] - use zookeeper-3.4.5
  • [STORM-132] - Default Storm scheduler should evenly use resources when managing multiple topologies
  • [STORM-241] - "storm jar" underperforms compared to scp
  • [STORM-252] - Upgrade curator to latest version
  • [STORM-263] - Update Kryo version to 2.21+
  • [STORM-265] - Upgrade Clojure to 1.5 (or 1.6)
  • [STORM-288] - Fix version Spelling in pom.xml
  • [STORM-301] - Fix Indentation for pom.xml in storm-dist
  • [STORM-302] - Fix Indentation for pom.xml in storm-dist
  • [STORM-306] - Document how to securely setup storm
  • [STORM-310] - Change Twitter authentication stream using the new Twitter4J. An optional set of filters can be used to restricted tweets.
  • [STORM-316] - Added registerMetric validation to have timeBucketSizeInSecs >= 1
  • [STORM-325] - storm-kafka: dependencies scope to provided
  • [STORM-484] - Implement topology validation logic in TopologyBuilder

New Feature

  • [STORM-69] - UI Visualizations
  • [STORM-138] - Pluggable serialization for multilang
  • [STORM-173] - use "-c " command to define Number config value will generate ClassCastException
  • [STORM-205] - Add REST API to Storm UI
  • [STORM-245] - Implement localOrShuffle() on Stream for performance
  • [STORM-276] - Add support for logviewer in storm.cmd
  • [STORM-308] - Storm Windows: Add support for config_value to {supervisor,nimbus,ui,drpc,logviewer} childopts
  • [STORM-315] - Added progress bar when submitting topology

Question

  • [STORM-270] - Why ahead-of-time compiled clojure "classes" are not used in storm-core

Task

  • [STORM-247] - Replace links to github resources in storm script
  • [STORM-305] - Create developer documentation

© 著作权归作者所有

共有 人打赏支持
悟性
粉丝 40
博文 27
码字总数 16670
作品 0
西安
技术主管
storm 0.9.2单机性能测试

最近在使用storm做了一下数据处理性能测试。 Topology结构:spout输出80万数据(csv格式);bolt1解析csv,拆分各信息段;bolt2按bolt1中某个字段汇总,累加记数后入库(入库触发频率:60s)...

GoldenRoc
2014/09/23
0
0
apache-storm分布式计算(drpc)开发心得

首先这东西是个拼凑出来的东西,啥zookeeper,nimbus,supervisor,drpc,一个服务不能少。对于我来说一开始不是部署集群还可以,大致步骤是先装zookeeper,这东西运行起来后,你才能跑nimbu...

uaisunshine
2015/03/27
0
2
年薪40万的大数据工程师是如何安装Strom

Strom集群的安装配置 主机规划 一、准备服务器 l 关闭防火墙 chkconfig iptables off && setenforce 0 l 创建用户 groupadd hadoop && useradd hadoop  && usermod -a -G hadoop hadoop l ......

爱尚实训
04/23
0
0
Apache Storm简介及安装部署

Apache Storm是一个分布式的、可靠的、容错的实时数据流处理框架。它与Spark Streaming的最大区别在于它是逐个处理流式数据事件,而Spark Streaming是微批次处理,因此,它比Spark Streaming...

风火数据
07/20
0
0
storm client command

最近在研究实时日志分析,storm确实不错,以下是命令参数: storm help Syntax: storm jar topology-jar-path class 运行jar包中类的主函数和指定的参数 Commands: activate storm activate ...

China_OS
2014/02/22
0
0

没有更多内容

加载失败,请刷新页面

加载更多

下一页

深夜胡思乱想

魔兽世界 最近魔兽世界出了新版本, 周末两天升到了满级,比之前的版本体验好很多,做任务不用抢怪了,不用组队打怪也是共享拾取的。技能简化了很多,哪个亮按哪个。 运维 服务器 产品 之间的...

Firxiao
10分钟前
0
0
MySQL 8 在 Windows 下安装及使用

MySQL 8 带来了全新的体验,比如支持 NoSQL、JSON 等,拥有比 MySQL 5.7 两倍以上的性能提升。本文讲解如何在 Windows 下安装 MySQL 8,以及基本的 MySQL 用法。 下载 下载地址 https://dev....

waylau
43分钟前
0
0
微信第三方平台 access_token is invalid or not latest

微信第三方开发平台code换session_key说的特别容易,但是我一使用就带来无穷无尽的烦恼,搞了一整天也无济于事. 现在记录一下解决问题的过程,方便后来人参考. 我遇到的这个问题搜索了整个网络也...

自由的开源
今天
0
0
openJDK之sun.misc.Unsafe类CAS底层实现

注:这篇文章参考了https://www.cnblogs.com/snowater/p/8303698.html 1.sun.misc.Unsafe中CAS方法 在sun.misc.Unsafe中CAS方法如下: compareAndSwapObject(java.lang.Object arg0, long a......

汉斯-冯-拉特
今天
2
0
设计模式之五 责任链模式(Chain of Responsibility)

一. 场景 相信我们都有过这样的经历; 我们去职能部门办理一个事情,先去了A部门,到了地方被告知这件事情由B部门处理; 当我们到了B部门的时候,又被告知这件事情已经移交给了C部门处理; ...

JackieRiver
今天
1
0

没有更多内容

加载失败,请刷新页面

加载更多

下一页

返回顶部
顶部