文档章节

Release Notes - Apache Storm - Version 0.9.2-incub

悟性
 悟性
发布于 2014/12/12 13:12
字数 719
阅读 133
收藏 0
Release Notes - Apache Storm - Version 0.9.2-incubating

Sub-task

  • [STORM-207] - Add storm-starter as a module
  • [STORM-208] - Add storm-kafka as a module
  • [STORM-223] - Safe YAML Parsing
  • [STORM-232] - ship JNI dependencies with the storm jar
  • [STORM-233] - Avoid worker killed on startup because of heavy ZK load
  • [STORM-235] - Registering a null metric should blow up early
  • [STORM-318] - storm-kafka curator.version fix

Bug

  • [STORM-86] - KafkaSpout in storm 0.9.0_rc2 does not work
  • [STORM-113] - TridentUtils.thriftDeserialize() is used unsafely when running in local mode.
  • [STORM-146] - Unit test regression when storm is compiled with 3.4.5 zookeeper
  • [STORM-186] - Milliseconds level tick tuple is broken
  • [STORM-187] - From ZMQ to Netty "java.lang.IllegalArgumentException: timeout value is negative"
  • [STORM-194] - Workers don't launch properly when the topology name has a space in it
  • [STORM-196] - When JVM_OPTS are set, storm jar fails to detect storm.jar from environment
  • [STORM-238] - LICENSE and NOTICE files are duplicated in storm-core jar
  • [STORM-244] - DRPC timeout can return null instead of throwing an exception
  • [STORM-259] - Netty Client IllegalArgumentException reconnecting after 30 retries
  • [STORM-260] - Race condition in backtype.storm.utils.Time
  • [STORM-264] - Remove deprecated topology.optimize config?
  • [STORM-267] - storm.yaml references invalid package for LoggingMetricsConsumer
  • [STORM-269] - Any readable file exposed via UI log viewer
  • [STORM-273] - Error while running storm topologies on Windows using "storm jar"
  • [STORM-275] - Topologies, Spouts and Bolts with special characters in name cannot be viewed in ui
  • [STORM-277] - Kafka-Spout does not support parallelism(unpredictable behaviour)
  • [STORM-280] - storm unit tests are failing on windows
  • [STORM-281] - Leaking fd's when reading config files
  • [STORM-285] - Fix storm-core shade plugin config
  • [STORM-286] - Use URLEncoder#encode with the encoding specified.
  • [STORM-287] - Fix the position of documentation strings
  • [STORM-289] - Trident DRPC memory leak
  • [STORM-290] - Exclude log4j and slf4j-log4j from curator dependency.
  • [STORM-291] - Upgrade http-client dependency to 4.3.3
  • [STORM-294] - Commas not escaped in command line
  • [STORM-295] - Add storm configuration to define JAVA_HOME
  • [STORM-296] - Storm kafka unit tests are failing on windows
  • [STORM-297] - Storm Performance cannot be scaled up by adding more CPU cores
  • [STORM-298] - Logback file does not include full path for metrics appender fileNamePattern
  • [STORM-303] - Forward port of storm-kafka work
  • [STORM-313] - remove log-level-page from logviewer
  • [STORM-326] - task metric send repeatedly
  • [STORM-331] - storm-kafka: bump Kafka version dependency to 0.8.1.1
  • [STORM-335] - Test for cleaning up timed-out DRPC Requests
  • [STORM-338] - Move towards idiomatic Clojure style
  • [STORM-342] - Contention in Disruptor Queue which may cause message loss or out of order
  • [STORM-352] - [storm-kafka] PartitionManager does not save offsets to ZooKeeper
  • [STORM-384] - Storm UI showing incorrect number of workers and executors

Documentation

  • [STORM-317] - Add SECURITY.md to release binaries
  • [STORM-559] - ZkHosts in README should use 2181 as port
  • [STORM-560] - ZkHosts in README should use 2181 as port

Improvement

  • [STORM-12] - Reduce Thread Usage of Netty Transport
  • [STORM-63] - timeout request stay in queue of drpc server
  • [STORM-70] - use zookeeper-3.4.5
  • [STORM-132] - Default Storm scheduler should evenly use resources when managing multiple topologies
  • [STORM-241] - "storm jar" underperforms compared to scp
  • [STORM-252] - Upgrade curator to latest version
  • [STORM-263] - Update Kryo version to 2.21+
  • [STORM-265] - Upgrade Clojure to 1.5 (or 1.6)
  • [STORM-288] - Fix version Spelling in pom.xml
  • [STORM-301] - Fix Indentation for pom.xml in storm-dist
  • [STORM-302] - Fix Indentation for pom.xml in storm-dist
  • [STORM-306] - Document how to securely setup storm
  • [STORM-310] - Change Twitter authentication stream using the new Twitter4J. An optional set of filters can be used to restricted tweets.
  • [STORM-316] - Added registerMetric validation to have timeBucketSizeInSecs >= 1
  • [STORM-325] - storm-kafka: dependencies scope to provided
  • [STORM-484] - Implement topology validation logic in TopologyBuilder

New Feature

  • [STORM-69] - UI Visualizations
  • [STORM-138] - Pluggable serialization for multilang
  • [STORM-173] - use "-c " command to define Number config value will generate ClassCastException
  • [STORM-205] - Add REST API to Storm UI
  • [STORM-245] - Implement localOrShuffle() on Stream for performance
  • [STORM-276] - Add support for logviewer in storm.cmd
  • [STORM-308] - Storm Windows: Add support for config_value to {supervisor,nimbus,ui,drpc,logviewer} childopts
  • [STORM-315] - Added progress bar when submitting topology

Question

  • [STORM-270] - Why ahead-of-time compiled clojure "classes" are not used in storm-core

Task

  • [STORM-247] - Replace links to github resources in storm script
  • [STORM-305] - Create developer documentation

© 著作权归作者所有

共有 人打赏支持
悟性
粉丝 40
博文 27
码字总数 16670
作品 0
西安
技术主管
storm 0.9.2单机性能测试

最近在使用storm做了一下数据处理性能测试。 Topology结构:spout输出80万数据(csv格式);bolt1解析csv,拆分各信息段;bolt2按bolt1中某个字段汇总,累加记数后入库(入库触发频率:60s)...

GoldenRoc
2014/09/23
0
0
apache-storm分布式计算(drpc)开发心得

首先这东西是个拼凑出来的东西,啥zookeeper,nimbus,supervisor,drpc,一个服务不能少。对于我来说一开始不是部署集群还可以,大致步骤是先装zookeeper,这东西运行起来后,你才能跑nimbu...

uaisunshine
2015/03/27
0
2
storm client command

最近在研究实时日志分析,storm确实不错,以下是命令参数: storm help Syntax: storm jar topology-jar-path class 运行jar包中类的主函数和指定的参数 Commands: activate storm activate ...

China_OS
2014/02/22
0
0
年薪40万的大数据工程师是如何安装Strom

Strom集群的安装配置 主机规划 一、准备服务器 l 关闭防火墙 chkconfig iptables off && setenforce 0 l 创建用户 groupadd hadoop && useradd hadoop  && usermod -a -G hadoop hadoop l ......

爱尚实训
04/23
0
0
由提交storm项目jar包引发对jar的原理的探索

序:在开发storm项目时,提交项目jar包当把依赖的第三方jar包都打进去提交storm集群启动时报了发现多个同名的文件错误由此开始了一段对jar包的深刻理解之路。 这里说明stom集群环境中有storm...

刘洋intsmaze
2016/10/25
0
0

没有更多内容

加载失败,请刷新页面

加载更多

oracle 安装 PL/SQL Developer连接64位Oracle免安装配置

PL/SQL Developer连接64位Oracle 在64位系统上安装64位的Oracle数据库,但是没有对应的64位PL/SQL Developer,此时就不能使用PL/SQL Developer来进行直接连接的,所以要想实现连接还得需要其...

PeakFang-BOK
8分钟前
1
0
裁员寒冬袭来,30岁还在CRUD的Java程序员,拿什么安身立命?

就在近日,智联招聘公布的数据更是侧面印证了很多公司“瘦身”的事实:“2018年第二季度,小微企业用人需求较第一季度平均下降26.6%”。 裁员大潮正滚滚向前,席卷各行各业! 你做好失业的准...

Java填坑之路
10分钟前
0
0
第一章:什么是SpringCloud

第一章:什么是SpringCloud 何为微服务 在了解 SpringCloud之前,我们先来大致了解下 微服务这个概念吧。 传统单体架构 单体架构在小微企业比较常见,典型代表就是一个应用、一个数据库、一个...

DemonsI
15分钟前
4
0
环境搭建之八-- node.js

1.node.js官网下载64位二进制压缩包 node-v8.12.0-linux-x64.tar.xz 2.解压文件 2.1 xz格式文件为 tar格式 xz -d node-v8.12.0-linux-x64.tar.xz 此时文件已经转变为 node-v8.12.0-linux-x64...

imbiao
19分钟前
1
0
JVM调优浅谈

1.数据类型 java虚拟机中,数据类型可以分为两类:基本类型和引用类型。 基本类型的变量保存原始值,即:它代表的值就是数值本身,而引用类型的变量保存引用值。 “引用值”代表了某个对象的...

xtof
23分钟前
2
0

没有更多内容

加载失败,请刷新页面

加载更多

返回顶部
顶部