文档章节

Predicting Running Time of Grid Tasks based on CPU Load Predictions

猪迪
 猪迪
发布于 2017/08/13 01:20
字数 911
阅读 7
收藏 0
点赞 0
评论 0

CPU LOAD PREDICTION

A. Polynomial Fitting

B. One-step-ahead Prediction Strategy

1) Prediction based on Polynomial Fitting.

From our observations we found that 2nd or 3rd order polynomial fitting achieves much better (and the best) fitting effect than the 1st order (linear) fitting

2阶3阶多项式拟合效果更好

1阶线性拟合

3 (V_(T-2), V_(T-1), V_T) or 4 (V_(T-3), V_(T-2), V_(T-1), V_T)

Polynomial fitting function and then use the function value at polynomial the next time point as P_(T+1)

2) Prediction based on Similar Patterns

when the load traces vary smoothly and monotonously,多项式拟合取得好的效果,

遇到拐点就不好使了。

如下图,There are many similar "patterns" in the load traces

We use the value of last turning point(拐点) as the prediction value for the current point, P_(T+1).

We think that next point will be a turning point.

If we can't find a successively increasing series we will predict using a "conservative" strategy: we use V_T as P_(T+1)

For the other cases we also choose a conservative prediction strategy(比较保守的预测) that set the increment (decrement增减) between V_T and P_(T+1) as 0.

步进预测策略

算法预测(V1,V2,...,VT),输入CPU加载路径历史(V1,V2,... VT)

输出P_(T+1),预测V_(T+1)的值。

Begin

if 

    if  V_{T-5}是拐点,在它之前的五个点也相继递减,

          则 P_{T+1}=V_{T-5}#直接使用拐点值作为预测结果,结合单调性

    else 预测P_{T+1}使用多项式拟合

if V_T是拐点

    搜索V_T之前最后一个拐点,使用递增度量VT预测PT+1

if VT-1是拐点

    if  最后模式改变方向在五个点之后

        使用点递增两步要求最终拐点为VT递增 

    else PT+1=VT

if VT>VT-1>VT-2>VT-3

    IF VT-3>VT-4 PT+1=VT

    ELSE P_T+1=VT-(VT-VT-1)

对于其他情况,PT+1=VT

end

 

3) Multi-steps-ahead Prediction Strategy.多步直接预测

multi-steps-ahead CPU load prediction based on the above one-step-ahead prediction strategy

当我们预测第i步加载P-T+i(i>0),我们使用2)依次预测P-T+1,P-T+1,...,P-T+I-1,then we use the historical load trace and all the predicted load values P-T+i之前的历史信息来预测P-T+i

 

IV.预测任务运行时间

A.连续时间的任务运行时间估计

t_nom:nominal time

t_exp: we want to predict the expected execution time of the task on the loaded host

当主机上的可用时间在t_nom时到达,给定资源时间函数at(t):

at(t_exp)=t_nom

The available CPU time until time t, at(t) (t > 0), can be expressed as

V(t)为当前加载,可用时间递减同平均负载递增

B. Discrete-time Task Running Time Estimation

Suppose the sample interval is delta, the available time until the ith sample (i delta-th second) in the future can be expressed as:

使用线性插值

the continuous-time signal which represents the available time until t then can be estimated

C. Predict Task Running Time using CPU Load Prediction

We substitute the predicted load signal PT+j for VT+j so that we obtain the
predicted value for ali using (7), and then we calculate the predicted discrete-time available time using (6) and its corresponding continuous-time approximation using (8).

 

Evaluation results for multi-steps-ahead CPU load prediction

- Choose a random value between 100 ms and 10seconds from a uniform distribution as the nominal time of a task, t_nom.

- Select a CPU load prediction system from our method and AR(16) model.

- Calculate the expected task running time texp using load predictions derived from the above selected load prediction system.

- Calculate the actual task running time t_act on the host with the load measurements in the trace.
- Calculate the prediction error for the selected load prediction system.

预测任务执行时间可用于改进动态网格环境中的资源选择和调度,

基于多步进的CPU预测新策略

The results of experiments that we conducted demonstrate that this new prediction strategy outperforms the task running time prediction method using
AR(16) load prediction model.

© 著作权归作者所有

共有 人打赏支持
猪迪
粉丝 6
博文 134
码字总数 180528
作品 0
海淀
程序员
20 Linux System Monitoring Tools Every SysAdmin Should Know

Need to monitor Linux server performance? Try these built-in commands and a few add-on tools. Most Linux distributions are equipped with tons of monitoring. These tools provide ......

wuyaoito
2014/02/19
0
0
Linux系统的CPU使用率和Load

好吧,我承认这个话题是老生常谈,我自己也在2009年刚接触性能测试时就已经开始关注并略知一二;然而,对于CPU使用率和系统负载Load的确切含义以及它们之间的关系,我相信不是每个人都说得清...

fdhay
2016/04/18
80
0
YOLO论文翻译——中英文对照

文章作者:Tyan 博客:noahsnail.com | CSDN | 简书 声明:作者翻译论文仅为学习,如有侵权请联系作者删除博文,谢谢! You Only Look Once: Unified, Real-Time Object Detection Abstract...

Quincuntial
2017/11/29
0
0
YOLO,You Only Look Once论文翻译——中英文对照

文章作者:Tyan 博客:noahsnail.com | CSDN | 简书 声明:作者翻译论文仅为学习,如有侵权请联系作者删除博文,谢谢! You Only Look Once: Unified, Real-Time Object Detection Abstract...

Quincuntial
2017/12/04
0
0
Machine Learning Project Walkthrough: Making Predictions

1: Recap We spent the last 2 missions cleaning and preparing a dataset that contains data on loans made to members of Lending Club. Our eventual goal is to generate features fro......

Betty__
2016/09/29
32
0
Deep Learning Models on Kubernetes with GPUs

Deploying Deep Learning Models on Kubernetes with GPUs April 19, 2018 by ML Blog Team This post is authored by Mathew Salvaris and Fidan Boylu Uz, Senior Data Scientists at Micr......

openthings
04/27
0
0
Celery: Distributed Task Queue

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, ......

shaohan
2014/04/29
0
0
Understanding the Load Average on Linux and Other Unix-like Systems

Understanding the Load Average on Linux and Other Unix-like Systems Linux, Mac, and other Unix-like systems display “load average” numbers. These numbers tell you how busy you......

Oscarfff
2016/10/27
1
0
Guided Project: Predicting the stock market

https://github.com/pmk2109/DataQuest/blob/master/Guided%20Project-%20Predicting%20the%20stock%20market/predict.py 1: The Dataset Welcome to a Dataquest guided project! If you ha......

Betty__
2016/09/28
5
0
Linux top命令下的load average的详解

解释:uptime gives a one line display of the following information. The 中文解释如下:系统平均负载被定义为在特定时间间隔内运行队列中的平均进程树。如果一个进程满足以下条件则其就会...

宏伟的版图
2017/12/20
0
0

没有更多内容

加载失败,请刷新页面

加载更多

下一页

CoreText进阶(七)-添加自定义View和对其

CoreText进阶(七)-添加自定义View和对其 其它文章: CoreText 入门(一)-文本绘制 CoreText入门(二)-绘制图片 CoreText进阶(三)-事件处理 CoreText进阶(四)-文字行数限制和显示更多...

aron1992
13分钟前
0
0
Python爬虫 爬取百合网的女人们和男人们

学Python也有段时间了,目前学到了Python的类。个人感觉Python的类不应称之为类,而应称之为数据类型,只是数据类型而已!只是数据类型而已!只是数据类型而已!重要的事情说三篇。 据书上说...

p柯西
24分钟前
0
0
在Java中,你真的会日期转换吗

1.什么是SimpleDateFormat 在java doc对SimpleDateFormat的解释如下: SimpleDateFormatis a concrete class for formatting and parsing dates in a locale-sensitive manner. It allows fo......

Java小铺
33分钟前
0
0
Linux系统梳理---系统搭建(二):tomcat的安装和使用

上一章讲到JDK的安装使用,这一章主要记录下服务器tomcat的安装以及部署一个项目. 1.下载tomcat,这里下载的是apache-tomcat-8.5.32.tar.gz 2.创建文件夹,便于管理,和JDK一样,在usr目录下创建t...

勤奋的蚂蚁
43分钟前
0
0
ES15-聚合

1.Terms Aggregation 分组聚合 2.Filter Aggregation 过滤聚合

贾峰uk
45分钟前
0
0
【2018.07.19学习笔记】【linux高级知识 20.27-20.30】

20.27 分发系统介绍 20.28 expect脚本远程登录 20.29 expect脚本远程执行命令 20.30 expect脚本传递参数

lgsxp
47分钟前
0
0
10.32/10.33 rsync通过服务同步~10.35 screen工具

通过服务的方式同步要编辑配置文件:[root@linux-xl ~]# vim /etc/rsyncd.confport=873log file=/var/log/rsync.logpid file=/var/run/rsyncd.pidaddress=192.168.43.21[tes...

洗香香
51分钟前
0
0
与女儿谈商业模式 (3):沃尔玛的成功模式

分类:与女儿谈商业模式 | 标签: 经济学 沃尔玛 陈志武 2007-05-10 09:09阅读(11279)评论(30) 与女儿谈商业模式 (3):沃尔玛的成功模式 陈志武 /文 沃尔玛(Wal-Mart)是另一个有意思的财...

祖冲之
57分钟前
0
0
网页加载速度优化方法总结

1、减少请求 最大的性能漏洞就是一个页面需要发起几十个网络请求来获取诸如样式表、脚本或者图片这样的资源,这个在相对低带宽和高延迟的移动设备连接上来说影响更严重。 2、整合资源 对开发...

Jack088
今天
0
0
dubbo学习

https://blog.csdn.net/houshaolin/article/details/76408399

喵五郎
今天
0
0

没有更多内容

加载失败,请刷新页面

加载更多

下一页

返回顶部
顶部