文档章节

人工智能资料库:第33辑(20170214)

AllenOR灵感
 AllenOR灵感
发布于 2017/09/10 01:25
字数 870
阅读 2
收藏 0

  1. 【代码】A TensorFlow Implementation of Character Level Neural Machine Translation Using the Quasi-RNN

简介:

InBradbury et al., 2016(hereafter, the Paper), the authors introduce a new neural network model which they call the Quasi-RNN. Basically, it tries to benefit from both CNNs and RNNs by combining them. The authors conducted three experiments to evaluate the performance of the Q-RNN. Character level machine translation is one of them. After the Paper was published, some enthusiasts tried to reproduce the experiments as the authors didn't disclose their source codes. Now I'm happy to be one of them. To my best knowledge, this is the first TensorFlow implementation of character level machine translation based on the Paper.

原文链接:https://github.com/Kyubyong/quasi-rnn


2.【博客】Unfolding RNNs II

简介:

Thefirst articlein this series focused on the general mechanism of RNN, architectures, variants and applications. The objective was to abstract away the details and illustrate the high-level concepts in RNN. Naturally, the next step is to dive into the details. In this article, we will follow a bottom-up approach, starting with the basic recurrent operation, building up to a complete neural network which performs language modeling.

As we have seen in the previous article, the RNNs consist of states, which are updated every time step. The state, at time stept, is essentially a summary of the information in the input sequence tillt. At eacht, information flows from the current input and the previous state, to the current state. This flow of information can be controlled. This is called thegatingmechanism. Conceptually, a gate is a structure that selectively allows the flow of information from one point to another. In this context, we can employ multiple gates, to control information flow from the input to the current state, previous state to current state and from current state to output. Based on how gates are employed to control the information flow, we have multiple variants of RNNs.

原文链接:http://suriyadeepan.github.io/2017-02-13-unfolding-rnn-2/


3.【资料】Open Source Deep Learning Curriculum

简介:

This open-source Deep Learning curriculum is meant to be a starting point for everyone interested in seriously studying the field. Plugging into the stream of research papers, tutorials and books about deep learning mid-stream it is easy to feel overwhelmed and without a clear idea of where to start. Recognizing that all knowledge is hierarchical, advanced concepts building on more fundamental ones, I strove to put a list of resources that form a logical progression from fundamental to advanced.

Few universities offer an education that is on par with what you can find online these days. The people pioneering the field from industry and academia so openly and competently share their knowledge that the best curriculum is an open source one.

原文链接:http://www.deeplearningweekly.com/pages/open_source_deep_learning_curriculum


4.【博客】Bayesian Linear Regression (in PyMC) - a different way to think about regression

简介:


In this blog post, I'll approach this problem from a Bayesian point of view. Ordinary linear regression (as taught in introductory statistics textbooks) offers a recipe which works great under a few circumstances, but has a variety of weaknesses. These weaknesses include an extreme sensitivity to outliers, an inability to incorporate priors, and little ability to quantify uncertainty.

Bayesian linear regression (BLR) offers a very different way to think about things. Combined with some computation (and note - computationally it's a LOT harder than ordinary least squares), one can easily formulate and solve a very flexible model that addresses most of the problems with ordinary least squares.

原文链接:https://www.chrisstucchio.com/blog/2017/bayesian_linear_regression.html


5.【NLP & Brain】This is your brain on sentences

简介:


Researchers at the University of Rochester have, for the first time, decoded and predicted the brain activity patterns of word meanings within sentences, and successfully predicted what the brain patterns would be for new sentences.

The study used functional magnetic resonance imaging (fMRI) to measure human brain activation. “Using fMRI data, we wanted to know if given a whole sentence, can we filter out what the brain’s representation of a word is—that is to say, can we break the sentence apart into its word components, then take the components and predict what they would look like in a new sentence,” said Andrew Anderson, a research fellow who led the study as a member of the lab ofRajeev Raizada, assistant professor ofbrain and cognitive sciencesat Rochester.

“We found that we can predict brain activity patterns—not perfectly [on average 70% correct], but significantly better than chance,” said Anderson, The study is published in the journalCerebral Cortex.

Anderson and his colleagues say the study makes key advances toward understanding how information is represented throughout the brain. “First, we introduced a method for predicting the neural patterns of words within sentences—which is a more complex problem than has been addressed by previous studies,which have almost all focused on single words,” Anderson said. “And second, we devised a novel approach to map semantic characteristics of words that we then correlated to neural activity patterns.”

原文链接:http://www.rochester.edu/newscenter/this-is-your-brain-on-sentences/#.WKFxXwJXqLM.facebook


本文转载自:http://www.jianshu.com/p/973c7a7482c5

共有 人打赏支持
AllenOR灵感
粉丝 10
博文 2634
码字总数 82983
作品 0
程序员
预测流行偏好,时尚 AI 未来可望取代造型师

【Technews科技新报】预测时尚潮流是一项需要天分的工作,还得仰赖一个庞大的系统让少数人追捧的时尚进入大众流行市场,进而让业者赚取大笔钞票。现在预测工作也可以交给人工智能,让服饰业者...

黄 嬿
2017/12/26
0
0
【Java每日一题】20170214

20170213问题解析请点击今日问题下方的“【Java每日一题】20170214”查看(问题解析在公众号首发,公众号ID:weknow619) 今日问题: 请问主程序输出结果是什么?(点击以下“【Java每日一题...

weknow
2017/02/14
0
0
人工智能知识整理-第1辑(20170603)-机器学习入门资源汇总

有一天我忽然忘记了一个函数的用法,于是就上谷歌搜,结果搜出来的竟然是自己写的一篇笔记,上面有很详细的回答。当时感觉是跟另外一个自己进行交流,那一个是刚学完知识,印象还非常深的自己...

人工智豪
2017/06/03
0
0
柯洁又一次输了人机大战:不敌国产AI 直言太无力

▼ 点击上方蓝字 关注网易智能 为你解读AI领域大公司大事件,新观点新应用 【网易智能讯 4月28日消息】昨日,第一届“吴清源杯”世界女子围棋赛暨2018世界人工智能围棋大赛在福州举行,中国知...

mcil9g4065q
04/28
0
0
【Java每日一题】20170215

20170214问题解析请点击今日问题下方的“【Java每日一题】20170215”查看(问题解析在公众号首发,公众号ID:weknow619) 今日问题: 请问主程序能否正常编译输出结果?(点击以下“【Java每...

weknow
2017/02/15
0
0

没有更多内容

加载失败,请刷新页面

加载更多

创建第一个react项目

sudo npm i -g create-react-app@1.5.2 create-react-app react-app cd react-apprm -rf package-lock.jsonrm -rf node_modules #主要是为了避免报错npm installnpm start......

lilugirl
今天
1
0
在浏览器中进行深度学习:TensorFlow.js (八)生成对抗网络 (GAN)

Generative Adversarial Network 是深度学习中非常有趣的一种方法。GAN最早源自Ian Goodfellow的这篇论文。LeCun对GAN给出了极高的评价: “There are many interesting recent development...

naughty
今天
0
0
搬瓦工镜像站bwh1.net被DNS污染,国内打不开搬瓦工官网

今天下午(2018年10月17日),继搬瓦工主域名bandwagonhost.com被污染后,这个国内的镜像地址bwh1.net也被墙了。那么目前应该怎么访问搬瓦工官网呢? 消息来源:搬瓦工优惠网->搬瓦工镜像站b...

flyzy2005
今天
3
0
SpringBoot自动配置

本篇介绍下,如何通过springboot的自动配置,将公司项目内的依赖jar,不需要扫描路径,依赖jar的情况下,就能将jar内配置了@configuration注解的类,创建到IOC里面 介绍下开发环境 JDK版本1.8 spr...

贺小五
今天
5
0
命令行新建Maven多项目

参考地址 # DgroupId 可以理解为包名# DartifactId 可以理解为项目名mvn archetype:generate -DgroupId=cn.modfun -DartifactId=scaffold -DarchetypeArtifactId=maven-archetype-quickst......

阿白
今天
2
0

没有更多内容

加载失败,请刷新页面

加载更多

返回顶部
顶部