Training RNNs as Fast as CNNs:和 CNN 一样快的训练 RNN

SRU is a recurrent unit that can run over 10 times faster than cuDNN LSTM, without loss of accuracy tested on many tasks.

SRU 是一个循环单元可以运行 10 倍速度相比 cuDNN LSTM,在很多的任务上没有失去准确率。

论文地址:https://arxiv.org/abs/1709.02755
项目地址:https://github.com/taolei87/sru

Average processing time of LSTM, conv2d and SRU, tested on GTX 1070
For example, the figure above presents the processing time of a single mini-batch of 32 samples. SRU achieves 10 to 16 times speed-up compared to LSTM, and operates as fast as (or faster than) word-level convolution using conv2d.

原创文章,作者:fendouai,如若转载,请注明出处:http://panchuang.net/2017/09/12/training-rnns-as-fast-as-cnns/

发表评论

电子邮件地址不会被公开。

联系我们

400-800-8888

在线咨询:点击这里给我发消息

邮件:admin@example.com

工作时间:周一至周五,9:30-18:30,节假日休息