Contributors

About

We lift barriers between creativity and technology, and converge advanced development into outcome-driven solutions. Pushing boundaries in gaming, digital, and experiential since 2010

Contact

Statistics

Posts: 405
Reposts: 0

Recurrent Neural Networks continue to improve

The latest improvements for RNN are flowing in, rolling in accuracy and performance gains "orders of magnitude" better than current state of the art. RNN's are particularly useful for speech recognition and natural language processing. This new improvement, the 'Transformer' is able to optimise the sequential learning steps when translating a sentence by homing in on particular words in a sentence that most significantly affect it's meaning (hence require more 'attention').

we show that the Transformer outperforms both recurrent and convolutional models on academic English to German and English to French translation benchmarks. On top of higher translation quality, the Transformer requires less computation to train and is a much better fit for modern machine learning hardware, speeding up training by up to an order of magnitude.

As a free user, you can follow Passle and like posts.

To repost this post to your own Passle blog, you will need to upgrade your account.

For plans and pricing, please contact our sales team at sales@passle.net

Sorry, you don't have permission to repost or create posts.

Repost successful!

View the repost

Repost successful!

Your repost is currently a draft. Review your repost and request approval.

Something went wrong whilst reposting - please try again.

Sorry - this is not an option. This post already exists in the Passle you have selected.

Try reposting to another Passle.