Received 44/45 points. Subjects: Higher level: Mathematics (7), Chemistry (7), English B (7) Standard level: Economics (7), Geography (7), Polish A (6)
Projects (professional or personal)
verified_user
0% verified
Publications
verified_user
0% verified
I
Distributed Deep Reinforcement Learning: Learn how to play Atari games in 20 minutes
ISC High Performance Frankfurt Conference Proceedings Springer
Jun 2018
We present a study in Distributed Deep Reinforcement Learning (DDRL) focused on scalability of a state-of-the-art Deep Reinforcement Learning algorithm known as Batch Asynchronous Advantage Actor Critic (BA3C). We show that using the Adam optimization algorithm with a batch size of up to 2048 is a viable choice for carrying out large scale machine learning computations. This, combined with careful reex- amination of the optimizer’s hyperparameters, using synchronous train- ing on the node level (while keeping the local, single node part of the algorithm asynchronous) and minimizing the model’s memory footprint, allowed us to achieve linear scaling for up to 64 CPU nodes. This corre- sponds to a training time of 21 minutes on 768 CPU cores,