Open Source

PyTorch DeepRL

A zoo of popular deep RL algorithms with PyTorch (600+ stars)

Google Summer of Code (GSoC) 2017

Contributed to MLPack by implementing various deep RL methods. Now I am in the contributor team of MLPack.

Reinforcement Learning: An Introduction

Python implementation of the textbook (3900+ stars)

Google Summer of Code (GSoC) 2014

Contributed to Xapian by optimizing the post list and the position list via the vector of splits encoding.


. A Deeper Look at Experience Replay. In DeepRL Symposium, NIPS, 2017.


. A Demon Control Architecture with Off-Policy Learning and Flexible Behavior Policy. In Hierarchical RL Workshop, NIPS, 2017.


. A Deep Neural Network for Modeling Music. In ICMR, 2015.



Coding Deep Reinforcement Learning Papers
Dec 9, 2017 12:00 AM


Research Intern

May 2018 - Now RLAD Lab, Huawei, Edmonton

Research Assistant

Jan 2017 - April 2018 RLAI Lab, University of Alberta

Teaching Assistant

Sept 2016 - Dec 2016 CMPUT 229, University of Alberta

Software Developer Engineer Intern

July 2015 - May 2016 SAP, Shanghai


Edmonton Half Marathon

Aug 2017 2 hrs 17 mins

Taihu Lake Half Marathon

Dec 2015 2 hrs 34 mins