The Gradient

Counting the Number of Parameters in Deep Learning

Posted on 2019-10-11 In NN Disqus:

A guide to calculate the number of trainable parameters by hand.

Dynamic Programming in NLP

Posted on 2019-09-21 In NLP Disqus:

Dynamic Programming (DP) is ubiquitous in NLP, such as Minimum Edit Distance, Viterbi Decoding, forward/backward algorithm, CKY algorithm, etc.

LeetCode: partition equal subset sum

Posted on 2019-09-12 In Algorithms , LeetCode , Dynamic Programming Disqus:

LeetCode 416.Partition Equal Subset Sum

Implementation Practical Misc

Posted on 2019-09-10 In Programming practical Disqus:

Some implementation magic.

PyTorch Notes

Posted on 2019-09-06 In PyTorch Disqus:

Go Deeper in Convolutions: a Peek

Posted on 2019-08-28 In NN , CNNs Disqus:

The main aim of conv op is to extract useful features for downstream tasks. And different filters could intuitionally extract different aspect of features via backprop during training. Afterward, all the extracted features are combined to make decisions.

Deciphering AlphaStar on StarCraft II

Posted on 2019-07-21 In RL Disqus:

On 19 December 2018, AlphaStar has decisively beaten human player MaNa with 5-0 on StarCraft II, one of the most challenging Real-Time-Strategy (RTS) games.