Beyond SGD: Gradient Descent with Momentum and Adaptive Learning Rate

There are many attempts to improve Gradient Descent: some add momentum, some add adaptive learning rate. Let's see what's out there in the realm of neural nets optimization.

Implementing Minibatch Gradient Descent for Neural Networks

Let's use Python and Numpy to implement Minibatch Gradient Descent algorithm for a simple 3-layers Neural Networks.

Paralellizing Monte Carlo Simulation in Python

Monte Carlo simulation is all about quantity. It can take a long time to complete. Here's how to speed it up with the amazing Python multiprocessing module!

Japan Photo Essay: Kanto and Kansai

To much to talk about, not enough time and space... So let's digest Japan bit by bit, starting with two of the most popular regions first: Kanto and Kansai.

Scrapy as a Library in Long Running Process

Scrapy is a great web crawler framework, but it's tricky to make it runs as a library in a long-running process. Here's how!

Hong Kong, a Photo Essay

High rising skyscrapers and unspoiled nature; China but not China

Kota Kinabalu, a Photo Essay

Jungle, sea, small town, and seafood in 14 days.

SCUBA Diving in Kota Kinabalu

Kota Kinabalu, the capital of Sabah, Malaysia, offers such a great diving spot!

Pyongyang Restaurant: The Epicenter of North Korean Delicacies

Got enough of Korean food? How about trying something different, like North Korean food?

Borobudur Temple

I've got a chance to be there again after more than 15 years. Time passed, things changed. How's Borobudur now in the eye of my adult-self?