Links with deep learning practical advices

This is a list of posts, papers and other resources related to deep learning training

• Ilya Sutskever’s practical advices
• Galaxy zoo solution
• DL4J tricks
• Max-norm regularization
• ReLU initialization discussion
• RNN initialization
• Using momentum in Pylearn2
• Practical recommendations for gradient-based training of deep architectures
• Random Search for Hyper-Parameter Optimization
• Imagenet paper
• Dropout paper