Deep Learning


Selected papers:

  • Learning Continuous Phrase Representations and Syntactic Parsing with Recursive Neural Networks.
    Richard Socher, Christopher Manning and Andrew Ng.
    In NIPS 2010 Workshop on Deep Learning and Unsupervised Feature Learning. [PDF]

  • An Analysis of Single-Layer Networks in Unsupervised Feature Learning.
    Adam Coates, Honglak Lee and Andrew Ng.
    NIPS 2010 Workshop on Deep Learning and Unsupervised Feature Learning. [PDF]

  • On random weights and unsupervised feature learning.
    Andrew Saxe, Pang Wei Koh, Zhenghao Chen, Maneesh Bhand, Bipin Suresh and Andrew Ng.
    NIPS 2010 Workshop on Deep Learning and Unsupervised Feature Learning.
    [ PDF, supplementary material ]

  • Multimodal Deep Learning.
    Jiquan Ngiam, Aditya Khosla, Mingyu Kim, Juhan Nam, Honglak Lee and Andrew Ng.
    NIPS 2010 Workshop on Deep Learning and Unsupervised Feature Learning. [PDF]

  • A Probabilistic Model for Semantic Word Vectors.
    Andrew Maas and Andrew Ng.
    NIPS 2010 Workshop on Deep Learning and Unsupervised Feature Learning. [PDF]

  • Tiled Convolutional Neural Networks.
    Quoc V. Le, Jiquan Ngiam, Zhenghao Chen, Daniel Chia, Pangwei Koh and Andrew Y. Ng.
    NIPS 2010. [PDF, visualizations]

  • Energy Disaggregation via Discriminative Sparse Coding.
    J. Zico Kolter and Andrew Y. Ng.
    NIPS 2010. [PDF]

  • Measuring invariances in deep networks.
    Ian J. Goodfellow, Quoc V. Le, Andrew M. Saxe, Honglak Lee and Andrew Y. Ng.
    NIPS 2009. [PDF]

  • Unsupervised feature learning for audio classification using convolutional deep belief networks.
    Honglak Lee, Yan Largman, Peter Pham and Andrew Y. Ng.
    NIPS 2009. [PDF]

  • Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations.
    Honglak Lee, Roger Grosse, Rajesh Ranganath and Andrew Y. Ng.
    ICML 2009. [PDF]

  • Large-scale Deep Unsupervised Learning using Graphics Processors.
    Rajat Raina, Anand Madhavan and Andrew Y. Ng.
    ICML 2009. [PDF]

  • Exponential Family Sparse Coding with Application to Self-taught Learning.
    Honglak Lee, Rajat Raina, Alex Teichman and Andrew Y. Ng.
    IJCAI 2009. [PDF]

  • Sparse Deep Belief Net Model for Visual Area V2.
    H. Lee, Chaitanya Ekanadham and A. Y. Ng.
    NIPS 2008. [PDF]

  • Exponential family sparse coding with application to self-taught learning with text documents.
    H. Lee and R. Raina and A. Teichman and A. Y. Ng.
    ICML Workshop on Prior Knowledge for Text and Language, 2008. [PDF]

  • Shift-Invariant Sparse Coding for Audio Classification.
    R. Grosse, R. Raina, H. Kwong and A. Y. Ng.
    Uncertainty in Artificial Intelligence (UAI), 2007. [PDF]

  • Self-taught learning: Transfer learning from unlabeled data.
    R. Raina, A. Battle, H. Lee, B. Packer and A. Y. Ng.
    ICML 2007. [PDF]

  • Efficient sparse coding algorithms.
    Honglak Lee, Alexis Battle, Raina Rajat and Andrew Y. Ng.
    NIPS 2007. [PDF]