Recognizing text in the natural images is a foundation for solving other problems in computer vision like content based image filtering. Even though we have reached near perfect result in character recognition in documents we do not have a good system to recognize text in scenery images. Text Recognition in Natural Images Using Convolutional Neural Network is a system that detects and recognize text in natural images. It uses MSER (Maximally Stable Extremel Region) to detect text in the image and uses Convolutional Neural Network to recognize the text in natural images. The accuracy of 86.96 % in seen images and 84.05% in the unseen test images was obtained in this project.