Communication is more effective when a speech is accompanied by the corresponding lipmovement. Lip-reading is helpful for hearing impaired person as well as for a normal hearing person in adverse acoustic condition. Speech Driven Face Animation can enhance audio based spoken communication. In this project, we have made a system that is capable of taking a raw audio as input and providing a face animation with the corresponding lip movements based on the audio. In order to obtain the face animation, we need to break the audio into respective set of phonemes and then map the phonemes to a corresponding facial expression. For the classification of phonemes a language model was built and the phonemes generated by the language model were mapped to the facial expression in Preston Blair series. For building the phoneme classifier, we need a text file which contains texts broken into their phonetic sequence. The test showed the accuracy of 70% for phoneme classification which is good enough for this application. This application can be useful in Internet telephony where only the audio is available. Further, it can be a useful application for hearing impaired person as they rely on the lip movements for better communication.