1
2 1 x 2 + y 2 integral from one to two of x squared plus y squared We trained the system by tailoring a transcript consisting of math equations and having different speakers in dif- ferent settings utter the sentences in the tran- script. Mathifier has a gram- mar different from the english language. The system had to know that instead of having a sub- ject followed by a verb, a number was followed by an operator. integral from one to two of x squared plus y squared \int _{1}^{2}x^2+y^2 During speech recognition, the rec- ognized sentence is converted to Latex on-the-fly. 2 1 x 2 + y 2 \int _{1}^{2}x^2+y^2 The Latex code is compiled so that an image in equation form can be displayed. 2 1 x 2 + y 2 The compiled image is shown to the user in an intuitive interface. Mathifier uses CMU Sphinx 4, an open-source speech recognition tool designed for research. The modular design of Sphinx allowed us to modify only certain parts of the system. linguist frontend decoder active list scorer pruner convert input to features acoustic model dictionary language model Sphinx 4 Architecture Mathifier Speech Recognition for Math Equations Mathifier is a system that recognizes speech restricted to the math domain. That is, you speak natural math equations, and Mathifier will recognize your speech, convert it to Latex, and compile the Latex code into an equation format in real-time. introduction credits Students: Salim Batlouni, Hala Karaki, Elie Mekanna. Advisor: Dr. Fadi Zaraket. Co-Advisor: Dr. Fadi Karameh. Final Year Project, ECE department, American University of Beirut. Class of 2011. Open-source project github.com/cityvideo/math-speech-recognition
