How to Pump Up Your MT

Quality

State-of-the-art

A variety of engines available:

• Rule-based

• Statistical

• Hybrid

• Neural MT

How do we measure the MT quality and translate it into “quality break-through”?

Questions to the Panel:

• What really helps turn the dial in improving the MT engine quality? Automated Evaluation?

Human feedback? Confidence and utility scoring?

• How can translation industry work with R&D to achieve higher MT quality?

• How do we align MT quality evaluation methodologies and business success metrics?

• Neural MT? Do we already see an impact on MT quality?

• Shall we differentiate between content types when we are evaluating MT quality?

• If we were to establish evaluation best practices, what would those be? How can we as an

industry standardize on MT evaluation?

• What quality estimation and engine improvement methodologies can have positive impact on

translators' experience with MT?