Martin Kay Morphology
Martin Kay
Stanford University andThe University of the Saarland
Translationand Cloud Computing!!
Martin Kay Machine Translation
What is Translation?• A text that is based on a text in another language and which—has the same meaning—conveys the same information—has the same effect on its readers—gives the gist of the original—explains the original
• It depends what you want• Generally a mixture of several of these
2
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
Semantics
Interlingua
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
Semantics
Transfer
Analys
is Analysis
Abs
tract
ion
Red
uce
dim
ensi
ons
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
Semantics
tying = tie+ing loved = love + ed
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
Semantics
loves = love+pl, love+3sg children = child+pl
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
Semantics
The dog chased the cat = the cat was chased by the dog
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
SemanticsBrutus killed Ceasar => Caesar is dead
Martin Kay Morphology
Statistical MT
Phonology / Orthography
Morphology
Syntax
Semantics
TransferMartin Kay Morphology
Pragmatic MT
Phonology / Orthography
Morphology
Syntax
Semantics
TransferAnal
ysis
Analysis
Martin Kay Morphology
Pragmatic MT
Phonology / Orthography
Morphology
Syntax
SemanticsI left nothing on the train = I had all my belongings when I got off the train
Martin Kay Morphology
Vauquois Triangle
Phonology / Orthography
Morphology
Syntax
Semantics
Semantic Processing
Martin Kay Morphology
Semantic Processing
Replace words and phrases by words and phrases that mean the sameReorder
• Translation in Language teaching• Popular perception of translation• Machine translation
Martin Kay Morphology
Semantic Processing
Replace words and phrases by words and phrases that mean the sameReorder
• St. Jerome: Vulgate• 20th Century• Translator is anonymous
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
15 Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
16
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
17 Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
18
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
19 Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
20
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
21 Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
22
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
23 Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
24
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
25 Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben
Make sure that you have forgotten nothing on the train
Make sure that you have left nothing on the train
I forgot to call you on the trainI forgot my password on the train
I left the trash on the train
The stuff on the car is still at home, but I left nothing on the train
Assurez-vous que vous n'avez rien oublié dans le train
26
Martin Kay Robotics
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben Assurez-vous que vous n'avez rien oublié dans le train
I didn't bring all my belongings with me!
I left your brief case, but none of my belongings.
27
Make sure that you take all your belongings with you
Martin Kay Robotics
We all know the Lost and Found scenario and that this is what they are talking about
28
Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben
Make sure that you take all your belongings with you
Semantic TranslationPragmatic
Martin Kay Robotics
Situated Language
29 Martin Kay Morphology
Semantic Processing Replace words and phrases by words and phrases that mean the sameReorder
Pragmatic Processing Replace words and phrases by words and phrases that will effect the same changes in the hearer's head
Martin Kay Morphology
• Mr President , I respond to an invitation yesterday afternoon by the President of the House to speak on behalf of my group on a matter referred to in the Minutes .
• Monsieur le Président , je réponds à une invitation lancée hier par la Présidente qui m ' a demandé de prendre la parole au nom de mon groupe sur un sujet mentionné dans le procès - verbal .
Martin Kay Morphology
• Mr President , I respond to an invitation yesterday afternoon by the President of the House to speak on behalf of my group on a matter referred to in the Minutes .
• Monsieur le Président , je réponds à une invitation lancée hier par la Présidente qui m'a demandé de prendre la parole au nom de mon groupe sur un sujet mentionné dans le procès - verbal .
Martin Kay Morphology
• Mr President , I respond to an invitation yesterday afternoon by the President of the House to speak on behalf of my group on a matter referred to in the Minutes .
• Monsieur le Président , je réponds à une invitation lancée hier par la Présidente qui m'a demandé de prendre la parole au nom de mon groupe sur un sujet mentionné dans le procès - verbal .
Martin Kay Morphology
• I refer to item 11 on the order of business .
• Je veux parler du point 11 de l'ordre des travaux .
Martin Kay Morphology
• Je souhaite exprimer ce point de vue , même si je désapprouve la proposition du président du groupe des socialistes , tout en la respectant , et même si j'ai voté contre .
• I wish to express that view even if I respectfully disagreed and voted against the proposal of the President of the Socialist Group .
Martin Kay Morphology
• Je souhaite exprimer ce point de vue , même si je désapprouve la proposition du président du groupe des socialistes , tout en la respectant , et même si j'ai voté contre .
• I wish to express that view even if I respectfully disagreed and voted against the proposal of the President of the Socialist Group.
• I want to express that view, even if I disapprove of the proposal of the president of the socialist group, while I respect it, and even though I voted against it
Martin Kay Morphology
• J 'apprécie fortement cette attitude . • That is something for which I have a deep appreciation .
Martin Kay Morphology
• Pragmatic translation often involves addition or removal of substantive information from what is explicitly expressed.
Martin Kay Translation
You cannot avoid it
Two no trumps, short stop, goal keeper, end runHappy hour, a hair of the dogAlimony, juge d'instructionvalue-added tax, home owner's policynut, hot tea, café/espresson-th floor, n pièces2-piece, 2-seater, deux roues, 6-packSecond reading. Do I have a second?
39Martin Kay Machine Translation
I usually go to work in the bus!on
40
Martin Kay Translation 41
Est_ce que ce train va a Perpignan?
Martin Kay Translation 42
Does this train go to
Perpignan?
No, it stops in Beziers.
Fährt dieser Zug nach
Perpignan?
Nein, er in
Béziersendethält
Martin Kay Machine Translation
Est-ce que c’est ta cousine?
Non, je n’ai pas de cousine.
Is that your cousin?
No. I don’t have a cousin.
female^
female^
Is that woman your cousin?
43 Martin Kay Machine Translation
Is that your cousin?
No. I don’t have a cousin.
female^
female^
Is that woman your cousin?girl
Est-ce que c’est ta cousine?
Non, je n’ai pas de cousine.
44
Martin Kay Robotics
People, see everything
—in a context
—from a point of view
45
Situated
Embodied
Martin Kay Machine Translation
Facts about translation
… are not all reflected in emergent properties of translationsDoes this train go to Endville?Est-ce que c’est ta cousine?I just got back from Texas/Utah. I had forgotten how good
beer tastes. Ich hatte vergeßen, wie gut[es] Bier schmekt.It may be necessary to reduce condenser steam side pressure
pression latérale de la vapeurpression côté vapeur
Martin Kay Machine Translation
TargetQuality
SourceDifficulty
!!
!
! ShakespeareGoogle
Weather reports
Coca Cola
Caterpillar
Haiti
Boeing
Martin Kay Machine Translation
TargetQuality
SourceDifficulty
!!
!
! ShakespeareGoogle
Weather reports
Coca Cola
Caterpillar
Haiti
Boeing
The Human Zone
Martin Kay Machine Translation
TargetQuality
SourceDifficulty
!!
!
! ShakespeareGoogle
Weather reports
Coca Cola
Caterpillar
Haiti
Boeing
TheAmateur
Zone
Martin Kay Machine Translation
• Literary translators are usually amateurs.• Legal translators are professionals.• Scientific, and technical translators of material to be disseminated are professionals.
• Scientific, and technical translators of internal material may be either.
Martin Kay Machine Translation
The human contribution
• Post-editing• Pre-editing• Consulting• Triangulation and Reflective editing
Martin Kay Morphology
Fin
Martin Kay Morphology
The Prevailing ViewInformation about language—resides in records of it in use—in texts;—Has something important to do with the frequency of short sequences of words (n-grams);
—occurs mostly in very weak dilution.
∴ Learning about language requires—computers, and—vast corpora.
Translation is all about relations between words and phrases in two languages.
Martin Kay Morphology
The Traditional ViewInformation about language—resides in people's heads;—Has something important to do with the frequency of short sequences of words (n-grams);
—occurs mostly in very weak dilution.
∴ Learning about language requires—computers, and—vast corpora.
Translation is all about relations between words and phrases in two languages.
Martin Kay Morphology
The Traditional ViewInformation about language—resides in people's heads;—Has something important to do with the recursive grammatical structure of sentences;
—occurs mostly in very weak dilution.
∴ Learning about language requires—computers, and—vast corpora.
Translation is all about relations between words and phrases in two languages.
Martin Kay Morphology
The Traditional ViewInformation about language—resides in people's heads;—Has something important to do with the recursive grammatical structure of sentences;
—occurs mostly in quite strong dilution.
∴ Learning about language requires—computers, and—vast corpora.
Translation is all about relations between words and phrases in two languages.
Martin Kay Morphology
Dictionary-and-Rearrangement Translation
• α' can translate α if α:α' is in the bilingual dictionary.
• α'β' can translate αβ if α' can translate α and β'can translate β
• β'α' can translate αβ if α' can translate
α and β'can translate β• The right alternative is the one that looks best.
Martin Kay Morphology
Dictionary-and-Rearrangement Translation
Used exclusively in:—Translation in foreign-language teaching.—Machine translation.
Preferred in—Religious translation—Much legal translation—Much post-1900 translation
Deprecated in—Scientific and technical translation—Translation of Belles Lettres
Because—It's easiest—Makes the translator anonymous
Because—What the text refers to is more important than what the words mean.
Semantic Translation
Martin Kay Morphology
Understand and Re-express Translation
• The ultimate basis of all translation
Pragmatic TranslationMartin Kay Morphology
• Je ne veux pas sans cesse remettre sur le tapis les problèmes de ce bâtiment mais cela constitue un sujet de préoccupation sérieux .
• I do not want to ever put on the table the issue of this building but this is a serious concern. (G)
• I do not want to drag up the issue of this building endlessly , but this is a serious problem .
Martin Kay Morphology
• Toutefois , nous discutons également aujourd ' hui du rapport sur les aides d ' État et du rapport général sur la politique de concurrence pour 1998, ma contribution à cette discussion commune touchant au dernier rapport .
• However , we are also discussing the aid report today and the general competition report for 1998, and my contribution to this joint debate relates to the latter .
• However, we also discussed today the report on state aid and the general report on competition policy for 1998, my contribution to this joint debate concerning the final report.
Martin Kay Morphology
• Il s ' agit de l ' exigence de modernisation afin d ' assurer l ' avenir de la politique européenne de concurrence .
• It is all about the need for modernisation and the future viability of the European competition policy .
• Nous appelons le Conseil et la Conférence intergouvernementale à introduire la procédure de codécision en matière de droit de la concurrence .
• Therefore , I would urge the Council and the Intergovernmental Conference to introduce the codecision procedure into legislation in this area
Martin Kay Morphology
• Les rudiments de l ' économie nous apprennent que• At the end of the day , one of the fundamental tenets of
economic theory is that
Martin Kay Morphology
Martin Kay Morphology
Cloud ComputingWhen you need computing resources—In large amounts.—In bursts—With simple parallelization—MapReduce
When you could use people—irregulary—of just the right kind
Martin Kay Morphology
Cloud Computing• Client
—A way to rent out time on computers you are not using.—A way to get other people to work for you for free
• Customer—A way to get huge bursts of computation done.
Martin Kay Morphology
CIA Google
Martin Kay Morphology
• A core team of about 100 employees has been developing n.Fluent over the past four years. The software went live for internal IBM use in August 2008. Since then, about 3,000 employee volunteers have collectively contributed more than 36 million words to extend and improve it. To encourage further participation and raise awareness of the project, IBM held its first crowdsourcing event last summer.
• No specific plans have been announced for a commercial product or service. "For right now, we're focusing on building and perfecting the tool," said Ari Fishkind, an IBM spokesman.
• Salim Roukos, computer science researcher at IBM's T.J. Watson Labs, believes this sort of technology could play a big role in localizing global operations. Companies currently spend about $13 billion a year to translate documentation, which is all done using human labor. With n.Fluent, companies could automate the first translation and then let humans focus on correcting any mistakes.
Martin Kay Morphology
• Philip Resnik, associate professor of computer science at the University of Maryland, has been researching crowdsourcing machine-translation techniques. Resnick said statistical techniques made a revolutionary leap by turning a labor-intensive, expert-driven development process into a machine-learning problem.
Martin Kay Morphology
• To address this gap, Resnik is working with Ben Bederson, associate professor of computer science at the University of Maryland, to develop a framework for human-machine interaction that pairs volunteers, one of whom knows only the source language and the other, only the target language.
Martin Kay Morphology
MapReduce• It is clear that the needs of machine translation re- searchers have outgrown the capabilities of individual computers.
Martin Kay Morphology
• Last month, for example, it said it was working to combine its translation tool with image analysis, allowing a person to, say, take a cellphone photo of a menu in German and get an instant English translation.
• The services themselves have long been referred to as Software as a Service (SaaS)
• Like many other NLP problems, output quality of statistical machine translation (SMT) systems in- creases with the amount of training data.
Martin Kay Morphology
Translation Models• Classroom model• Find lexical pairs (bilingual dictionary)• Do morphology• Reorder
• Makes translator anonymous, less accountable• Good for
—religious translation—legal text?
Martin Kay Morphology
The delphi method• The name "Delphi" derives from the Oracle of Delphi. The authors of the method were not happy with this name, because it implies "something oracular, something smacking a little of the occult"
• The opening anecdote relates Francis Galton's surprise that the crowd at a county fair accurately guessed the weight of an ox when their individual guesses were averaged (the average was closer to the ox's true butchered weight than the estimates of most crowd members, and also closer than any of the separate estimates made by cattle experts).
Martin Kay Morphology
• Coordination of behavior includes optimizing the utilization of a popular bar and not colliding in moving traffic flows. The book is replete with examples from experimental economics, but this section relies more on naturally occurring experiments such as pedestrians optimizing the pavement flow or the extent of crowding in popular restaurants. He examines how common understanding within a culture allows remarkably accurate judgments about specific reactions of other members of the culture.
Martin Kay Morphology
Pragmatic Translation• Assurez-vous que vous n'avez rien oublié dans le train
• Versichern Sie Sich daß Sie nichts in dem Zug vergeßen haben
• Make sure you have not forgotten the train.—Google translate 5/29/10 5.55pm CET.
• English—Make sure that you have have not forgotten (left) anything on the train.
—Make sure that you take all your belongings with you.
Martin Kay Machine Translation Martin Kay Machine Translation
Translation Types• Outbound• Inbound• Indicative• Informative
Martin Kay Machine Translation
The European UnionDanishDutchEnglishFinnishFrenchGermanGreekItalianPortugueseSpanishSwedish
CzechEstonian
HungarianLithuanian
LatvianMaltese
PolishSlovene
Slovak
11 languages2,500 (12.5%) of 20,000 staff1% of the annual budget40% of administration costs.
Martin Kay Machine Translation
The perception
Linguistics is not about communicationIt focuses on fringe phenomenaIt is not robustIt luxuriates in ambiguities but is not
interested in resolving themIt never gets beyond the sentence
Linguistics has failed technology
Martin Kay Machine Translation
Generative Linguistics
The generative vein in linguistics has run out because most problems have—been solved—turned out to belong to a wider domain
A new paradigm is required based in acknowledging that language is about communication
Translation is about communication
Martin Kay Machine Translation
In many ways Linguistics has been a phenomenal success
Where problems have competing solutions, fringe phenomena can decide the issue
The strength and flexibility of language comes in large measure from its openness to ambiguity. Resolving ambiguity is not a linguistic enterprise
Much of what there is to study about language is within the sentence
Lexical semantics
Martin Kay Machine Translation
Unfortunately we have …
Early bindingZipf’s lawLocalityEmergent PropertiesAIBleu score
Martin Kay Machine Translation
Triangulation
Martin Kay Machine Translation
Weather reports
Belles LettresAdvertising
Manuals
Scientific PapersSource
Difficulty
Easy
Hard
TargetQuality
HighLow
DisseminationInformative
AssimilationIndicative
There is a lot of stuffin this corner
Martin Kay Machine Translation
TargetQuality
SourceDifficulty
!!
!
! ShakespeareGoogle
Weather reports