+ All Categories
Home > Documents > Classical Copying versus Quantum Entanglement in Natural...

Classical Copying versus Quantum Entanglement in Natural...

Date post: 14-Oct-2020
Category:
Upload: others
View: 3 times
Download: 1 times
Share this document with a friend
44
Classical Copying versus antum Entanglement in Natural Language: the Case of VP-ellipsis Gijs Jasper Wijnholds 1 Mehrnoosh Sadrzadeh 1 een Mary University of London, United Kingdom [email protected] SYCO 2 December 17, 2018
Transcript
Page 1: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Classical Copying versus�antum Entanglement in Natural

Language: the Case of VP-ellipsis

Gijs Jasper Wijnholds1

Mehrnoosh Sadrzadeh1

�een Mary University of London, United Kingdom

[email protected]

SYCO 2

December 17, 2018

Page 2: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

DISTRIBUTIONAL SEMANTICS: MEANING IN CONTEXT

G. J. Wijnholds SYCO 2 2 / 41

Page 3: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

COMPOSINGWORD EMBEDDINGS: A CHALLENGE

Coordination−−−−−−−−−−−−−−−→dancing and running = ??

�antification−−−−−−−−−−−−−−−−−−−−−−−−→Every student likes some teacher = ??

Anaphora−−−−−−−−−−→shaves himself = ??

⇒ Ellipsis−−−−−−−−−−−−−−−−−−−−−−−−−−−−→Ma� went to Croatia and Max did too = ??

G. J. Wijnholds SYCO 2 3 / 41

Page 4: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

VERB PHRASE ELLIPSIS

I Ellipsis is a natural language phenomenon in which part of a phrase is

missing and has to be recovered from context.

I In verb phrase ellipsis, the missing part is… a verb phrase.

I There is o�en a marker that indicates the type of the missing part.

Bob drinks a beer︸ ︷︷ ︸ant VP

and Alice does too︸ ︷︷ ︸marker

G. J. Wijnholds SYCO 2 4 / 41

Page 5: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

VERB PHRASE ELLIPSIS

I Ellipsis is a natural language phenomenon in which part of a phrase is

missing and has to be recovered from context.

I In verb phrase ellipsis, the missing part is… a verb phrase.

I There is o�en a marker that indicates the type of the missing part.

Bob drinks a beer︸ ︷︷ ︸ant VP

and Alice does too︸ ︷︷ ︸marker

G. J. Wijnholds SYCO 2 4 / 41

Page 6: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

ELLIPSIS NEEDS COPYING AND MOVEMENT

ant VP marker

Bob drinks a beer

drinks a beer drinks a beer

and Alice does too

G. J. Wijnholds SYCO 2 5 / 41

Page 7: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

ELLIPSIS NEEDS COPYING AND MOVEMENT

ant VP marker

Bob drinks a beer

drinks a beer drinks a beer

and Alice does too

G. J. Wijnholds SYCO 2 6 / 41

Page 8: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

ELLIPSIS NEEDS COPYING AND MOVEMENT

ant VP marker

Bob drinks a beer

drinks a beer drinks a beer

and Alice �����does too

G. J. Wijnholds SYCO 2 7 / 41

Page 9: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

THE CHALLENGE: COMPOSE WORD VECTORS TO GET AMEANING REPRESENTATION FOR VP ELLIPSIS

G. J. Wijnholds SYCO 2 8 / 41

Page 10: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

THE BIG PICTURE

�antum Entanglement

SOURCE

L♦,FTARGET

FVectFunctor

Classical

SOURCE

L♦,FINTER

λNLTARGET

λFVecFrob

Hder Hlex

G. J. Wijnholds SYCO 2 9 / 41

Page 11: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

QUANTUM ENTANGLEMENT

G. J. Wijnholds SYCO 2 10 / 41

Page 12: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

LAMBEK VS. LAMBEK

The core of the Lambek calculus: application, co-application

B⊗ B\A→ A A→ B\(B⊗ A)

A/B⊗ B→ A A→ (A⊗ B)/B

(A⊗ B)⊗ C ↔ A⊗ (B⊗ C)

Interpretation: words have types, and type-respecting embeddings

Word Type embedding

john np−−→john ∈ N

sleeps np\s sleep ∈ N ⊗ S (← matrix)

likes (np\s)/np like ∈ N ⊗ S ⊗ N (← cube)

beer np−−→beer ∈ N

(Coecke et al., 2013)

G. J. Wijnholds SYCO 2 11 / 41

Page 13: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

IN PICTURES

A⊗ A\B→ B

A A B

B→ A\(A⊗ B)

A AB

B/A⊗ A→ B

A AB

B→ (B⊗ A)/A

A AB

(Coecke et al., 2013)

G. J. Wijnholds SYCO 2 12 / 41

Page 14: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

IN PICTURES

A⊗ A\B→ B

A A B

B→ A\(A⊗ B)

A AB

B/A⊗ A→ B

A AB

B→ (B⊗ A)/A

A AB

LINEAR‼

(Coecke et al., 2013)

G. J. Wijnholds SYCO 2 13 / 41

Page 15: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

LAMBEKWITH CONTROL OPERATORS: L♦,F

The core of the Lambek calculus: application, co-application

B⊗ B\A→ A A→ B\(B⊗ A)

A/B⊗ B→ A A→ (A⊗ B)/B

(A⊗ B)⊗ C ↔ A⊗ (B⊗ C)

Modalities: application, co-application

♦�A→ A A→ �♦AI Linear logic: controlled duplication/deletion of resources via

! = ♦�. Here: controlled copying, reordering

Controlled contraction, commutativity

A→ ♦A⊗ A (♦A⊗ B)⊗ C → B⊗ (♦A⊗ C)

♦A⊗ (♦B⊗ C)→ ♦B⊗ (♦A⊗ C)

G. J. Wijnholds SYCO 2 14 / 41

Page 16: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

ILLUSTRATION

Bob

ant VP

drinks a beer and Alice

marker

does too

np np\s

♦(np\s) np\s

(s\s)/s np ♦(np\s)\(np\s)

G. J. Wijnholds SYCO 2 15 / 41

Page 17: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

IN PICTURES

A⊗ A\B→ B

A A B

B→ A\(A⊗ B)

A AB

B/A⊗ A→ B

A AB

B→ (B⊗ A)/A

A AB

A→ ♦A⊗ A

A

A A

(♦A⊗ B)⊗ C → B⊗ (♦A⊗ C)

A B C

B A C

G. J. Wijnholds SYCO 2 16 / 41

Page 18: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

QUANTUM ENTANGLEMENT AND ELLIPSIS

Bob

N

· · · · ·

drinks a beer

N ⊗ S

◦ ◦

and

S ⊗ S ⊗ S

· · ·

Alice

N

·

does too

N ⊗ S ⊗ S ⊗ N

· · · ·

G. J. Wijnholds SYCO 2 17 / 41

Page 19: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

QUANTUM ENTANGLEMENT AND ELLIPSIS

Bob

N

· · · · ·

drinks a beer

N ⊗ S

◦ ◦

and

S ⊗ S ⊗ S

· · ·

Alice

N

·

does too

N ⊗ S ⊗ S ⊗ N

· · · ·

·◦·

G. J. Wijnholds SYCO 2 18 / 41

Page 20: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

QUANTUM ENTANGLEMENT AND ELLIPSIS

Bob

N

· · ·

drinks a beer

N ⊗ S

(−→Bob �

−−→Alice)> ×

−−−−−−−−→drinks a beer

Alice

N

·

G. J. Wijnholds SYCO 2 19 / 41

Page 21: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A MORE COMPLICATED CASE: SLOPPY READING

Bob loves his beer and Alice does too

Bob loves Bob’s beer and Alice loves Bob’s beer

Bob

ant VP

loves

(np\s)/np

his

♦np\(np/n)

beer

n

and Alice

marker

does too

np

♦np np

♦(np\s)

np\s

np\s

(s\s)/s np ♦(np\s)\(np\s)

G. J. Wijnholds SYCO 2 20 / 41

Page 22: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A MORE COMPLICATED CASE: SLOPPY READING

Bob loves his beer and Alice does too

Bob loves Bob’s beer and Alice loves Bob’s beer

Bob

ant VP

loves

(np\s)/np

his

♦np\(np/n)

beer

n

and Alice

marker

does too

np

♦np np

♦(np\s)

np\s

np\s

(s\s)/s np ♦(np\s)\(np\s)

G. J. Wijnholds SYCO 2 21 / 41

Page 23: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A MORE COMPLICATED CASE: STRICT READING

Bob loves his beer and Alice does too

Bob loves Bob’s beer and Alice loves Alice’s beer

Bob

ant VP

loves

(np\s)/np

his

♦np\(np/n)

beer

n

and Alice

marker

does too

np

♦np np

♦(np\s)

np\s

np\s

(s\s)/s np ♦(np\s)\(np\s)

G. J. Wijnholds SYCO 2 22 / 41

Page 24: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A MORE COMPLICATED CASE: STRICT READING

Bob loves his beer and Alice does too

Bob loves Bob’s beer and Alice loves Alice’s beer

Bob

ant VP

loves

(np\s)/np

his

♦np\(np/n)

beer

n

and Alice

marker

does too

np

♦np np

♦((np\s)/s ⊗ ( ♦np\n⊗ n)

)

(s\s)/s np ♦(np\s)\(np\s)

G. J. Wijnholds SYCO 2 23 / 41

Page 25: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A More Complicated Case: Sloppy Reading

Bob

N

· · · · · ·

loves

N ⊗ S ⊗ N

◦ ◦

his

N ⊗ N ⊗ N

·

beer

N

and

S ⊗ S ⊗ S

· · ·

Alice

N

·

does too

N ⊗ S ⊗ S ⊗ N

· · · ·· ·

G. J. Wijnholds SYCO 2 24 / 41

Page 26: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A More Complicated Case: Sloppy Reading

Bob

N

· · · · · ·

loves

N ⊗ S ⊗ N

◦ ◦

his

N ⊗ N ⊗ N

·

beer

N

and

S ⊗ S ⊗ S

· · ·

Alice

N

·

does too

N ⊗ S ⊗ S ⊗ N

· · · ·· ·

·◦··

◦·

G. J. Wijnholds SYCO 2 25 / 41

Page 27: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A More Complicated Case: Sloppy Reading

Bob loves Bob’s beer and Alice loves Bob’s beer

Bob

N

Alice

N

beer

N

· · · ·

loves

N ⊗ S ⊗ N

∆(Bob� Alice� Beer)ik lovesijk

G. J. Wijnholds SYCO 2 26 / 41

Page 28: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A More Complicated Case: Strict Reading

Bob loves Bob’s beer and Alice loves Alice’s beer

Bob

N

Alice

N

beer

N

· · · ·

loves

N ⊗ S ⊗ N

∆(Bob� Alice� Beer)ik lovesijk

G. J. Wijnholds SYCO 2 27 / 41

Page 29: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

A More Complicated Case: Strict Reading

Bob loves Bob’s beer and Alice loves Alice’s beer

Bob

N

Alice

N

beer

N

· · · ·

loves

N ⊗ S ⊗ N

∆(Bob� Alice� Beer)ik lovesijk

G. J. Wijnholds SYCO 2 27 / 41

Page 30: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

WHAT NOW?

Classical Semantics

G. J. Wijnholds SYCO 2 28 / 41

Page 31: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

WHAT NOW?

Classical Semantics

G. J. Wijnholds SYCO 2 28 / 41

Page 32: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

General Interpretation

The syntax-semantics homomorphism interprets types and proofs of L♦,F as objects types and maps

terms in a compact closed category non-linear lambda calculus:

Type Level

bA⊗ Bc = bAc × bBc bA/Bc = bAc → bBc bA\Bc = bAc → bBc b♦Ac = b�Ac = bAc

Application, co-application

B× (B→ A)λxM.M x−−−−−−−→ A

λx.λy.〈y, x〉−−−−−−−−−→ B→ (B× A)

(B→ A)× BλMx.Mx−−−−−−→ A

λx.λy.〈x, y〉−−−−−−−−−→ B→ (A× B)

Modalities

♦,� are semantically vacuous, so only the control rules get a non-trivial interpretation:

Aλx.〈x, x〉−−−−−−−→ A× A (A× B)× C

λ〈x, y, z〉.〈y, x, z〉−−−−−−−−−−−−−→ B× (A× C)

G. J. Wijnholds SYCO 2 29 / 41

Page 33: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Lambda term for simple ellipsis

Bob drinks and Alice does too

A proof of

(np ⊗ np\s)⊗ ((s\s)/s ⊗ (np ⊗ (♦(np\s)⊗ ♦(np\s)\(np\s)))) −→ s

gives term

λ〈subj1,verb,coord,subj

2,verb∗,aux〉.(coord ((auxverb∗)subj

2))(verbsubj

1)

The movement and contraction give

λ〈subj1,verb,coord,subj

2,aux〉.(coord ((aux verb) subj

2))(verb subj

1)

Plugging in some constants, we get an abstract term

(and ((dt drinks) bob))(drinks alice) : s

G. J. Wijnholds SYCO 2 30 / 41

Page 34: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Modelling Vectors with Lambdas

Vector: λi.vi I → R (= V )

Matrix: λij.Mij I → I → R

� : λvui.vi · ui V → V → R

Vector � Vector: λv.v � v V → V

Matrix> λmij.mji M→ M

Matrix ×1 Vector λmvi.∑jmij · vj M→ V → V

Cube ×2 Vector λcvij.∑kcijk · vk C → V → M

(Muskens & Sadrzadeh, 2016)

G. J. Wijnholds SYCO 2 31 / 41

Page 35: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Classical Semantics for simple ellipsis

Bob drinks and Alice does too

(λP.λQ.P � Q ((λx.x (λv.drinks×1 v)) bob))((λv.(drinks×1 v)) alice)

→β (λP.λQ.P � Q ((λv.drinks×1 v) bob))((λv.(drinks×1 v)) alice)

→β (λP.λQ.P � Q (drinks×1 bob))(drinks×1 alice)

→β (drinks×1 bob)� (drinks×1 alice)

G. J. Wijnholds SYCO 2 32 / 41

Page 36: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Classical Semantics for Ambiguous Ellipsis

Bob loves Bob’s beer and Alice loves Bob’s beer (sloppy)

(bob×1 loves×2 (bob�beer))� (alice×1 loves×2 (bob�beer))

Bob loves Bob’s beer and Alice loves Alice’s beer (strict)

(bob×1 loves×2 (bob�beer))�(alice×1 loves×2 (alice�beer))

G. J. Wijnholds SYCO 2 33 / 41

Page 37: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Conclusion 1: Classical vs. �antum Entanglement

Developing Frobenius Semantics fits easily in the DisCoCat

framework, but fails to give a proper account for more complex

examples of ellipsis.

Classical Semantics are more involved and are non-linear, but give a

be�er account of derivational ambiguity.

G. J. Wijnholds SYCO 2 34 / 41

Page 38: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

LET THE DATA SPEAK

G. J. Wijnholds SYCO 2 35 / 41

Page 39: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

EXPERIMENTINGWITH VP ELLIPSIS

I GS2011 verb disambiguation dataset (200 samples):

man draw photograph ∼ man a�ract photograph

man draw photograph ∼ man depict photograph

I KS2013 similarity dataset (108 samples):

man bites dog ∼ student achieve result

I We extended the above datasets to elliptical phrases (now with 400/416 sentence pairs)

man bites dog and woman does too ∼ student achieve result and boy does too

I Run experiments with several models:

Linear

−−→subj ?

−−→verb ?

−→obj ?

−→and ?

−−→subj∗ ?

−−→does ?−→too

Non-Linear

−−→subj ?

−−→verb ?

−→obj ?

−−→subj∗ ?

−−→verb ?

−→obj

Lambda-Based T(−−→subj, verb,

−→obj) ? T(

−−→subj∗, verb,

−→obj)

Picture-Based T(−−→subj ?

−−→subj∗, verb,

−→obj)

where ? is addition or multiplication, and T is some a�ested model for a transitive

sentence.

G. J. Wijnholds SYCO 2 36 / 41

Page 40: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

EXPERIMENTINGWITH VP ELLIPSIS: DISAMBIGUATIONRESULTS

CB W2V GloVe FT D2V1 D2V2 ST IS1 IS2 USE

Verb Only Vector .4150 .2260 .4281 .2261

Verb Only Tensor .3039 .4028 .3636 .3548

Add. Linear .4081 .2619 .3025 .1292

Mult. Linear .3205 -.0098 .2047 .2834

Add. Non-Linear .4125 .3130 .3195 .1350

Mult. Non-Linear .4759 .1959 .2445 .0249

Best Lambda .5078 .4263 .3556 .4543

2nd Best Lambda .4949 .4156 .3338 .4278

Best Picture .5080 .4263 .3916 .4572

Sent Encoder .1425 .2369 -.1764 .3382 .3477 .2564

Sent Encoder+Res .2269 .3021 -.1607 .3437 .3129 .2576

Sent Encoder-Log .1840 .2500 -.1252 .3484 .3241 .2252

Table: Spearman ρ scores for the ellipsis disambiguation experiment. CB: count-based,W2V: Word2Vec, FT: FastText, ST: Skip-Thoughts, IS1:InferSent (GloVe), IS2: InferSent (FastText), USE: Universal Sentence Encoder.

G. J. Wijnholds SYCO 2 37 / 41

Page 41: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

EXPERIMENTINGWITH VP ELLIPSIS: SIMILARITY RESULTS

CB W2V GloVe FT D2V1 D2V2 ST IS1 IS2 USE

Verb Only Vector .4562 .5833 .4348 .6513

Verb Only Tensor .3946 .5664 .4426 .5337

Add. Linear .7000 .7258 .6964 .7408

Mult. Linear .6330 .1302 .3666 .1995

Add. Non-Linear .6808 .7617 .7103 .7387

Mult. Non-Linear .7237 .3550 .2439 .4500

Best Lambda .7410 .7061 .4907 .6989

2nd Best Lambda .7370 .6713 .4819 .6871

Best Picture .7413 .7105 .4907 .7085

Sent Encoder .5901 .6188 .5851 .7785 .7009 .6463

Sent Encoder+Res .6878 .6875 .6039 .8022 .7486 .6791

Sent Encoder-Log .1840 .6599 .4715 .7815 .7301 .6397

Table: Spearman ρ scores for the ellipsis similarity experiment. CB: count-based,W2V: Word2Vec, FT: FastText, ST: Skip-Thoughts, IS1: InferSent(GloVe), IS2: InferSent (FastText), USE: Universal Sentence Encoder.

G. J. Wijnholds SYCO 2 38 / 41

Page 42: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Conclusion 2: Classical vs. �antum Entanglement

Experimentally, the linear approximation that Frobenius Semantics

gives is equally performant to the classical semantics!

G. J. Wijnholds SYCO 2 39 / 41

Page 43: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Future Work

1. Entailment:

Dogs sleep and cats too⇒ cats walk

2. Guess the antecedent (ambiguity!):

Dogs run, cats walk, and foxes …

3. Negation:

Dogs sleep but cats do not.

G. J. Wijnholds SYCO 2 40 / 41

Page 44: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in

Thank you!

[email protected]

G. J. Wijnholds SYCO 2 41 / 41


Recommended