CEPT: Collaborative Editing Tool for Non-Native Authors
Yeshuang Zhu, Shichao Yue, Chun Yu, Yuanchun Shi
http://pi.cs.tsinghua.edu.cn
Background
• Language editing is important and necessary for L2 writing.
• L2 problems: word choice, style, and L1 interference. (Park, T., et al. UIST 2008)
Background
• Language editing is important and necessary for L2 writing.
• L2 problems: word choice, style, and L1 interference.
• Language service by experts is not the first option.
• Considerations: cost, delay, domain mismatch, etc.
(Park, T., et al. UIST 2008)
Background
• Language editing is important and necessary for L2 writing.
• L2 problems: word choice, style, and L1 interference.
• Language service by experts is not the first option.
• Considerations: cost, delay, domain mismatch, etc.
• Collaborative editing (CE) is most often adopted by NNSs.
(Park, T., et al. UIST 2008)
Two Is Better than One
Two Is Better than One
• Collaborators have different and complementary knowledge about how to improve the writing.
(Piaget, J. On the development of memory and identity, 1968)
Two Is Better than One
• Collaborators have different and complementary knowledge about how to improve the writing.
• Picking from alternatives (recognition) is easier than generating new ones (recall).
(Winke, P. Studies in Second Language Acquisition, 2007)
(Piaget, J. On the development of memory and identity, 1968)
Tools for Collaborative Writing and Editing
Tools for Collaborative Writing and Editing
Email + edit mode
Tools for Collaborative Writing and Editing
Email + edit mode
(Noël, S., et al. CSCW 2004)
Online (synchronous) document
Tools for Collaborative Writing and Editing
Email + edit mode
(Noël, S., et al. CSCW 2004)
Online (synchronous) document
(Tomlinson, B., et al. CHI EA 2012)
Version control
Tools for Collaborative Writing and Editing
Email + edit mode
(Noël, S., et al. CSCW 2004)
Online (synchronous) document
(Tomlinson, B., et al. CHI EA 2012)
Version control
None is specially designed for language editing
Why Not Synchronous Document?
Why Not Synchronous Document?
• Edit mode is hard to interpret and share
Why Not Synchronous Document?
• Edit mode is hard to interpret and share
• Different opinions are not welcomed by nature
(Birnholtz, J., et al. CSCW 2012)
Why Not Synchronous Document?
Contribution in CEKnowledge in language
NNS 2
NNS 1
NNS 3
From Single Version to Parallel
From Single Version to Parallel
From Single Version to Parallel
Multi-Versioning: A Pilot Study
• Four Google Docs placed in parallel
SettingsP1 P2
P3 P4
• Four Google Docs placed in parallel
• Participants could:• edit their own copy only• refer to others• commenting on others
SettingsP1 P2
P3 P4
P1 P2
P3 P4
Lessons Learned
P1 P2
P3 P4
Lessons Learned
• Edit mode is hard to interpret• Full of strike-throughs
P1 P2
P3 P4
Lessons Learned
• Edit mode is hard to interpret• Full of strike-throughs
• Mess of multiple versions• Difficult to locate areas concerned
P1 P2
P3 P4
Lessons Learned
• Edit mode is hard to interpret• Full of strike-throughs
• Mess of multiple versions• Difficult to locate areas concerned
• Lack of interaction• Direct with the edits
CEPT - Design ?
CEPT - Interface DesignOverview
CEPT - A Use CaseStep #1: Alice Uploads an Essay
And She invites 3 friends to help:Bob, Carol, and Dave
CEPT - A Use CaseStep #2: Bob Edits on His Own
CEPT - A Use CaseStep #3: More Editors Join (Carol and Dave)
CEPT - A Use CaseStep #4: Alice Aggregates the Revisions
CEPT - A Use CaseStep #4: Alice Aggregates the Revisions
CEPT - Four Design Features
Feature #1: Aligned Sentences View
Feature #1: Aligned Sentences View
User sentence
Feature #1: Aligned Sentences View
User sentence
Automatic summary of revisions
Feature #1: Aligned Sentences View
User sentence
Automatic summary of revisions
Revision with cross-sentence edits
Feature #1: Aligned Sentences View
User sentence
Automatic summary of revisions
Revision with cross-sentence edits
Details of each summarized revision
Beyond Sentences
Many to one (Sentences are merged by others)
One to many (Sentences are merged by me)
Beyond Sentences
Many to one (Sentences are merged by others)
One to many (Sentences are merged by me)
Beyond Sentences
One to zero (One sentence is deleted by others)
Zero to one (New sentence is inserted by others)
Beyond Sentences
One to zero (One sentence is deleted by others)
Zero to one (New sentence is inserted by others)
Feature #2: Refined Edit Presentation
1. Newton lost himsself in thought of the relation between objects.
2. Newton lost himssself in thought of the relation between objects.
3. Newton lost himhisself in thought of the relation between objects.
4. Newton lost himselfhisself in thought of the relation between objects.
(Raw tracking)
(Raw tracking)
(Raw tracking)
(Word-level diff-ing)
Feature #2: Refined Edit Presentation
1. Newton lost himsself in thought of the relation between objects.
2. Newton lost himssself in thought of the relation between objects.
3. Newton lost himhisself in thought of the relation between objects.
4. Newton lost himselfhisself in thought of the relation between objects.
(Raw tracking)
(Raw tracking)
(Raw tracking)
(Word-level diff-ing)
Toggle Visibility of Deleted Text
Toggle Visibility of Deleted Text
Toggle Visibility of Deleted Text
Toggle Visibility of Deleted Text
Feature #3: Edit Summarization
…
Feature #3: Edit Summarization
…
Feature #4: Interaction with Others
Feature #4: Interaction with Others
Feature #4: Interaction with Others
CEPT - Implementation
Technique #1: Sentence Mapping
S1 S2 S3 S4 S5
S1' S2', S3' S4 Snew S5'V1:
V0:
Example
1
2
3
4
5
1) Edit in Sentences
1
2
3
4
5
2) Insert A Sentence
1
2
3
4
5
2) Insert A Sentence
1
2
3
4
5
?
3) Remove A Sentence
1
2
3
4
5
3) Remove A Sentence
1
2
3
4
5
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol:
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol:
Sharing their lives on social media becomes really necessary.excessive
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol:
Sharing their lives on social media becomes really necessary.excessive
Sharing their lives on social media becomes really necessary.over acting
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol: Sharing their lives on social media becomes really necessary.takes too much time
Sharing their lives on social media becomes really necessary.excessive
Sharing their lives on social media becomes really necessary.over acting
Technique #2: Edit Summary and Borrowing
Sharing their lives on social media becomes really necessary.Alice:
Sharing their lives on social media becomes really necessary.Bob:
Sharing their lives on social media becomes really necessary.Carol: Sharing their lives on social media becomes really necessary.takes too much time
Sharing their lives on social media becomes really necessary.becomes excessive
Sharing their lives on social media becomes really necessary.becomes over acting
Technique #2: Edit Summary and Borrowing
Carol: Sharing their lives on social media becomes really necessary.takes too much time
Alice: Sharing their lives on social media becomes really necessary.becomes excessive
Bob: Sharing their lives on social media becomes really necessary.becomes over acting
Summarized: Sharing their lives on social media becomes really necessary .3
Preliminary Evaluation
Interface #1: CEPT
Interface #2: Baseline
Design
…Initial revision Final revision Quality Evaluation
1 NS rater12 NNS participants3 NNS "Collaborators"
2 paragraphs
Design
…Initial revision Final revision Quality Evaluation
1 NS rater12 NNS participants3 NNS "Collaborators"
2 paragraphs
12 “quartets”
Results
Results
• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)
Results
• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)
• Two is better than one:• 9 out of 12 cases 4-NNSs could outperform a NS.
Results
• CEPT improves edit quality more than a plain interface:• Reducing 18% more errors (t11 = −2.54, p < .05)
• Two is better than one:• 9 out of 12 cases 4-NNSs could outperform a NS.
• CEPT draws intensive interaction• And also receives strong subjective preference.
Future Work: Field Deployment
CEPT: Collaborative Editing Tool for Non-Native Authors
Yeshuang Zhu, Shichao Yue, Chun Yu, Yuanchun Shi
http://pi.cs.tsinghua.edu.cn