© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---1

Two Unique Challenges NetApp has tackled while Implementing Machine Translation

Yukako Ueda APAC Global Content Lead, NetApp & Chapter Manager, Women in Localization Japan Apr. 19, 2016

Company Snapshot

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---2

Providing with software, systems, and services to manage and store data

FY15 revenue: $6.1 billion

Over 12,000 employees in more than 150 offices worldwide

13 consecutive years on FORTUNE Magazine's "100 Best Companies" list

FORTUNE 500® Company

Creator of Data ONTAP, the worlds #1 branded storage operating system2

Member of S&P 500 and NASDAQ

Recognized by Great Place to Work Institute3

#1 “Best Companies to Work for in Europe” list #4 “World’s Best Multinational Workplaces” list #5 “Best Companies to Work for in APAC” list #9 “Great Place to Work in Japan” list

1. From FORTUNE® Magazine, June 15, 2015 ©2015 Time Inc. FORTUNE®, and FORTUNE 500® are registered trademarks of Time Inc. and are used under License. FORTUNE and Time Inc. are not affiliated with, and do not endorse products or services of, NetApp.

2. IDC Worldwide Quarterly Enterprise Storage Systems Tracker 2015 Q4,  March 2016 (Open Networked Enterprise Storage Systems revenue)3. Copyright © 2015 GREAT PLACE TO WORK® INSTITUTE, INC.

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---3

Questions to start using Machine Translation…

What type of content would you choose? Technical? Marketing ? We chose both!

Which language would you select? French? German? Spanish? Portuguese? Chinese? Japanese? We chose Japanese and Simplified Chinese

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---4

To determine what type of content we should choose…

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---5

To determine what type of content we should choose…

STEP 1• Pilot Raw MT

Project for KB Articles

STEP 2• Pilot MT+PE

Projects for both Marketing and Technical contents

STEP 3• Deploy MTPE

for production

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---6

STEP1: MT deployed for KB Articles for 5 languagesSelect the language

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---7

STEP1: MT deployed for KB Articles for 5 languagesLatest or frequently-viewed Japanese articles are shown

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---8

STEP1: MT deployed for KB Articles for 5 languagesThe article is shown in English if MT has never run before

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---9

The article is Machine Translated into Japanese as soon as you select “ 日本語” STEP1: MT deployed for KB Articles for 5 languages

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---10

STEP2: MT+PE Pilot projects for productionPerform Full and Light PE for both Marketing and Technical projects

MT Engine Retraining

Quality Level Definition

Post Edit Guidelines

Post Edit evaluation Form

Form for MT output feedback

Pricing and SLAs

Which vendor is best for PE for which content type

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---11

STEP 3: Deploy MTPE for productionReady for various projectsCurrent Content Classification

Customer Success Story

Epic Story

Product & Solutions Customer Presentation

Video

Product UI

Legal (currently) Option with waiver, no QA (exception as NO SLAs are ensured) NDA, good for small # of languages

GUI Test

Community

Social Media

Knowledge Base Article

Customer Support Self-Service

Chat

Instant Messaging

Online Help

Express Guide

Technical Report

Technical White Paper

Product Manual

Customer Support Site

Datasheet, Solution Brief, Service Brief

Marketing White Paper

Level 2 & 3 Web

NetAppU

Campaign Landing Page

Web Landing Page

Banner

Press Release

Demand Gen Email

Highly Creative Brand Educational Technical/Support High Volume Real Time Fast Track

Well-defined process in place In progress Process needs development In progress Process needs development

Localization Model

QA Model

Teams

Workflow Model

Traditional

100% Review

Certified Translation Teams

TMS

Traditional

50-70% Review

Certified Translation Teams

TMS

Traditional

30-50% Review

Certified Translation Teams

TMS

Machine Translation + PE

Post Edit and Spot Check

MT Post Editors and GCM

TMS & MT

Raw Machine Translation

Post Edit if needed

MT Post Editors

TMS & MT

Raw Machine Translation Traditional

No Review

n/a

TMS Vendor Portal

Approved Vendor

No Review

© 2015 NetApp, Inc. All rights reserved. NetApp Proprietary. Internal Use Only12

STEP 3: Deploy MTPE for productionDecision matrix

Content survey Is OK to RAW MT Is OK to PE Is HT

Content repository Yes Yes Yes

Languages All* (7 Trained ) 7 Languages 12 Core languages

MT engine quality (based on TMs leveraging) and reuse Only High confidence 7 languages All

Content type based on the content classification

Technical, low visibility, low traffic Any technical

High visibility, banners, High touch Marketing, etc.,

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---13

Which language to start using MT for?

NetApp Confidential - Internal Use Only14

Japanese and Simplified Chinese were selectedStarted MT with 2 APAC Languages

Starting from the languages with the highest volume to get the highest outcome

Choosing the languages having the biggest corpus for both Marketing and Technical projects for the effective training of the MT engine

Starting from the toughest languages to leverage the successful methods easy to the remaining languages

© 2015 NetApp, Inc. All rights reserved. NetApp Proprietary. Internal Use Only15

NetApp’s QA model

To comply with NetApp’s high quality standards, additional review step was added after PE

NetApp’s GCMs conduct review and compile feedback

Feedback is being categorized and submitted to engine training team for retraining and shared with vendors for learning (feedback loop)

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---16

Basic Workflow

TMS Project is kicked off

MT is run by NetApp PM

Post Editor is assigned by Vendor

PM

Post Edit is done following Post Edit

Guidelines

Post Edited content is submitted with the MT engine

quality Feedback form

Post Edit is evaluated by

NetApp Global Content Manager

DTP is done by Vendor Engineer

DTPed content is reviewed by NetApp GCM (and the local

stakeholder)

Update is made and the project is completed.

Final file is submitted to the

requester

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---17

Acrolinx

NetAppU – fully implemented

Marketing – in progress

Product Manuals – to be trained next

Technical Reports – to be planned

Effort is being made by a specific project

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---18

Feedback LoopForm was created and communicated with the vendors

© 2016 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---19

Thank You.

© 2015 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use 20

Come and join us! ~ Women in Localization Japan ~