Home >Documents >Hands-On Lab: NetApp StorageGRID Webscale 10 · PDF file3 Lab Environment ... Hands-On Lab:...

Hands-On Lab: NetApp StorageGRID Webscale 10 · PDF file3 Lab Environment ... Hands-On Lab:...

Date post:23-Mar-2018
Category:
View:306 times
Download:14 times
Share this document with a friend
Transcript:
  • Hands-On Lab: NetApp StorageGRIDWebscale 10.3

    March 2017 | SL10303 Version 3.1

  • Hands-On Lab: NetApp StorageGRID Webscale 10.32 2017 NetApp, Inc. All rights reserved. NetApp Proprietary

    TABLE OF CONTENTS

    1 Introduction to Object Storage...................................................................................................... 3

    2 Introduction to this Lab..................................................................................................................6

    2.1 Lab Objectives........................................................................................................................... 6

    2.2 Prerequisites.............................................................................................................................. 6

    3 Lab Environment............................................................................................................................. 7

    4 Lab Activities................................................................................................................................... 9

    4.1 Lab Tools Overview...................................................................................................................9

    4.2 Connect to Admin GUI............................................................................................................10

    4.3 S3 Account Management........................................................................................................14

    4.4 Configure S3 Client................................................................................................................. 18

    4.5 Create S3 Buckets...................................................................................................................21

    4.6 Examine ILM Rules..................................................................................................................24

    4.7 Create New ILM rules..............................................................................................................25

    4.8 Activate ILM rules....................................................................................................................36

    4.9 Ingest data and Validate Data Placement............................................................................. 39

    4.10 Validate ILM policy has been applied..................................................................................42

    4.11 ILM Re-evaluation..................................................................................................................46

    4.12 S3 Versioning.........................................................................................................................52

    4.13 Configure a Swift Client........................................................................................................63

    4.14 Configure the NAS Bridge....................................................................................................68

    4.15 Exploring S3 and Swift APIs................................................................................................ 82

    4.15.1 Access to S3 via the AWS CLI........................................................................................................................ 83

    4.15.2 Access to S3 through Python...........................................................................................................................86

    4.15.3 Access to Swift through the CLI.......................................................................................................................87

    4.15.4 Access to Swift Using Python.......................................................................................................................... 88

    5 Version History.............................................................................................................................. 90

  • Hands-On Lab: NetApp StorageGRID Webscale 10.33 2017 NetApp, Inc. All rights reserved. NetApp Proprietary

    1 Introduction to Object StorageObject storage is a little different than the familiar block and file storage. It organizes data into flexibly sizeddata containers called objects. Objects are stored in a flat namespace that may span multiple locations. Eachobject has both data (an un-interpreted sequence of bytes), and metadata (a unique ID plus an extensible set ofattributes that describe the object). Data stored using object storage is typically accessed by a client applicationusing an object protocol or API, rather than at the user level (accessing a file). A simple way to think about thisis that object storage is like valet parkingyou give the valet your ticket, and you get your car back without everneeding to know anything about where the car was parked. The advantage of this approach is that data can bereferenced and retrieved just by providing the unique ID.

    Figure 1-1: Object Storage Concepts

    Three trends are contributing to increasing interest in object storage:

    Continued growth in the amount of unstructured data necessitates a new approach to storing andprotecting data. Object-enabled data management facilitates intelligent data placement to meet a widerange of performance, durability, availability, location, and longevity requirements.

    Enterprises are increasingly coping with decentralized data creation and consumption. The "primarydata center plus DR data center" model is being replaced by a multisite approach in which users,workloads, and data are brought closer together.

    The hybrid cloud is providing new options to balance cost and performance, and IT teams are looking athow they can best leverage both on-premises and cloud-based storage.

    The Opportunity:

    Storage growth to billions of objects. Decentralized data production and global distribution is driving new data management approaches to

    reduce operation costs and complexity. Due to data sovereignity, performance, cost, or a combination of all three, a hybrid cloud with both on-

    premises and clooud-based storage is a requirement.

    Use Cases

    StorageGRID Webscale is extremely well suited for web data repositories, data archives, and media repositories.Each of these use cases has its own distinct set of requirements, but StorageGRID Webscale adapts toaccommodate the wide variety of needs encompassed in this set of use cases.

  • Hands-On Lab: NetApp StorageGRID Webscale 10.34 2017 NetApp, Inc. All rights reserved. NetApp Proprietary

    Figure 1-2: Use Cases for Object Storage

    Web Data Repositories

    Web data repositories are characterized by small object size, high object count, and high transactions. Because itcan handle up to 100 billion objects in a single repository distributed across many locations and with S3, Swift andCDMI API support, StorageGRID Webscale is well suited for this use case.

    Data Archives

    Increasingly, enterprises are storing massive amounts of data for extended periods to satisfy both corporategovernance and legal requirements. With data archives of this type, cost and management are typically the mostimportant concerns. Long access latency is tolerated in exchange for reduced cost. StorageGRID Webscalesatisfies this use case with tape integration, proven data durability, and flexible, policy based management.

    Media Repositories

    Media repositories are characterized by large object sizes, with the need for geographical distribution, a need fordata integrity, and a low time-to-first byte latency. The geographically distributed, durable design of StorageGRIDWebscale satisfies these requirements. It also supports ranged reads, so, for example, a video can be streamedfrom any point without having to download the entire object.

    Introduction to StorageGRID Webscale

    The StorageGRID Webscale system is a distributed object storage system that stores, protects, and preservesfixed-content data over long periods of time. By employing a grid architecture that distributes copies of objectdata throughout the system, a highly reliable system is created where data is continuously available. If onepart of the system goes down, another immediately takes over, which results in objects always being availablefor retrieval. To implement this architecture, the StorageGRID Webscale system employs a system of networkconnected servers hosting grid nodes. These grid nodes host a collection of one or more services, each providinga set of capabilities to the StorageGRID Webscale system. To manage objects ingested into the system, theStorageGRID Webscale system employs metadata based information lifecycle management (ILM) rules. TheseILM rules determine what happens to an objects data after it is ingestedwhere it is stored, how it is protectedfrom loss, and how long it is stored. The StorageGRID Webscale system operates over wide area network (WAN)links, providing the system with off-site loss protection. Copies are made and distributed throughout the systemso that objects are continuously available. In systems with multiple sites, this distribution of copies means that if asite is lost, data is not lost, and clients can seamlessly retrieve it from other sites.

    Advantages of the StorageGRID Webscale system include the following:

    Software-defined storage management for hardware independence Support for standard object storage protocols and APIs:

  • Hands-On Lab: NetApp StorageGRID Webscale 10.35 2017 NetApp, Inc. All rights reserved. NetApp Proprietary

    Simple Storage Service (S3) OpenStack Swift Cloud Data Management Interface (CDMI)

    Support for standard file system storage protocols:

    Network File System (NFS) Server Message Blo

of 91/91
Hands-On Lab: NetApp StorageGRID Webscale 10.3 March 2017 | SL10303 Version 3.1
Embed Size (px)
Recommended