3

ECS Software 2.x - Multi-Node installation Vasily.Pantyukhin@emc.com

IcreatedthisdocumenttokeeptrackofmyexperimentalinstallationofECS2.2.0.1ImadeinMarch2016.

Itisbasedontheofficialinstallationinstructionsfromgithub.combutcontainsmoredetailsand

commentsforspecificcommands’outputanddescriptionofmistakesImadeanderrorsIgot.

Allinfohereisprovidedasis.

Content

1. References..............................................................................................................................4

2. CentOSpreparation................................................................................................................42.1. Virtualmachines.....................................................................................................................................................................42.2. Installadditionalpackages.................................................................................................................................................52.3. InstallSSLcertificate.............................................................................................................................................................72.4. Checkdiskandethinterface..............................................................................................................................................7

3. InstallECS...............................................................................................................................83.1. Installationscript....................................................................................................................................................................83.2. Checkrebootpersistence.................................................................................................................................................103.3. ProblemsImetduringtheinstallation......................................................................................................................123.3.1. ProblemwithDockerCommandLineFlags.............................................................................................................123.3.2. Problemwithargparse...................................................................................................................................................133.3.3. ProblemDNS.......................................................................................................................................................................133.3.4. ProblemwithSSLcertificate........................................................................................................................................143.3.5. Problemwithauthenticationserver.........................................................................................................................14

4. ConfigureECS.......................................................................................................................154.1. Configurebyscript..............................................................................................................................................................154.2. Login..........................................................................................................................................................................................154.3. License......................................................................................................................................................................................164.4. StorageGroup,VDCandReplicationGroup.............................................................................................................174.5. Addmanagementuser.......................................................................................................................................................204.6. Createnamespace................................................................................................................................................................214.7. Addobjectuser.....................................................................................................................................................................224.8. Createbucket.........................................................................................................................................................................23

5. Checkdataaccess.................................................................................................................245.1. S3protocol..............................................................................................................................................................................245.2. Atmosprotocol.....................................................................................................................................................................265.3. Swiftprotocol........................................................................................................................................................................31

6. Appendix..............................................................................................................................346.1. ConfigurenetworkinCentOS.........................................................................................................................................346.2. CreateVMwaretemplateinCentOS............................................................................................................................356.3. AddnewdisktoCentOS....................................................................................................................................................376.4. ExtendadiskinCentOS....................................................................................................................................................38

4

1. References

Maininstruction.Verybriefanddoesn’trevealanypitfalls.

https://github.com/EMCECS/ECS-CommunityEdition/blob/master/Documentation/ECS-MultiNode-

Instructions.md

Greatsingle-nodeinstallationarticlefromKeithAnderson.IfounditwhenIalreadyinstalledmulti-node

ECSandwasupsetthatdidn’t’finditearlier.Someadvicessavealotoftime.

https://inside.emc.com/blogs/keith/2016/03/03/performing-an-ecs-22-single-node-install-on-esx-55

EMCSSLinstructions:

https://github.com/EMCECS/ECS-CommunityEdition/tree/develop/emc-ssl-cert

Single-nodeinstallationinstructionwithveryusefulcomments.

https://community.emc.com/docs/DOC-45387

ECS2.2+SwiftaccessviaCyberduckproblemisresolved.

https://asdjira.isus.emc.com:8443/browse/STORAGE-11753

2. CentOSpreparation

2.1. Virtualmachines

• FourVMsarecreated

• Checkdetailsinthescreenshotbelow

5

Actionsbelowhavetobedoneonall4CentOSnodes

2.2. Installadditionalpackages

• CheckOSversion

[root@ecsnode1~]#hostnamectlStatichostname:ecsnode1.vipr.localIconname:computer-vmChassis:vmMachineID:00b827eeef474cf5960ca71a30e0b320BootID:385b2f3220af403fa9e87443904042ebVirtualization:vmwareOperatingSystem:CentOSLinux7(Core)CPEOSName:cpe:/o:centos:centos:7Kernel:Linux3.10.0-327.el7.x86_64Architecture:x86-64

6

• Updateyum

[root@ecsnode1ECS]#yumcleanall[root@ecsnode1ECS]#yumcheck(bepatient,ittakessometime)[root@ecsnode1ECS]#yumeraseapf[root@ecsnode1ECS]#yumupgrade

• Installgit

[root@ecsnode1ECS]#yuminstallgit

• CloneECSgitrepository

[root@ecsnode1~]#mkdir/ECS[root@ecsnode1~]#cd/ECS/[root@ecsnode1ECS]#gitclonehttps://github.com/EMCECS/ECS-CommunityEdition

• InstallEPEL

Note:ExtraPackagesforEnterpriseLinux(EPEL)-isaFedoraSpecialInterestGroupthatcreates,

maintains,andmanagesasetofadditionalpackagesforEnterpriseLinux,including,butnotlimitedto

RHEL,CentOSandScientificLinux(SL),OracleLinux(OL).

[root@ecsnode1ecs-multi-node]#yuminstallepel-release

• Installpip

[root@ecsnode1~]#yuminstall-ypython-pip

• Incaseoferror-updatecertificates

[root@ecsnode1~]#yuminstall-ypython-pipFailedtosetlocale,defaultingtoCLoadedplugins:fastestmirrorLoadingmirrorspeedsfromcachedhostfileError:Cannotretrievemetalinkforrepository:epel.Pleaseverifyitspathandtryagain[root@ecsnode1~]#yumupgradeca-certificates--disablerepo=epel…DependenciesResolved===================================================================================PackageArchVersionRepositorySize===================================================================================Updating:ca-certificatesnoarch2015.2.4-65.0.1.el6_6base1.3M…Complete!

7

• Installargparsewithpip

[root@ecsnode1~]#pipinstallargparseCollectingargparse/usr/lib/python2.6/site-packages/pip/_vendor/requests/packages/urllib3/util/ssl_.py:90:InsecurePlatformWarning:AtrueSSLContextobjectisnotavailable.Thispreventsurllib3fromconfiguringSSLappropriatelyandmaycausecertainSSLconnectionstofail.Formoreinformation,seehttps://urllib3.readthedocs.org/en/latest/security.html#insecureplatformwarning.InsecurePlatformWarningDownloadingargparse-1.4.0-py2.py3-none-any.whlInstallingcollectedpackages:argparseSuccessfullyinstalledargparse-1.4.0

2.3. InstallSSLcertificate

• IfyouareinEMCnetwork-addSSLcertificate

[root@ecsnode1ECS]#cp/ECS/ECS-CommunityEdition/emc-ssl-cert/emc_ssl.pem/etc/pki/ca-trust/source/anchors/[root@ecsnode1ecs-multi-node]#update-ca-trustextract

2.4. Checkdiskandethinterface

• Checkunpartitioneddiskname

[root@ecsnode1~]#fdisk-lDisk/dev/sda:17.2GB,17179869184bytes,33554432sectorsUnits=sectorsof1*512=512bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDisklabeltype:dosDiskidentifier:0x00092f81DeviceBootStartEndBlocksIdSystem/dev/sda1*2048102604751200083Linux/dev/sda2102604833554431162641928eLinuxLVMDisk/dev/mapper/centos-root:14.9GB,14889779200bytes,29081600sectorsUnits=sectorsof1*512=512bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDisk/dev/mapper/centos-swap:1719MB,1719664640bytes,3358720sectorsUnits=sectorsof1*512=512bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytes

8

Disk/dev/sdb:108.4GB,108447924224bytes,211812352sectorsUnits=sectorsof1*512=512bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytes

• Checknetworkadaptername

[root@ecsnode3~]#ifconfigens160:flags=4163<UP,BROADCAST,RUNNING,MULTICAST>mtu1500inet10.76.246.145netmask255.255.255.0broadcast10.76.246.255inet6fe80::250:56ff:feb8:c995prefixlen64scopeid0x20<link>ether00:50:56:b8:c9:95txqueuelen1000(Ethernet)RXpackets1571962bytes1298801446(1.2GiB)RXerrors0dropped819784overruns0frame0TXpackets318bytes27355(26.7KiB)TXerrors0dropped0overruns0carrier0collisions0

3. InstallECS

3.1. Installationscript

• Letstrytoinstallmulti-nodeECS

• Executethecommandbelowonall4nodes

• Iranthe1stnodealittlebitbeforecauseithastoprovideauthenticationserviceforthreeof

others

• Important–besurethatyougetanAuthTokenwhenscriptiscompleted

• Authenticationretriesarenormal.Justwaittillthescriptissuccessfullyended.Itcantakeup20

minutes.

[root@ecsnode1ecs-multi-node]#cd/ECS/ECS-CommunityEdition/ecs-multi-node/[root@ecsnode1ecs-multi-node]#pythonstep1_ecs_multinode_install.py--ips10.76.246.14310.76.246.14410.76.246.14510.76.246.146--hostnamesecsnode1ecsnode2ecsnode3ecsnode4--ethadapterens160--diskssdb…*AreyoutryingtoconnecttoaTLS-enableddaemonwithoutTLS?*Isyourdockerdaemonupandrunning?[01/Apr/201612:50:41]INFO[root:150]CreatingtheNetwork.jsonfilewithEthernetAdapter:ens160Hostname:ecsnode1.vipr.localandIP:10.76.246.143:[01/Apr/201612:50:41]INFO[root:153]{"private_interface_name":"ens160","public_interface_name":"ens160","hostname":"ecsnode1.vipr.local","public_ip":"10.76.246.143"}[01/Apr/201612:50:41]INFO[root:179]Creatingtheseeds.examplefilewithIPaddresses:['10.76.246.143','10.76.246.144','10.76.246.145','10.76.246.146'][01/Apr/201612:50:41]INFO[root:215]Updatingthe/etc/hostsfilewiththeIP-HostnameofeachoneoftheDataNodesinthecluster

9

(Ignoring)HostnameExists:10.76.246.143ecsnode1(Ignoring)HostnameExists:10.76.246.144ecsnode2(Ignoring)HostnameExists:10.76.246.145ecsnode3(Ignoring)HostnameExists:10.76.246.146ecsnode4[01/Apr/201612:50:41]INFO[root:248]Partitioningthedisk'/dev/sdb'[01/Apr/201612:50:41]INFO[root:256]MakeFilefilesystemin'/dev/sdb1'meta-data=/dev/sdb1isize=256agcount=4,agsize=6619072blks=sectsz=512attr=2,projid32bit=1=crc=0finobt=0data=bsize=4096blocks=26476288,imaxpct=25=sunit=0swidth=0blksnaming=version2bsize=4096ascii-ci=0ftype=0log=internallogbsize=4096blocks=12927,version=2=sectsz=512sunit=0blks,lazy-count=1realtime=noneextsz=4096blocks=0,rtextents=0[01/Apr/201612:50:43]INFO[root:261]Make/ecs/uuid-1DirectoryinattachedVolume[01/Apr/201612:50:43]INFO[root:265]Mountattached/dev/dev/sdb1to/ecs/uuid-1volume.[01/Apr/201612:50:43]INFO[root:273]Datadiskalreadyenteredinfstable[01/Apr/201612:50:43]INFO[root:343]Settingtheadditionalpreparationscriptpermissions.[01/Apr/201612:50:43]INFO[root:349]Executingtheadditionalpreparationscriptin'/dev/sdb1'createfile0000createfile0001createfile0002createfile0003createfile0004createfile0005createfile0006createfile0007createfile0008…Phase1-findandverifysuperblock...Phase2-usinginternallog-scanfilesystemfreespaceandinodemaps...-foundrootinodechunkPhase3-foreachAG...-scan(butdon'tclear)agiunlinkedlists...-processknowninodesandperforminodediscovery...-agno=0-agno=1-agno=2-agno=3-processnewlydiscoveredinodes...Phase4-checkforduplicateblocks...-settingupduplicateextentlist...-checkforinodesclaimingduplicateblocks...-agno=0-agno=1-agno=2-agno=3Nomodifyflagset,skippingphase5Phase6-checkinodeconnectivity...-traversingfilesystem...

10

-traversalfinished...-movingdisconnectedinodestolost+found...Phase7-verifylinkcounts...Nomodifyflagset,skippingfilesystemflushandexiting./dev/sdb1uuid-1xfsrw,noatime,seclabel,attr2,inode64,noquota00…Tryingtopullrepositorydocker.io/emccorp/ecs-software-2.2...latest:Pullingfromemccorp/ecs-software-2.257f711ac00c0:Pullcomplete7e753bf71d17:Pullcomplete…7cf143d0c7ec:PullcompleteDigest:sha256:076ab6cf5cb3ee61be62fbdbcd145d209e474c36fe70f76cbb85e169f1acaa3dStatus:Downloadednewerimagefordocker.io/emccorp/ecs-software-2.2:latest66cdbbc654a1f8b719a843da525c67f4bbb729ed5bdc612a70a653c5828a5d1e[01/Apr/201613:23:25]INFO[root:470]ChecktheDockerprocesses.CONTAINERIDIMAGECOMMANDCREATEDSTATUSPORTSNAMES66cdbbc654a1emccorp/ecs-software-2.2:latest"/opt/vipr/boot/boot."1secondsagoUpLessthanasecondecsmultinode…[01/Apr/201613:45:56]INFO[root:594]Problemreachingauthenticationserver.Retryingshortly.ExecutinggetAuthToken:curl-i-khttps://10.76.246.143:4443/login-uroot:ChangeMe%Total%Received%XferdAverageSpeedTimeTimeTimeCurrentDloadUploadTotalSpentLeftSpeed00000000--:--:----:--:----:--:--0curl:(7)Failedconnectto10.76.246.143:4443;Connectionrefused[01/Apr/201613:46:26]INFO[root:594]Problemreachingauthenticationserver.Retryingshortly.ExecutinggetAuthToken:curl-i-khttps://10.76.246.143:4443/login-uroot:ChangeMe%Total%Received%XferdAverageSpeedTimeTimeTimeCurrentDloadUploadTotalSpentLeftSpeed1009310093008700:00:010:00:01--:--:--87AuthTokenBAAccDZDZUtqajkrbTRQTWhoM1Q5VG1iRHFSM00wPQMAjAQASHVybjpzdG9yYWdlb3M6VmlydHVhbERhdGFDZW50ZXJEYXRhOmFhMjk1ZDBjLTQ0NzktNDcxMC1iZWQ3LTZjMjkzNDY0MWY5YQIADTE0NTk1MDcyMzA2MTQDAC51cm46VG9rZW46OWM5NDU0Y2QtNjk2ZS00Njc0LWJjNmEtZDk0NzAyNzQ0YzQxAgAC0A8=[01/Apr/201613:46:57]INFO[root:702]Step1Completed.NavigatetotheadministratorwebsitethatisavailablefromanyoftheECSdatanodes.TheECSadministrativeportalcanbeaccessedfromport443.Forexample:https://ecs-node-external-ip-address.Thewebsitemaytakeafewminutestobecomeavailable.

3.2. Checkrebootpersistence

DothatonallECSnodes

• Checkifdatadiskwillbemountedafterreboot

[root@ecsnode1~]#cat/etc/fstab

11

##/etc/fstab#CreatedbyanacondaonFriMar1811:33:422016##Accessiblefilesystems,byreference,aremaintainedunder'/dev/disk'#Seemanpagesfstab(5),findfs(8),mount(8)and/orblkid(8)formoreinfo#/dev/mapper/centos-root/xfsdefaults00UUID=107b6944-c98d-4ddc-97a6-458d63052ea3/bootxfsdefaults00/dev/mapper/centos-swapswapswapdefaults00/dev/sdb1uuid-1xfsrw,noatime,seclabel,attr2,inode64,noquota00

• Checkandenablethedockerservice

[root@ecsnode1~]#systemctldocker.servicestatusUnknownoperation'docker.service'.[root@ecsnode1~]#systemctlstatusdocker.service●docker.service-DockerApplicationContainerEngineLoaded:loaded(/usr/lib/systemd/system/docker.service;disabled;vendorpreset:disabled)Active:active(running)sinceFri2016-04-0112:51:11MSK;7hagoDocs:http://docs.docker.comMainPID:10450(docker)Memory:18.4MCGroup:/system.slice/docker.service└─10450/usr/bin/dockerdaemonApr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.329066..."Apr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.337882..."Apr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.356536..."Apr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.415475..."Apr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.415524...0Apr0113:24:12ecsnode1.vipr.localdocker[10450]:2016/04/0113:24:12http:respon...nApr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.422583..."Apr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.496843..."Apr0113:24:22ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:22.498392..."Apr0113:24:23ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:23.348026..."Hint:Somelineswereellipsized,use-ltoshowinfull.[root@ecsnode1~]#systemctlenabledocker.serviceCreatedsymlinkfrom/etc/systemd/system/multi-user.target.wants/docker.serviceto/usr/lib/systemd/system/docker.service.[root@ecsnode1~]#systemctlstatusdocker.service●docker.service-DockerApplicationContainerEngineLoaded:loaded(/usr/lib/systemd/system/docker.service;enabled;vendorpreset:disabled)Active:active(running)sinceFri2016-04-0112:51:11MSK;7hagoDocs:http://docs.docker.comMainPID:10450(docker)CGroup:/system.slice/docker.service└─10450/usr/bin/dockerdaemonApr0113:24:12ecsnode1.vipr.localdocker[10450]:time="2016-04-01T13:24:12.329066..."…

12

Hint:Somelineswereellipsized,use-ltoshowinfull.

• Enablesystemdservice

[root@ecsnode1~]#cp/ECS/ECS-CommunityEdition/ecs-multi-node/systemd/docker.ecsmultinode.service/usr/lib/systemd/system/[root@ecsnode1~]#systemctlenabledocker.ecsmultinode.serviceCreatedsymlinkfrom/etc/systemd/system/multi-user.target.wants/docker.ecsmultinode.serviceto/usr/lib/systemd/system/docker.ecsmultinode.service.[root@ecsnode1~]#systemctldaemon-reload

Notes:

• Aftertherebootwaitatleast5minutesforthingstostart

• Checkecsmultinodecontainerisrunning

[root@ecsnode1~]#dockerpsCONTAINERIDIMAGECOMMANDCREATEDSTATUSPORTSNAMES66cdbbc654a1emccorp/ecs-software-2.2:latest"/opt/vipr/boot/boot."7hoursagoUp7hoursecsmultinode

• Checkifport443islistening.

[root@ecsnode1~]#netstat-an|grep:443tcp0010.76.246.143:4430.0.0.0:*LISTENtcp60010.76.246.143:909110.76.246.146:44385ESTABLISHEDtcp60010.76.246.143:920110.76.246.145:44395ESTABLISHED

3.3. ProblemsImetduringtheinstallation

3.3.1. ProblemwithDockerCommandLineFlags

ecsglobalname'DockerCommandLineFlags'isnotdefined• TofixtheproblemyouneedtoenterDockerCommandLineFlags=[]intothescript

[root@ecsnode1ecs-multi-node]#vi/ECS/ECS-CommunityEdition/ecs-multi-node/ step1_ecs_multinode_install.py#!/usr/bin/envpython#AninstallationprogramforECSSW2.1MultipleDatanodesimportargparseimportgetoptimportsubprocessfromsubprocessimportPIPE,Popenimportloggingimportlogging.configimportsysimportsocketimportos

13

importtimeimportsettingsimportre#LoggingInitializationlogging.config.dictConfig(settings.ECS_SINGLENODE_LOGGING)logger=logging.getLogger("root")DockerCommandLineFlags=[]

3.3.2. Problemwithargparse

Traceback(mostrecentcalllast):File"step1_ecs_multinode_install.py",line3,in<module>importargparseImportError:Nomodulenamedargparse

• Tofix-installargparseasdescribedintheprevioussection

3.3.3. ProblemDNS

Traceback(mostrecentcalllast):File"step1_ecs_multinode_install.py",line143,innetwork_file_funcip_address=subprocess.check_output(['hostname','-i']).rstrip('\r\n')File"/usr/lib64/python2.7/subprocess.py",line575,incheck_outputraiseCalledProcessError(retcode,cmd,output=output)CalledProcessError:Command'['hostname','-i']'returnednon-zeroexitstatus1[30/Mar/201616:32:09]CRITICAL[root:167]Abortingprogram!Pleasereviewlog.

• ItfailedcauseIforgottoconfigureDNS

• IconfiguredDNSrecords

[root@ecsnode3~]#hostname-i10.76.246.145

14

3.3.4. ProblemwithSSLcertificate

…e86f1e73f912:Pullingfslayerdba2f1894f05:Layeralreadybeingpulledbyanotherclient.Waiting.

• Tofix-installEMCSLLcertificateasdescribedintheprevioussection

3.3.5. Problemwithauthenticationserver

[01/Apr/201610:39:59]INFO[root:594]Problemreachingauthenticationserver.Retryingshortly.ExecutinggetAuthToken:curl-i-khttps://10.76.246.143:4443/login-uroot:ChangeMe%Total%Received%XferdAverageSpeedTimeTimeTimeCurrentDloadUploadTotalSpentLeftSpeed00000000--:--:----:--:----:--:--0curl:(7)Failedconnectto10.76.246.143:4443;Connectionrefused[01/Apr/201610:40:31]INFO[root:594]Problemreachingauthenticationserver.Retryingshortly.[01/Apr/201610:40:31]CRITICAL[root:597]Authenticationservicenotyetstarted.[01/Apr/201610:40:31]INFO[root:702]Step1Completed.NavigatetotheadministratorwebsitethatisavailablefromanyoftheECSdatanodes.TheECSadministrativeportalcanbeaccessedfromport443.Forexample:https://ecs-node-external-ip-address.Thewebsitemaytakeafewminutestobecomeavailable.

• Tofixtheproblem:

o Delete/datadirectory

[root@ecsnode1~]#rm-rf/datao Deletediskpartition(unmountsitfirstifneeded)

[root@ecsnode3~]#fdisk/dev/sdbWelcometofdisk(util-linux2.23.2).Changeswillremaininmemoryonly,untilyoudecidetowritethem.Becarefulbeforeusingthewritecommand.Command(mforhelp):dSelectedpartition1Partition1isdeletedCommand(mforhelp):wThepartitiontablehasbeenaltered!

o Restartinstallationscript

[root@ecsnode1ecs-multi-node]#pythonstep1_ecs_multinode_install.py--ips10.76.246.14310.76.246.14410.76.246.14510.76.246.146--hostnamesecsnode1ecsnode2ecsnode3ecsnode4--ethadapterens160--diskssdb

15

4. ConfigureECS

4.1. Configurebyscript

https://github.com/EMCECS/ECS-CommunityEdition/blob/master/Documentation/ECS-UI-

Automation.md

• Basicconfigurationcanbedonebyscript

• Bepatient,ittakesabout15-20minutes

[root@ecsnode3~]#pythonstep2_object_provisioning.py--ECSNodes=10.76.246.143,10.76.246.144,10.76.246.145,10.76.246.146--Namespace=ns1--ObjectVArray=VA1--ObjectVPool=VP1--UserName=user1--DataStoreName=DS1--VDCName=VDC1--MethodName=

Note:Iprefertomakebasicconfigurationmanuallyandfollowtheproceduredescribedinthenext

sections

4.2. Login

• Openinbrowserhttps://<node1IP>

• CheckDashboard

16

4.3. License

• Applylicense

[root@ecsnode1ecs-multi-node]#/ECS/ECS-CommunityEdition/ecs-multi-node/license.xml

17

4.4. StorageGroup,VDCandReplicationGroup

• ConfigureStoragePools

18

• ConfigureVDC

19

• AddReplicationGroup

20

4.5. Addmanagementuser

• Createadminuser

21

4.6. Createnamespace

• Configurenamespaceandaddadminuser

22

4.7. Addobjectuser

• Createuser

• GenerateS3passphraseandSwiftpassword(

• admingrouphastobespecifiedforSwiftusertobeablelistdirectories

23

4.8. Createbucket

• Createbucket

• Specifyobjusercreatedonthepreviousstep

24

5. Checkdataaccess

5.1. S3protocol

• ConfigureaccountinS3browser

• DisableSSLconnection

25

• Nowwegetaccesstothebucketwecreated

• Wecanstorenewobjects

26

5.2. Atmosprotocol

• Modifyandexecutesubtenantcreationscript

[root@ecsnode1ECS]#vicreate-subtenant.shecho"+++++++++++++++++++++++++++++++++++++++++++++++CREATESUBTENANT++++++++++++++++++++++++++++++++++++++++++++++++++++"user1="bucket1user"key1="3hI1vxPKeUuMI5OFEJqxJDGu7wJIs1oMR+HrJ6/k"endpoint="http://10.76.246.143:9022"method="PUT"atmos_path="/rest/subtenant"contentType="text/plain"date=`date-u+"%a,%d%b%Y%H:%M:%SGMT"`signstr="$method\n${contentType}\n\n\n${atmos_path}\nx-emc-date:${date}\nx-emc-uid:${user1}"sig=$(python-c"importbase64,hmac,sha;printbase64.b64encode(hmac.new(base64.b64decode(\"$key1\"),\"$signstr\",sha).digest())")subtid=$(curl-v-i-X$method-H"Content-Type:$contentType"-H"x-emc-date:$date"-H"x-emc-uid:$user1"-H"x-emc-signature:$sig"${endpoint}${atmos_path}-v|grep'subtenantID'|cut-d""-f2|tr-d''|tr-d'\r')echo"Subtenantidis..."echo$subtiduid1="${subtid}/${user1}"echo"UIDstringis:"echo$uid1

27

[root@ecsnode1ECS]#chmod+xcreate-subtenant.sh[root@ecsnode1ECS]#./create-subtenant.sh+++++++++++++++++++++++++++++++++++++++++++++++CREATESUBTENANT++++++++++++++++++++++++++++++++++++++++++++++++++++*Abouttoconnect()to10.76.246.143port9022(#0)*Trying10.76.246.143...%Total%Received%XferdAverageSpeedTimeTimeTimeCurrentDloadUploadTotalSpentLeftSpeed00000000--:--:----:--:----:--:--0*Connectedto10.76.246.143(10.76.246.143)port9022(#0)>PUT/rest/subtenantHTTP/1.1>User-Agent:curl/7.29.0>Host:10.76.246.143:9022>Accept:*/*>Content-Type:text/plain>x-emc-date:Fri,01Apr201614:14:17GMT>x-emc-uid:bucket1user>x-emc-signature:pBW2mg8rstqap9SP8e3aIDix8uM=>00000000--:--:--0:00:01--:--:--0<HTTP/1.1204NoContent<subtenantID:80f4b7fc83944eca8a5822f0348a1d7b<x-emc-request-id:0a4cf68f:153d16724f2:12b:3<Server:Jetty(7.6.4.v20120524)<00000000--:--:--0:00:01--:--:--0*Connection#0tohost10.76.246.143leftintactSubtenantidis...80f4b7fc83944eca8a5822f0348a1d7bUIDstringis:80f4b7fc83944eca8a5822f0348a1d7b/bucket1user

• Checkifthebucketiscreated

• Forsomereasontheownerofthebucketisroot

28

• Modifysubtenant’sowner

• AddaccountintoAtmosChromeplugin

29

• UploadobjectinNamespaceview

• UploadobjectinObjectview

• AddaccountinAtmosFox

30

• TheuploadedobjectisvisibleinNamespaceview

• NothingvisibleinObjectview

31

• TypeObjectIDintheFindfield

• NowobjectisvisibleintheObjectviewaswell

5.3. Swiftprotocol

• CreateCyberduckprofile

32

• Loginusingtheprofile

• CreatenewFolder

33

• Uploadfile

• Fileissuccessfullyuploaded

34

6. Appendix

6.1. ConfigurenetworkinCentOS

• InCentOSConsole

• Don’tforgettospecifynetmaskinaddress(/24)

[root@localhost~]#nmtui-edit

• Checkthenetworkconfig

[root@localhost~]#cat/etc/sysconfig/network-scripts/ifcfg-ens160TYPE=EthernetBOOTPROTO=noneDEFROUTE=yesIPV4_FAILURE_FATAL=noIPV6INIT=yesIPV6_AUTOCONF=yesIPV6_DEFROUTE=yesIPV6_FAILURE_FATAL=noNAME=ens160UUID=d3138700-7057-425d-b0cb-57628a60823eDEVICE=ens160ONBOOT=yesIPADDR=10.76.246.143PREFIX=32GATEWAY=10.76.246.1DNS1=10.76.246.101DOMAIN=vipr.localIPV6_PEERDNS=yesIPV6_PEERROUTES=yesIPV6_PRIVACY=no

35

[root@localhost~]#cat/etc/resolv.conf#GeneratedbyNetworkManagersearchvipr.localnameserver10.76.246.101nameserver10.64.86.33

• Restartnetwork

[root@localhost~]#systemctlrestartnetwork

• Configurehostname

[root@localhost~]#hostnamectlset-hostnameecsnode1.vipr.local[root@localhost~]#hostnameecsnode1.vipr.local

• ThereisnoifconfigInminimalCentOS7.1configuration

• Letsinstallit

[root@localhost~]#yuminstallnet-tools…Installed:net-tools.x86_640:2.0-0.17.20131004git.el7Complete![root@localhost~]#ifconfigens160:flags=4163<UP,BROADCAST,RUNNING,MULTICAST>mtu1500inet10.76.246.143netmask255.255.255.0broadcast10.76.246.255inet6fe80::250:56ff:feb8:d453prefixlen64scopeid0x20<link>ether00:50:56:b8:d4:53txqueuelen1000(Ethernet)RXpackets13173bytes14751981(14.0MiB)RXerrors0dropped1972overruns0frame0TXpackets4420bytes439972(429.6KiB)TXerrors0dropped0overruns0carrier0collisions0

6.2. CreateVMwaretemplateinCentOS

• Installopenvmtools

Notes:

KBarticlewhichdescribesLinuxcustomizationpackageinstallationishere:

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId

=2075048

36

• InstallVMwaretools

[root@ecsnode1keys]#yuminstallopen-vm-tools…Installed:open-vm-tools.x86_640:9.10.2-4.el7Complete![root@ecsnode1keys]#vmware-toolbox-cmd-v9.10.2.48224(build-2822639)

NotesGuestcustomizationplug-inisavailablefromVMwarecalledthedeployPkgToolsPlug-inopen-vm-tools9.10.xincludesthefunctionalityprovidedbyopen-vm-tools-deploypkgandthereisnoneedtoinstallthisadditionalpackage.

• Installadditionalpackages

[root@ecsnode1~]#yuminstallnet-tools[root@ecsnode1~]#yuminstallperlgccmakekernel-headerskernel-devel-y

• CloneVMtothetemplate

• SelectDataStoreandThinProvisioningoption

37

6.3. AddnewdisktoCentOS

[root@ecsnode1ECS]#echo"---">/sys/class/scsi_host/host0/scan[root@ecsnode1ECS]#echo"---">/sys/class/scsi_host/host1/scan[root@ecsnode1ECS]#echo"---">/sys/class/scsi_host/host2/scan[root@ecsnode1ECS]#fdisk-l2>/dev/null|egrep'^Disk'|egrep-v'dm-'|wc-l10[root@ecsnode1ECS]#fdisk-lDisk/dev/sda:2147MB,2147483648bytes255heads,63sectors/track,261cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0x0003ea29DeviceBootStartEndBlocksIdSystem/dev/sda1*16451200083LinuxPartition1doesnotendoncylinderboundary./dev/sda26426215841288eLinuxLVMPartition2doesnotendoncylinderboundary.Disk/dev/sdb:214.7GB,214748364800bytes255heads,63sectors/track,26108cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytes

38

Diskidentifier:0x00000000Disk/dev/mapper/VolGroup-lv_root:1405MB,1405091840bytes255heads,63sectors/track,170cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0x00000000Disk/dev/mapper/VolGroup-lv_swap:213MB,213909504bytes255heads,63sectors/track,26cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0x00000000Disk/dev/sdc:17.2GB,17179869184bytes255heads,63sectors/track,2088cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0x00000000

• Alternativemethodtorescanscsibus

[root@ecsnode1ECS]#yuminstallsg3_utils[root@ecsnode1ECS]#./rescan-scsi-bus.sh

6.4. ExtendadiskinCentOS

https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalI

d=1006371

• Createnewpartition

[root@ecsnode1ECS]#fdisk/dev/sdcDevicecontainsneitheravalidDOSpartitiontable,norSun,SGIorOSFdisklabelBuildinganewDOSdisklabelwithdiskidentifier0xd20a5af4.Changeswillremaininmemoryonly,untilyoudecidetowritethem.Afterthat,ofcourse,thepreviouscontentwon'tberecoverable.Warning:invalidflag0x0000ofpartitiontable4willbecorrectedbyw(rite)WARNING:DOS-compatiblemodeisdeprecated.It'sstronglyrecommendedtoswitchoffthemode(command'c')andchangedisplayunitstosectors(command'u').Command(mforhelp):p

39

Disk/dev/sdc:17.2GB,17179869184bytes255heads,63sectors/track,2088cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0xd20a5af4DeviceBootStartEndBlocksIdSystemCommand(mforhelp):nCommandactioneextendedpprimarypartition(1-4)pPartitionnumber(1-4):1Firstcylinder(1-2088,default1):Usingdefaultvalue1Lastcylinder,+cylindersor+size{K,M,G}(1-2088,default2088):Usingdefaultvalue2088Command(mforhelp):tSelectedpartition1Hexcode(typeLtolistcodes):8eChangedsystemtypeofpartition1to8e(LinuxLVM)Command(mforhelp):pDisk/dev/sdc:17.2GB,17179869184bytes255heads,63sectors/track,2088cylindersUnits=cylindersof16065*512=8225280bytesSectorsize(logical/physical):512bytes/512bytesI/Osize(minimum/optimal):512bytes/512bytesDiskidentifier:0xd20a5af4DeviceBootStartEndBlocksIdSystem/dev/sdc11208816771828+8eLinuxLVMCommand(mforhelp):wThepartitiontablehasbeenaltered!Callingioctl()tore-readpartitiontable.Syncingdisks.

• Convertthenewpartitiontoaphysicalvolume

[root@ecsnode1ECS]#pvcreate/dev/sdc1Physicalvolume"/dev/sdc1"successfullycreated[root@ecsnode1ECS]#pvdisplay"/dev/sdc1"isanewphysicalvolumeof"15.99GiB"---NEWPhysicalvolume---PVName/dev/sdc1VGNamePVSize15.99GiB

40

AllocatableNOPESize0TotalPE0FreePE0AllocatedPE0PVUUIDc4Nizb-1y31-ToVB-lDru-Chtx-ZJwJ-NaYj7N

• FindouthowyourVolumeGroupiscalled

[root@ecsnode1ECS]#vgdisplay---Volumegroup---VGNameVolGroupSystemIDFormatlvm2MetadataAreas1MetadataSequenceNo3VGAccessread/writeVGStatusresizableMAXLV0CurLV2OpenLV2MaxPV0CurPV1ActPV1VGSize1.51GiBPESize4.00MiBTotalPE386AllocPE/Size386/1.51GiBFreePE/Size0/0VGUUIDQu7zi0-sSpz-PoLS-OBdG-n4q7-XIXc-lihtGm

• ExtendthatVolumeGroupbyaddingthenewlycreatedphysicalvolumetoit.

[root@ecsnode1ECS]#vgextendVolGroup/dev/sdc1Volumegroup"VolGroup"successfullyextended[root@ecsnode1ECS]#vgdisplay---Volumegroup---VGNameVolGroupSystemIDFormatlvm2MetadataAreas2MetadataSequenceNo4VGAccessread/writeVGStatusresizableMAXLV0CurLV2OpenLV2MaxPV0CurPV2ActPV2VGSize17.50GiBPESize4.00MiB

41

TotalPE4480AllocPE/Size386/1.51GiBFreePE/Size4094/15.99GiBVGUUIDQu7zi0-sSpz-PoLS-OBdG-n4q7-XIXc-lihtGm

• Checkthenewlyaddedphysicalvolumeandtheusablespace.

[root@ecsnode1ECS]#pvscan/dev/sdb:readfailedafter0of4096at214748299264:Input/outputerror/dev/sdb:readfailedafter0of4096at214748356608:Input/outputerrorPV/dev/sda2VGVolGrouplvm2[1.51GiB/0free]PV/dev/sdc1VGVolGrouplvm2[15.99GiB/15.99GiBfree]Total:2[17.50GiB]/inuse:2[17.50GiB]/innoVG:0[0]

• ExtendLogicalVolume.

[root@ecsnode1ECS]#lvextend-L+15.99G/dev/VolGroup/lv_rootRoundingsizetoboundarybetweenphysicalextents:15.99GiBExtendinglogicalvolumelv_rootto17.30GiBLogicalvolumelv_rootsuccessfullyresized[root@ecsnode1ECS]#lvdisplay---Logicalvolume---LVPath/dev/VolGroup/lv_rootLVNamelv_rootVGNameVolGroupLVUUIDPEPZl0-qAVh-S2j6-dxOx-2sWk-QHfc-f2KJK4LVWriteAccessread/writeLVCreationhost,timelocalhost.localdomain,2014-12-2521:09:29+0400LVStatusavailable#open1LVSize17.30GiBCurrentLE4429Segments2AllocationinheritReadaheadsectorsauto-currentlysetto256Blockdevice253:0---Logicalvolume---LVPath/dev/VolGroup/lv_swapLVNamelv_swapVGNameVolGroupLVUUID1BRC2j-Vr84-2zT7-vnSB-u2YC-mZmG-zmxnpDLVWriteAccessread/writeLVCreationhost,timelocalhost.localdomain,2014-12-2521:09:30+0400LVStatusavailable#open1LVSize204.00MiBCurrentLE51Segments1AllocationinheritReadaheadsectorsauto

42

-currentlysetto256Blockdevice253:1

• Resizethefilesystemtothevolumegroup,sowecanusethespace.

[root@ecsnode1ECS]#df-hFilesystemSizeUsedAvailUse%Mountedon/dev/mapper/VolGroup-lv_root1.3G1.3G0100%/tmpfs7.8G07.8G0%/dev/shm/dev/sda1485M33M427M8%/boot[root@ecsnode1ECS]#resize2fs/dev/VolGroup/lv_rootresize2fs1.41.12(17-May-2010)Filesystemat/dev/VolGroup/lv_rootismountedon/;on-lineresizingrequiredolddesc_blocks=1,new_desc_blocks=2Performinganon-lineresizeof/dev/VolGroup/lv_rootto4535296(4k)blocks.Thefilesystemon/dev/VolGroup/lv_rootisnow4535296blockslong.[root@ecsnode1ECS]#df-hTFilesystemTypeSizeUsedAvailUse%Mountedon/dev/mapper/VolGroup-lv_rootext418G1.3G15G8%/tmpfstmpfs7.8G07.8G0%/dev/shm/dev/sda1ext4485M33M427M8%/boot