7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 1/27

Introduction and Early Experiences withthe SME & HPSS integration

Kamran Yousaf Jaime Pinto

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 2/27

Storage Made Easy - Briefing

Rationale/Use Case

Rationale for SME:

Attract a new host of researchers that work primarily fromtheir desktops, and who still need a place “in the cloud” toarchive their data.

HSI/HTAR: power users – internal transfers

Globus/DSI: power users – cross site transfers

SME: light users – web transfers, dropbox,remote drives

Intended/typical use of the HPSS clients at SciNet

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 3/27

What Storage Made Easyprovides

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 4/27

Storage Made Easy - Briefing

Enterprise File Share and Sync fabric

Bridge & control public/private Storage Assets

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 5/27

SME Features

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 6/27

Storage Made Easy - Briefing

Provides a controlled access point

Web File Manager

Support all Mobiles / Tabletsnatively

(iOS, Android, Windows Phone, BlackBerry)

Native Cloud Drives, syncApps & Mail integration

(Windows, Mac & Linux)

For all data assets no matter where they reside

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 7/27

Manage & secure all company data in on place

Federated data access

Storage Made Easy - Briefing

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 8/27

Connectors to over 50 public / private Storage andSaas Providers

Storage Connectors

Storage Made Easy - Briefing

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 9/27

Protect, secure and promote access visiblity

Data Secure Features

Storage Made Easy - Briefing

Secure File Sharing-Password protected-Time Expiry

Controlled encryption- SHA-256

Audit-Export to Excel CSV-Output to Syslog format

Cloud Governance-Set Policies-Control all sharing features File versioning

locking, trashGEO Location controls

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 10/27

Across data silos

Focus on Governance and Compliance

Storage Made Easy - Briefing

Single-Sign-On-For LDAP & Active Directory

Data Retention policiesLegal Hold

File Alerts- Real-Tme file access alerts

File Versioning- File versioning retention

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 11/27

Integrates with LDAP and Active Directory for Single-Sign-On

Identity Management

Storage Made Easy - Briefing

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 12/27Storage Made Easy - Briefing

Data is not tampered with

No lock in. Easy to migrate. Accessible over otherchannels and Apps.

Files view in storageConsole of other EFSS Apps

Files view in storage consoleof SME data

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 13/27

Built in collaboration that work across data silos

Built in Collaboration

Storage Made Easy - Briefing

Web office editing(Best of breed)

(Cloud to desktop editing)

File Commenting(& notifications)

PDF Annotation editing(multi-user support) Secure File and

Folder Sharing(+ versioning & notifications)

Bookmark links(& notifications)

Project WorkSpaces(create virtual workspaces

Across Storage Silos)

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 14/27

Highly Available

Storage Made Easy - Briefing

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 15/27

HPSS Journey

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 16/27Storage Made Easy - Briefing

Start of Journey

! 6 months ago Jaime watched SME in a webinar and

became interested in integrating SME with SciNet

! How to bridge the gap between a product built for Cloud (SME)and Mature product

!Initial setup was challenging, during trial the appliance wasbehind multiple firewalls

! HTTP/S access was through a sequence of ssh tunnels, we had

problems with hostnames and outbound access

! Web UI was not working because of tunneling and hostnames

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 17/27Storage Made Easy - Briefing

First Attempt HPSS/FTP

! Out of box SME provides an FTP connector

! HPSS provides a FTP interface

! The FTP interface worked with minor changes

Problems

! Getting the listing was very slow

!

Had to open a lot of ports

! No unified login

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 18/27Storage Made Easy - Briefing

Second Attempt HPSS/API

! Looked promising at the start

! HPSS provides shell binaries to access HPSS

! The API is stable, then

HPSS Upgrade!!!

! The API binaries are now only supported onCentOS 6.6 and CentOS 7

! SME is based on CentOS 5.11

! To authenticate on the SciNet test environment we had to usekeytab files

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 19/27Storage Made Easy - Briefing

Eureka (VFS-Fuse)

!

HPSS now also supports VFS Fuse

! VFS Fuse exposes HPSS as a Virtual FileSystem

! VFS Fuse Honors user permissions

! SME already has a provider for CIFS

! SME writing a Storage Provider to integrate withHPSS using VFS-Fuse

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 20/27

Storage Made Easy - Briefing

Eureka (VFS-Fuse)

! SME will authenticate a user via LDAP and use thesame credentials to access HPSS (Single Sign on)

!

User’s HPSS data will be immediately availableusing all the SME tools

! Release date: First week of October (for now still

over and NFS mount on the appliance)

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 21/27

Storage Made Easy - Briefing

Futures

! SME will be upgraded to CentOS 7

! VFS FUSE will be supported directly on Appliance!

Initial release will be at SciNet and then generallyavailable

! Make your HPSS system Cloud aware!

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 22/27

Storage Made Easy - Briefing

Futures

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 23/27

Storage Made Easy - Briefing

Futures

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 24/27

Storage Made Easy - Briefing

Futures

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 25/27

Storage Made Easy - Briefing

Summary

! Private Enterprise File Share & Sync fabric

! Works with HPSS and any other Storage combination

! Planned HPSS release date first week of October

! Does not ‘tamper’ with data

! Fully brandable

! Integrates with LDAP / Active directory

! Enables Cloud Governance / Security features for allcorporate data assets

! Strong Collaboration features

! Build in BYOD & integrates with best-of-breed

! Private ‘Google’ for all corporate data

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 26/27

Storage Made Easy - Briefing

Storage Made Easy

kamran@storagemadeeasy.com

giada@storagemadeeasy.com

d

7/17/2019 Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

http://slidepdf.com/reader/full/integrating-hpss-with-storage-made-easy-enterprise-file-sync-and-share 27/27

Questions ?

Storage Made Easy