Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

Introduction and Early Experiences with the SME & HPSS integration

Kamran YousafJaime Pinto

Storage Made Easy - Briefing

Rationale/Use Case

Rationale for SME:

Attract a new host of researchers that work primarily from their desktops, and who still need a place “in the cloud” to archive their data.

HSI/HTAR: power users – internal transfers

Globus/DSI: power users – cross site transfers

SME: light users – web transfers, dropbox, remote drives

Intended/typical use of the HPSS clients at SciNet

3

What Storage Made Easyprovides


Enterprise File Share and Sync fabricBridge & control public/private Storage Assets

5

SME Features


Provides a controlled access point

Web File Manager

Support all Mobiles / Tablets natively

(iOS, Android, Windows Phone, BlackBerry)

Native Cloud Drives, sync Apps & Mail integration(Windows, Mac & Linux)

For all data assets no matter where they reside

Manage & secure all company data in on place

Federated data access


Connectors to over 50 public / private Storage and Saas Providers

Storage Connectors


Protect, secure and promote access visiblity

Data Secure Features


Secure File Sharing -Password protected-Time Expiry

Controlled encryption- SHA-256

Audit-Export to Excel CSV-Output to Syslog format

Cloud Governance-Set Policies-Control all sharing features File versioning

locking, trashGEO Location controls

Across data silosFocus on Governance and Compliance


Single-Sign-On-For LDAP & Active Directory

Data Retention policiesLegal Hold

File Alerts- Real-Tme file access alerts File Versioning

- File versioning retention

Integrates with LDAP and Active Directory for Single-Sign-OnIdentity Management



Data is not tampered withNo lock in. Easy to migrate. Accessible over other channels and Apps.

Files view in storage Console of other EFSS Apps

Files view in storage consoleof SME data

Built in collaboration that work across data silos

Built in Collaboration


Web office editing(Best of breed) (Cloud to desktop editing)

File Commenting(& notifications)

PDF Annotation editing(multi-user support) Secure File and

Folder Sharing (+ versioning & notifications)

Bookmark links(& notifications)

Project WorkSpaces(create virtual workspacesAcross Storage Silos)

Highly Available


1

HPSS Journey


Start of Journey

• 6 months ago Jaime watched SME in a webinar and became interested in integrating SME with SciNet

• How to bridge the gap between a product built for Cloud (SME) and Mature product

• Initial setup was challenging, during trial the appliance was behind multiple firewalls

• HTTP/S access was through a sequence of ssh tunnels, we had problems with hostnames and outbound access

• Web UI was not working because of tunneling and hostnames


First Attempt HPSS/FTP

• Out of box SME provides an FTP connector

• HPSS provides a FTP interface

• The FTP interface worked with minor changes

Problems

• Getting the listing was very slow

• Had to open a lot of ports

• No unified login


Second Attempt HPSS/API

• Looked promising at the start

• HPSS provides shell binaries to access HPSS

• The API is stable, then

HPSS Upgrade!!!

• The API binaries are now only supported on CentOS 6.6 and CentOS 7

• SME is based on CentOS 5.11

• To authenticate on the SciNet test environment we had to use keytab files


Eureka (VFS-Fuse)

• HPSS now also supports VFS Fuse

• VFS Fuse exposes HPSS as a Virtual File System

• VFS Fuse Honors user permissions

• SME already has a provider for CIFS

• SME writing a Storage Provider to integrate with HPSS using VFS-Fuse


Eureka (VFS-Fuse)

• SME will authenticate a user via LDAP and use the same credentials to access HPSS (Single Sign on)

• User’s HPSS data will be immediately available using all the SME tools

• Release date: First week of October (for now still over and NFS mount on the appliance)


Futures

• SME will be upgraded to CentOS 7

• VFS FUSE will be supported directly on Appliance• Initial release will be at SciNet and then generally

available

• Make your HPSS system Cloud aware!


Futures


Futures


Futures


Summary

• Private Enterprise File Share & Sync fabric

• Works with HPSS and any other Storage combination

• Planned HPSS release date first week of October

• Does not ‘tamper’ with data

• Fully brandable

• Integrates with LDAP / Active directory

• Enables Cloud Governance / Security features for all corporate data assets

• Strong Collaboration features

• Build in BYOD & integrates with best-of-breed

• Private ‘Google’ for all corporate data


Storage Made [email protected]@storagemadeeasy.com

Questions ?

Storage Made Easy - Sales Briefing

Storage Made Easy

Date post:	15-Apr-2017
Category:	Software
Upload:	storage-made-easy
View:	2,477 times
Download:	0 times

Integrating HPSS with Storage Made Easy Enterprise File Sync and Share

Software