Linux on Z13 and Simulatenus Multithreading - Sebastien Llaurency

9.0

27th of MayBruxells

Linux on z13 and Simultaneous Multithreading

Sébastien LLaurency

IBM Certified Expert Integration Architect

IBM Client Center Montpellier

TrademarksThe following are trademarks of the International Business Machines Corporation in the United States and/or other countries.

BladeCenetr*BlueMixCICS*COGNOS*DB2*

HiperSocketsHyperSwapIBM*IBM (logo)*Infinband*

DFSMSDFSMSdfpDFSMSdssDFSMShsmDS8000*

* Registered trademarks of IBM Corporation

Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.

IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.

All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.

This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

This information provides only general descriptions of the types and portions of workloads that are eligible for execution on Specialty Engines (e.g, zIIPs, zAAPs, and IFLs) ("SEs"). IBM authorizes customers to use IBM SE only to execute the processing of Eligible Workloads of specific Programs expressly authorized by IBM as specified in the “Authorized Use Table for IBM Machines” provided at www.ibm.com/systems/support/machine_warranties/machine_code/aut.html (“AUT”). No other workload processing is authorized for execution on an SE. IBM offers SE at a lower price than General Processors/Central Processors because customers are authorized to use SEs only to process certain types and/or amounts of workloads as specified by IBM in the AUT.

The following are trademarks or registered trademarks of other companies.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. Java and all Java based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. andLinux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. OpenStack is a trademark of OpenStack LLC. The OpenStack trademark policy is available on the OpenStack website.TEALEAF is a registered trademark of Tealeaf, an IBM Company.Windows Server and the Windows logo are trademarks of the Microsoft group of countries.Worklight is a trademark or registered trademark of Worklight, an IBM Company.UNIX is a registered trademark of The Open Group in the United States and other countries.* Other product and service names might be trademarks of IBM or other companies.

Easy Tier*ECKDFlashSystemFICON*GDPS*

IMSMQSeries*NetView*OMEGAMON*RACF*

System Storage*Tivoli*WebSphere*z13zEnterprise*

z/OS*z Systemsz/VM*z/VSE*

http://www.openstack.org/brand/openstack-trademark-policy

© 2015IBM Corporation3

Introducing z 13 innovations for Linux on z

Cloud, Analytics, Mobile & Security

Contents

Linux on z System & SMT


Mobile, social, cloud, big data and analytics are changing how we live, work and interact

40% of peoplesocialize more online than they do face-to-face

300x growthof digital content between

2005-2020

57% of companiesusing cloud to drive competitive and cost advantages

80% of all datais unstructured and growing 15x the rate of structured data

63% of peopleexpect to be doing more shopping on their

mobile devices over the next couple of years


A fundamental change

The people access to

centralized services

A service developed in

one flavor for all

The service access to

people everywhere

A service developed in one flavor for

all but capable to adapt


But has all really changed ?

Find & WalkWaitAsk for serviceFew physical locationsNational

Walk & FindSelf-ServiceMore physical locationsInternational

LocateSelf-ServiceAnywhereInternational

Yes and No !


Hybrid Cloud Private Cloud Public Cloud

Up to 10 TB Memory on z13Improves consolidation ratios

SMT-2 technology on z13Improves performance and

throughput of workloads

GDPS for Linux on z Systems

Disaster Recovery solution for mission-critical workloads

KVM New industry-standard hypervisor

(SOD)

Increase in # of LPARs on z13Improves TCO

Cloud Manager w/ OpenStack V4.2

Heterogeneous platform management from z Systems

Elastic Storage for Linux on z Systems

Enables new class of workloads

New Capabilities in z13 supporting Cloud Computing




Contents



Existing major workloads utilizedOracle Database on Linux on z

WebSphere (App Servers, Message Broker, MQ, …)

SAP Application Servers

Basic Infrastructure Services (HTTP Server, FTP, Apache, Tomcat, Samba, Networking, Tivoli Storage Manager, Domino...)

Leverage existing ISV Solutions or custom client applications

DB2 LUW

Other WebSphere components (Portal Server, Business Process Manager, …)

...

New utilizationsMobile on z Systems (IBM MobileFirst Server)

z/VM Virtualization management (IBM Wave) and Cloud

Analytics on Linux on z (Cognos, Spss, Infosphere, …)

OpenSource solutions (Hadoop, PostGreSQL, MariaDB, Docker,...)

Enterprise Linux Printing (Ubiquitech solution,....)

Advanced Case Management (FileNet),Document and customer management (Filenet)

– Migrate Oracle to DB2 UDB on Linux on z (incl. InfoSphere Data Replication)

UNIX based Solutions from competitive platforms (e.g. Solaris, HP-UX)

...

Linux on z System


1 processor ship

1 core 1 IFL (Integrated Facility for Linux)

Example, depending on the type,model of the server and the type of workload:- On 1 intel core you are running 4 virtual machines - On 1 IFL you can run 40 virtual machines

4 virtual cpu cores affected to 1 virtual machine

Intel

1 core 1 IFL

Consolidation Ratio used in this example, 1:10: 10 cores to 1 IFL

Consolidation of Linux on z System


Basics of MultithreadingDefinition for « a process »

• is a running instance of a program• gets separated from other process by the OS• runs with ist own copy of resources• consists out of one or more threads (a thread container from the OS perspective)

Definition for « a thread »

• a sequence of instructions• runs with other threads in parallel within a process• shares resource like memory, open files, addresses with other threads• allows programmer to isolate code that could freeze other while waiting

What is Simultaneous Multithreading?

A modification of a processor so the processor can run more than one thread silmuntanously

What are the benefits?Superscalar processors offer a high level of parallelism (e.g. out-oforderExecution)Using SMT, unutilized execution units can be exploited for an increased efficiency:

• modern processors have a latency when memory is accessed• this is circumvented (to a certain extent ) by a complex cache topology• during cache misses other threads can run on the same coreAdditional capacity with a limit effort of additional areas on the chip


IBM z System SMT Exploitation

MT Aware

MT Unaware

Physical Hardware

Core

Thr Thr

PR/SM Hypervisor

OS OS

Core

Thr Thr

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Appl Appl

Core

Thr Thr

Core

Thr Thr

Logical CPUs

Logical cores

Physical cores

HW Threads

Applcpu1 cpuN

n LinuxGuests

Virtual CPUs


SMT Support Implementation on z 13 for z/VM Enable SMT for IFLs Support up to 32 multithreaded cores (64 threads) Treat each thread as an independent ‘processor’ Dispatch virtual IFLs on the Hardware Threads

• Same or different guests can share core• Adds to variability

How to Enable it ? Add the MULTITHreading ENAble statement to your system configuration

file. The system must be in vertical polarization mode (this is the default)

– Make sure you don't have an SRM POLARIZATION HORIZONTAL statement in your system configuration file.

The system must be using the reshuffle dispatcher method (this is the default)

– Make sure you don't have an SRM DSPWDMethod REBALANCE statement in your system configuration file.

Re-IPL your system!


1 IFL

Using Simutaneous Multi-Threading (SMT), on z 13 for Linux workloads

1 IFL

Two tasks, one core

Two tasks, two threads

Elapsed Time

(assumes one thread delivers 70% of a core)

Additional capacity

Task A Task B

Flexibility & More Throughput !

thread0

thread1

Processing more work with same resources


● Objective is to improve system capacity, not the speed of a single instruction stream.

● Not everything runs in parallel -> no linear gain● Workloads profit individually from SMT

What you see, is what you get - no general rule (like estimate20%)

It increases the capacity: things not get faster, but more thingscan be done within the given time

Some scenarios are exploiters of multi threading, there are others that don‘t: The amount of data shared between software threads is small, The amount of process is important, The size of the allocated memory pages is important (TLB misses) Lightweight Java applications with many threads.

Summary on Simutaneous Multi-Threading (SMT)




Contents



Virtualization and Cloud Portfolio for Linux on z Systems

Servers: z13, zEC12, zBC12Massively scalable

Characterized by great economics / efficiencies

Highly secure / available

z/VM 6.3Support more virtual servers than any other platform in a single footprint

Integrated OpenStack support

IBM Wave for z/VMA graphical interface tool that simplifies the management and administration of z/VM and Linux environments

Cloud Manager with OpenStack

A simple, entry level cloud management stack

Based on OpenStack

Formerly known as SmartCloud Entry

Cloud Orchestrator

Based on OpenStack

Builds on functionality of Cloud Manager with OpenStack and adds runbook automation and middleware pattern support for workload deployment

Formerly known as SmartCloud Orchestrator

Service Lifecycle ManagementStandardizationDifferentiation

VirtualizationInfrastructure & Virtualization

Management

Entry Level Cloud

Standarization & Automation

Advanced Cloud

Orchestration & Optimization


z System is ready for Hybrid Cloud Computing

IBM Cloud: SoftlayerExpose services in a secure manner via

zOSConnect to achieve rapid open source based development whilst leveraging mainframe assets

Expose z/OS Data as-a-Service via BlueMix to enable system of record to be called by Dev-Ops

driven composable apps

z Systems - BlueMix Integration

PaaS : Bluemix

DataPower

CastIron

Secure Gateway

z/OS Connect


z Cloud mobile services

MobileFirst Platform

(on-prem)

CICS

IMS

WebSphere AS

DB2

Ana

lytic

s

Mobile apps run either on-prem (using Linux on

System z) or in the cloud (via BlueMix)

z/OS ConnectMobileFirst

Platform (cloud)

Analytics run on SoR system

for optimal performance and security

Mobile

Access this demonstration here: DemoSearch for : IBM Apple Advise & Grow Demo

https://www-304.ibm.com/systems/clientcenterdemonstrations/faces/dcHome.jsp?currentMenuLabel=Demonstration%20Center

https://www-304.ibm.com/systems/clientcenterdemonstrations/faces/_rlvid.jsp?_rap=!viewDemo&_rvip=/dcSearchByKeywords.jsp&demoId=1239&conversationContext=2


© Copyright IBM Corporation 2014

Str

uct

ure

dU

nstr

uct

ur

ed

InfoSphere DataStage

Functionally Complete & RichFunctionally Complete & RichFunctionally Complete & RichFunctionally Complete & Rich

Low Latency (Limited Data Flow)Low Latency (Limited Data Flow)Low Latency (Limited Data Flow)Low Latency (Limited Data Flow)

AcceleratedAcceleratedAcceleratedAccelerated

Ultra-safeUltra-safeUltra-safeUltra-safe

z Cloud secured analytics services

IBM InfoSphere z System Connector for Hadoop


z13 – Redesigned for efficient and trusted cloud services

* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Up to 8,000 virtual servers per system, more than 50 per core

Open virtualization with new KVM support *

z13 brings faster processing and higher throughput of secure

transactions (2X more throughput on crypto

coprocessor)

Business continuity and IT analytics with enterprise grade

Linux solution

Open support extended with OpenStack®, PostgreSQL, Node.JS, and KVM*

Enterprise-grade Linux provides the foundation for public, private, and hybrid cloud

Patterns for Linux on z Systems to quickly build out complex cloud workload instances

Improved overall system performance leads to a lower TCO compared to public cloud deployments and deployments on x86 architectures

Enabling next generation cloud applications with IBM Bluemix™ on z Systems

© Copyright IBM Corporation 2015

Session summary

Optimized Workload Deployment • Increased efficiency for workload deployment• “Shared everything” architecture• Consolidates monitoring and performance management• Deploy on the best suited platform• Multiple O/S Support for Heterogeneous clouds

Secure Infrastructure with Security Built in• Highest security rating • Each processor has its own cryptographic

coprocessor• End to End encryption• Hypervisors managed as firmware• Unparalleled audit and compliance capabilities

Resilience with RAS designed in• Engineered to rarely fail and to rapidly recover • Built in hardware redundancy• High degrees of elasticity / scalability• Guaranteed application performance (QoS)• Active monitoring for abnormal behavior

Linux on z System let's you take benefits of :


IBM Client Center Montpellier

Parc Industriel de la Pompignane

34000 Montpellier

Phone: +33 4 67 34 65 74

[email protected]

Follow me on Twitter :

@SLLaurency

https://twitter.com/SLLaurency

Sébastien LLaurency

IBM Certified Expert Integration Architect

Cloud Computing

Digital Solutions for z Systems

mailto:[email protected]


Affordability

Attractive price performance. Offers the lowest TCA for Linux deployment of Oracle database workloads over competition - saving over half the cost1. Lower costs through reduced complexity - Simplified management, Reduced environmental costs, Greater flexibility to meet changing needs

AvailabilityNear zero downtime/continuous availability, even during maintenance of hardware, OS, database and application components. Enhanced disaster recovery responsiveness.

Efficiency

Reduced infrastructure complexity through consolidation, automation and virtualization, saving on energy, labor, software, and more. Management of the end to end applications, fast private network, fewer hops and points of failure. High resource utilization.

Integration

Capability to handle the largest volumes of data, in a day and age when data is booming. Tight integration and simpler management of data and applications on one system. Low latency. Homogeneous system environment.

ScalabilityFlexibility and near-linear large scalability, unmatched in the IT world, to grow with your business. Superior virtualization. Unprecedented scale.

SecurityComprehensive protection of critical data from all IT security threats. Private server network. Most secure platform with Common Criteria Evaluation Assurance Level 5 (EAL5).

1 Based on measurements at a large bank comparing a production workload running on Oracle RAC DB on distributed versus Oracle RAC DB on Linux a Enterprise Linux Server with cores running at 5.5 GHz.

Infrastructure Matters

Date post:	06-Aug-2015
Category:	Technology
Upload:	nrb
View:	66 times
Download:	1 times

Linux on Z13 and Simulatenus Multithreading - Sebastien Llaurency

Technology