Home >Education >Big data mgmt bala

Big data mgmt bala

Date post:19-May-2015
Category:
View:900 times
Download:2 times
Share this document with a friend
Description:
Big Data Management by Bala Prabahar
Transcript:
  • 1. Partitioning and ArchivingBala PrabaharBAPS Software Consulting Services Inc.07/15/2011

2. 1. What is Partitioning?2. Types of Partitioning 3. How to Implement?4. Global Versus Local Index 5. Questions 2 3. Partitioning enables tables and indexes to besubdivided into smaller manageable piecesEach of those smaller pieces is called Partition.3 4. 10 Partitions with ~10m records 5. Available Partitioning Types: Range Partitioning (introduced in Oracle 8) Hash Partitioning (introduced in Oracle 8i) Composite Partitioning (introduced in Oracle 8i) List Partitioning (introduced in Oracle 9i) Interval Partitioning (introduced in Oracle 11g) System Partitioning (introduced in Oracle 11g) Reference Partitioning (introduced in Oracle 11g)5 6. Range-hash partitioning was introduced in Oracle 8iRange-list partitioning was introduced in Oracle 9i Range-range partitioning was introduced in Oracle 11g List-range partitioning was introduced in Oracle 11g List-hash partitioning was introduced in Oracle 11gList-list partitioning was introduced in Oracle 11gInterval-range partitioning was introduced in Oracle 11gInterval-list partitioning was introduced in Oracle 11g Interval-hash partitioning was introduced in Oracle 11g 7. Available Partitioning Types: Range Partitioning (introduced in Oracle 8) Hash Partitioning (introduced in Oracle 8i) Composite Partitioning (introduced in Oracle 8i) List Partitioning (introduced in Oracle 9i) Interval Partitioning (introduced in Oracle 11g) System Partitioning (introduced in Oracle 11g) Reference Partitioning (introduced in Oracle 11g)7 8. Interval partitioning is a partitioning method introduced inOracle 11g. This is a helpful addition to range partitioning whereOracle automatically creates a partition when the inserted valueexceeds all other partition ranges.The following restrictions apply:You can only specify one partitioning key column, and it must be of NUMBER or DATE type.Interval partitioning is NOT supported for index-organized tables. You can NOT create a domain index on an interval-partitionedtable. 9. 1 Identify Tables5 Determine # of Partitions2 Discuss with Business6 Run a Script to identify theUpper Key LimitGenerate CREATE TABLE3 Determine Partition Key 7 StatementRun SQL Statement4 Group BY &8 Load data into Partitioned TableOrder BY 10. SELECT , , Count(*) FROM GROUP BY , , ORDER BY , ,10 11. ODSR_4IN68CVTKN5HWSCTCM8G03ZIQ541332 ODSR_4IPWDLN3A0E9ZQL9C715GI9W1 65351 ODSR_4IQPKCK3V2L00HG22IF07LF2P 86676 ODSR_4ITGFBK0J0DFFDYVSFXFAN05U 55170 ODSR_4IV1M2YUQGVGUIQ4KHQ06WXAP53280 ODSR_4IVFQZCVDSWY1PPK0MXC06SNL 67820 ODSR_4IXS9V5HSV12YA22KWXUV0FPU47570 ODSR_4J2627MWPQSEMKEN3SCD6BKIA 49048 ODSR_4J32BJFV6AV8GCQCX6NEUY5JM 18109 ODSR_4J4JFJQKSZPTDIM9Z2DVE9ZMA 58148 ODSR_4J9OGSBOLT2YN8BA0V0EVJHJM 67760 11 12. 1 Identify Tables5 Determine # of Partitions2 Discuss with Business6 Run a Script to identify theUpper Key LimitGenerate CREATE TABLE3 Determine Partition Key 7 StatementRun SQL Statement4 Group BY &8 Load data into Partitioned TableOrder BY 13. 13 14. 14 15. 1 Identify Tables5 Determine # of Partitions2 Discuss with Business6 Run a Script to identify theUpper Key LimitGenerate CREATE TABLE3 Determine Partition Key 7 StatementRun SQL Statement4 Group BY &8 Load data into Partitioned TableOrder BY 16. CREATE TABLE "/BIC/B0000252000_NEW" PARTITION BY RANGE ("REQUEST") (PARTITION P1 VALUES LESS THAN(ODSR_4IR2HPAGY9GBAE2NNIO2BQJ6A) PCTFREE 10 PCTUSED 40 INITRANS 1 MAXTRANS 255 STORAGE(INITIAL 30M NEXT 1048576 MINEXTENTS 1 FREELISTS 1 FREELIST GROUPS 1 BUFFER_POOL DEFAULT) TABLESPACE "PSAPSR3FACT", 16 17. 1 Identify Tables5 Determine # of Partitions2 Discuss with Business6 Run a Script to identify theUpper Key LimitGenerate CREATE TABLE3 Determine Partition Key 7 StatementRun SQL Statement4 Group BY &8 Load data into Partitioned TableOrder BY 18. 18 19. Global Local 19 20. Multi-providers Cubes Further levels of Partitioning 20 21. Drop Partition instead of Deleting Records Benefits: Old records are not mixed with new records. Dropping partition will be faster 21 22. 22

Popular Tags:

Click here to load reader

Reader Image
Embed Size (px)
Recommended