+ All Categories
Home > Documents > Webzendownload.microsoft.com/.../Case_Study_Smasung_Elec… · Web viewSamsung Electro-Mechanics is...

Webzendownload.microsoft.com/.../Case_Study_Smasung_Elec… · Web viewSamsung Electro-Mechanics is...

Date post: 26-Jun-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
3
“For the SPC system handling a large number of items, it has to process high volumes of transactions. We were especially impressed that SQL Server 2014 OLTP In-Memory is not only latch free, but also lock free and thus guarantees data consistency. OLTP speed improved up to 24 times when we built the native code using In-Memory complier. Even the slow retrieval system became 22 times faster in its processing speed when CCI (Clustered Columnstore Indexes) was applied”, Myongsu Kim, Senior Engineer, Manufacturing Engineering R&D, Samsung Electro-Mechanics Samsung Electro-Mechanics has SPC (Statistical Process Control) system per product line and DW (Data Warehouse) for SPC. SPC and DW help identify the various issues surrounding quality that inevitably could come to the fore in the course of production, and address the root problem. Since the 2000s, Samsung Electro-Mechanics has applied SPC and DW to its main product lines for the purpose of accomplishing a 0% error rate. In 2013, it allocated a new SPC and DW. It was not easy to ensure performance given that OLTP, as the new SPC, had to handle over 7,000 items. Moreover, the DW environment based on SPC data is better suited to processing large- scale data and thus was not able to guarantee fast data retrieval. With the improvements made to SPC and DW processing for larger volumes of data, Samsung Electro-Mechanics reached the conclusion that it needed a fundamental solution to improve performance of database and undertook the SQL Server 2014 PoC project. Through this project, Samsung Electro-Mechanics found that SQL Server 2014 In-Memory OLTP and CCI (Clustered Columnstore Indexes) would deliver a radical improvement to OLTP and OLAP environments in a way that the traditional relational database never could. In fact, SQL Server 2014 improved the performance of OLTP up to 24 times, and OLAP up to 22 times in the test of the SPC and DW models. Customer: Samsung Electro-Mechanics Website: www.samsungsem.co.kr Country or Region: Korea Industry: Manufacturing Customer Profile Samsung Electro-Mechanics is a corporation that produces high-tech integrated components of electronics and mechanical devices for all electrical devices. Business Challenge The burden associated with ensuring the performance of the mainstays of quality management, SPC (Statistical Process Control) and SPC data-based DW (Data Warehouse), has grown heavier. Solution To examine the possibility of improving the performance of OLTP and OLAP, Samsung Electro-Mechanics undertook the PoC (Proof of Concept) for SQL Server 2014 In-Memory, OLTP and CCI (Clustered Columnstore Indexes). Benefits OLTP performance improved by 24 times, and DW by 22 times The dawn of a new era A new paradigm of database extension Ushering in a new era: real-time preventive quality management Microsoft SQL Server 2014 Customer Solution Case Study Improves OLTP performance up to 24 times, and DW up to 22 times
Transcript
Page 1: Webzendownload.microsoft.com/.../Case_Study_Smasung_Elec… · Web viewSamsung Electro-Mechanics is a corporation that produces high-tech integrated components of electronics and

“For the SPC system handling a large number of items, it has to process high volumes of transactions. We were especially impressed that SQL Server 2014 OLTP In-Memory is not only latch free, but also lock free and thus guarantees data consistency. OLTP speed improved up to 24 times when we built the native code using In-Memory complier. Even the slow retrieval system became 22 times faster in its processing speed when CCI (Clustered Columnstore Indexes) was applied”,

Myongsu Kim, Senior Engineer, Manufacturing Engineering R&D, Samsung Electro-Mechanics

Samsung Electro-Mechanics has SPC (Statistical Process Control) system per product line and DW (Data Warehouse) for SPC. SPC and DW help identify the various issues surrounding quality that inevitably could come to the fore in the course of production, and address the root problem. Since the 2000s, Samsung Electro-Mechanics has applied SPC and DW to its main product lines for the purpose of accomplishing a 0% error rate. In 2013, it allocated a new SPC and DW. It was not easy to ensure performance given that OLTP, as the new SPC, had to handle over 7,000 items. Moreover, the DW environment based on SPC data is better suited to processing large-scale data and thus was not able to guarantee fast data retrieval. With the improvements made to SPC and DW processing for larger volumes of data, Samsung Electro-Mechanics reached the conclusion that it needed a fundamental solution to improve performance of database and undertook the SQL Server 2014 PoC project. Through this project, Samsung Electro-Mechanics found that SQL Server 2014 In-Memory OLTP and CCI (Clustered Columnstore Indexes) would deliver a radical improvement to OLTP and OLAP environments in a way that the traditional relational database never could. In fact, SQL Server 2014 improved the performance of OLTP up to 24 times, and OLAP up to 22 times in the test of the SPC and DW models.

Customer: Samsung Electro-Mechanics Website: www.samsungsem.co.krCountry or Region: KoreaIndustry: Manufacturing

Customer ProfileSamsung Electro-Mechanics is a corporation that produces high-tech integrated components of electronics and mechanical devices for all electrical devices.

Business Challenge The burden associated with ensuring the performance of the mainstays of quality management, SPC (Statistical Process Control) and SPC data-based DW (Data Warehouse), has grown heavier.

Solution To examine the possibility of improving the performance of OLTP and OLAP, Samsung Electro-Mechanics undertook the PoC (Proof of Concept) for SQL Server 2014 In-Memory, OLTP and CCI (Clustered Columnstore Indexes).

Benefits− OLTP performance improved by 24

times, and DW by 22 times − The dawn of a new era− A new paradigm of database

extension− Ushering in a new era: real-time

preventive quality management

Microsoft SQL Server 2014Customer Solution Case Study

Improves OLTP performance up to 24 times,

and DW up to 22 times

Page 2: Webzendownload.microsoft.com/.../Case_Study_Smasung_Elec… · Web viewSamsung Electro-Mechanics is a corporation that produces high-tech integrated components of electronics and

Business NeedsSamsung Electro-Mechanics found a

new solution that would leverage the SPC (Statistical Process Control) system. The SPC system plays an essential role in ensuring uniform product quality at the mass-production stage. It is especially important to manufacturers running large facilities. Samsung Electro-Mechanics developed and extended SPC at the system level since the 2000s and then put the experience it gained into the business logic underpinning the deployment of the SPC system to its new production floor. In short, the SPC systems at Samsung Electro-Mechanics have become more advanced, more intelligent and more sophisticated with its move to the next generation technology. The rise in the importance of the SPC

system also precipitated an increasing in the complexity of the business logic surrounding it. This presented a new challenge to Samsung Electro-Mechanics, which needed to make certain that the database performs at its best. 2013 was the year that Samsung Electro-Mechanics realized the importance of database performance in connection with the SPC system. That year, though it developed a new SPC system, it had trouble ensuring its performance. There were two concerns with speed.

The first concern was the speed of OLPT (Online Transaction Processing) in the SPC system. Unlike the SPC systems engaged in other production process, this had to check over 7,000 items throughout the course of manufacturing a single product. It not only had to test more items that other SPC systems did, but also featured business logic that was much more complex. What’s more, the system consumed excessive disk input/output when processing complicated events. The degradations in performance

that the processing of such complicated events caused meant that, in practical terms, Samsung Electro-Mechanics was not able to use

all the business logic it had developed. For instance, one instance of business logic triggers the SPC system to give a warning alarm when the product goes beyond the standard specification and reaches its limit in the course of manufacturing process, such that it stops and moves to the next process. This is essential for sound, real-time quality management. Samsung Electro-Mechanics was compelled to operate a system based not on such business logic, however, but on the measured value of each test item. This deficiency stemmed from its inability to make the most of its database. For this reason, it was focused very much on finding ways to process the various test records measured by sensors mounted on manufacturing equipment in a way that would prevent database performance from becoming degraded.

The other concern was retrieval speed of SPC statistical data. Samsung Electro-Mechanics runs DW (Data Warehouse), which reads data from SPC system through the batch processing and provides many different report forms to help users retrieve production or quality records. The slow speed this DW faced in retrieving data was found to be because the SPC system that had been developed in 2013 handled much larger volumes of data compared to other SPC systems. While struggling to find a solution to these problems, Samsung Electro-Mechanics discovered the potential to do just that with the SQL Server 2014 PoC project in January 2014.

SolutionSamsung Electro-Mechanics

plunged into action right after Microsoft offered the PoC (Proof of Concept) project for SQL Server 2014 In-Memory OLTP and CCI (Clustered Columnstore Indexes). With great expectations for what In-Memory OLTP and CCI could do in terms of

improving the performance of its SPC system, Samsung Electro-Mechanics set about undertaking the project. For this 2-week PoC project which ran from early January 2014, it set up a test server that was similar to the actual operating server and variously installed on it the database running on the SPC system and on the server. Plus, it connected clients to the test server to measure the workload caused by the data retrieval service.

After concluding the preparatory work, Samsung Electro-Mechanics carried out two tests to see the changes when the SPC system was running on SQL Server 2014. The first was to measure how much performance had improved. For this, Samsung Electro-Mechanics compared the performance recompiling the old stored procedure in TSQL and natively compiled stored procedure for In-Memory. The second test was to measure the total workload on the system when all the features of the STC system were put into use without worrying about how they would degrade performance.

The results of both tests were encouraging. There was a clear difference in performance before and after SQL Server 2014 In-Memory OLTP was applied, even when the old stored procedure was used. Performance improved up to 24 times after the old stored procedure was optimized for In-Memory. The second test that enabled all the business logic of the SPC system to achieve better results than expected. Even though all the features developed back in 2013 were installed, SQL Server 2014 outperformed the old operating environment that focused on processing values transmitted from the sensor. That was not only because In-Memory OLTP reduced disk I/O, but also tables were retained in memory, which resulted in reduced CPU load.

Though the SPC-related retrieval service drew much attention when SQL Server 2012 was first launched, its Columnstore index was not useful

Page 3: Webzendownload.microsoft.com/.../Case_Study_Smasung_Elec… · Web viewSamsung Electro-Mechanics is a corporation that produces high-tech integrated components of electronics and

when it came down to table operations (for example, insert, update and delete). Samsung Electro-Mechanics reasoned that if SQL Server 2014 CCI could address this problem, it would be worthwhile to use it, and thus weighed up the possibility. Through this period of evaluation, it saw that the problems of old had been addressed.

The Columnstore index proved its worth when it came to improving speed. Through this project, Samsung Electro-Mechanics learned that SQL Server 2014 made data retrieval faster by 22 times when compared to its old DW. In addition, Samsung Electro-Mechanics examined how CCI improves data compression. It was not lost on the company that a good compression rate could save storage as the DW system associated with the SPC system has many tables that are larger in size than 1TB.

BenefitsOLTP performance improved by 24 times, and DW by 22 times

From the SQL Server 2014 PoC project, Samsung Electro-Mechanics obtained a clear-cut result regarding the improvements it could expect to the SPC system and the dedicated DW.

“For the SPC system handling a large number of items, it has to process high volumes of transactions. We were especially impressed that SQL Server 2014 OLTP In-Memory is not only latch free, but also lock free and thus guarantees data consistency. OLTP speed improved up to 24 times when we built the native code using In-Memory complier. Even the slow retrieval system became 22 times faster in its processing speed when CCI (Clustered Columnstore Indexes) was applied”, said a member of Samsung Electro-Mechanics.

The dawn of a new eraOne of the greatest benefits that

Samsung Electro-Mechanics derives from SQL Server 2014 In-Memory OLTP is the way it can be introduced gradually. In general, changing a relational database into an in-memory environment requires a lot of work because it involves everything from design to development and operation.

By contrast, SQL Server 2014 In-Memory OLTP allows gradual migration. That is, it is designed to help users make use of In-Memory to a certain extent without changing the old stored procedure, and phase in the native code to bring out the optimum performance.

A new paradigm of database extension

The SQL Server 2014 PoC project gave Samsung Electro-Mechanics a new benchmark as to how it should further ensure the performance of databases associated with its major business systems. Samsung Electro-Mechanics expects that this will transform how the company understands capacity estimation, performance optimization and efficient management. It realized through this PoC project that a new epoch in database has arrived; the age of the relational database is no more.

“We used to scale up databases when we felt the performance was not good enough. Thanks to In-Memory, we now can take the scale-out approach to improve performance”, said a member of Samsung Electro-Mechanics. With the ever-decreasing price of memory card taken into account, scale-out deployment is the more cost effective approach. In other words, the cost for addressing a disk I/O bottleneck (which degrades database performance) could be greatly reduced with In-Memory. Moreover, Samsung Electro-Mechanics expects that it will be able to take advantage of Windows Server in terms of scalability when SQL Server 2014 is used as OLTP-dedicated database. In this project, it used SQL Server 2014 Enterprise, which can use as much memory as the operating system supports. For Windows Server 2012, both the Standard and Datacenter versions support up to 4TB of physical memory. That is, this solution helps to expand memory capacity and ensure performance even with x86 server, if not with a dedicated appliance or MPP (Massively Parallel Processing).

Ushering in a new era: real-time preventive quality management

Samsung Electro-Mechanics expects that the upgrade of SPC system and DW with SQL Server 2014 will bring about new innovation into the way it manages quality. In the SPC system used in this SQL Server 2014 PoC project, diverse instances of business logic were implemented for the intended purpose of preventive quality management. Though not all were used owing to the requirement for the response time to be less than 1 second, logic that handled necessary information according to the flow of manufacturing process was implemented. Since the OLTP system by its nature handles large bulk data in real-time, ensuring a stable processing speed was given a higher priority than handling complicated events.

Samsung Electro-Mechanics confirmed through this project that In-Memory could keep the response time to less than 1 second even when all the business logic had been implemented. This gave the assurance it needed that SQL Server 2014 would deliver the required performance and enhance the usage value of the SPC system. In fact, this project proved that the SPC system can be automated and evolved to the extent that it issues an alarm when any specification value designated to each of 7,000 items exceeds the limit, postpones the manufacturing process and performs an immediate defect tracking and analysis.


Recommended