Sorting Sorting Arranging items in a collection so that there is an ordering on one (or more) of the...

Post on 13-Jan-2016

216 views 0 download

Tags:

transcript

Sorting

SortingArranging items in a collection so that there is an ordering on one (or more) of the fields in the itemsSort KeyThe field (or fields) on which the ordering is basedSorting algorithmsAlgorithms that order the items in the collection based on the sort key

Why is sorting important?

Chapter 13 presents several common algorithms for sorting an array of integers.

Two slow but simple algorithms are Selectionsort and Insertionsort.

This presentation demonstrates how the two algorithms work.

Quadratic Sorting

Data Structuresand Other ObjectsUsing C++

Selection Sort

Given a list of names, put them in alphabetical order Find the name that comes first in the alphabet,

and write it on a second sheet of paper

Cross out the name off the original list

Continue this cycle until all the names on the original list have been crossed out and written onto the second list, at which point the second list contains the same items but in sorted order

Selection Sort

A slight adjustment to this manual approach does away with the need to duplicate space

As you cross a name off the original list, a free space opens up

Instead of writing the value found on a second list, exchange it with the value currently in the position where the crossed-off item should go

Selection Sort

Figure 9.9 Example of a selection sort (sorted elements are shaded)

Sorting an Array of Integers

The picture shows an array of six integers that we want to sort from smallest to largest [1] [2] [3] [4] [5] [6]

0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6][0] [1] [2] [3] [4] [5]

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Selectionsort Algorithm

Start by finding the smallest entry.

[0] [1] [2] [3] [4] [5]

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Selectionsort Algorithm

Start by finding the smallest entry.

Swap the smallest entry with the first entry. [0] [1] [2] [3]

[4] [5]

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Selectionsort Algorithm

Start by finding the smallest entry.

Swap the smallest entry with the first entry. [0] [1] [2] [3]

[4] [5]

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Selectionsort Algorithm

Part of the array is now sorted.

Sorted side Unsorted side

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

Find the smallest element in the unsorted side.

Sorted side Unsorted side

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

Find the smallest element in the unsorted side.

Swap with the front of the unsorted side.

Sorted side Unsorted side

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

We have increased the size of the sorted side by one element.

Sorted side Unsorted side

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

The process continues...

Sorted side Unsorted side

Smallestfrom

unsorted

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

The process continues...

Sorted side Unsorted side

[0] [1] [2] [3] [4] [5]

Swap

with

front

The Selectionsort Algorithm

The process continues...

Sorted side Unsorted sideSorted side

is bigger

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

The process keeps adding one more number to the sorted side.

The sorted side has the smallest numbers, arranged from small to large.

Sorted side Unsorted side

[0] [1] [2] [3] [4] [5]

The Selectionsort Algorithm

We can stop when the unsorted side has just one number, since that number must be the largest number.

[0] [1] [2] [3] [4] [5]

Sorted side Unsorted side

The Selectionsort Algorithm

The array is now sorted.

We repeatedly selected the smallest element, and moved this element to the front of the unsorted side.

[0] [1] [2] [3] [4] [5]

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

The Insertionsort algorithm also views the array as having a sorted side and an unsorted side.

[0] [1] [2] [3] [4] [5]

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

The sorted side starts with just the first element, which is not necessarily the smallest element.

[0] [1] [2] [3] [4] [5]

Sorted side Unsorted side

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

The sorted side grows by taking the front element from the unsorted side...

Sorted side Unsorted side

cur

i=1

for (int i = 1; i < v.size(); i++) { int cur = v[i]; // slide cur down into position to left

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

...and inserting it in the place that keeps the sorted side arranged from small to large.

Sorted side Unsorted side

j=i-1 i=1

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];cur

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

In this example, the new element goes in front of the element that was already in the sorted side.

Sorted side Unsorted side

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];v[j+1] = cur;

j--j+1=0

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

Sometimes we are lucky and the new inserted item doesn't need to move at all.

Sorted side Unsorted side

for (int i = 1; i < v.size(); i++) { int cur = v[i]; // slide cur down into position to left

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

The Insertionsort Algorithm

Sometimes we are lucky twice in a row.

Sorted side Unsorted side

v[j+1] = cur;

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

Copy the new element to a separate location.

Sorted side Unsorted side

cur

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

Shift elements in the sorted side, creating an open space for the new element.

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

Shift elements in the sorted side, creating an open space for the new element.

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

Continue shifting elements...

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

Continue shifting elements...

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

...until you reach the location for the new element.

for (int j=i-1; j >= 0 && v[j] > cur; j--) v[j+1] = v[j];

[1] [2] [3] [4] [5] [6]0

10

20

30

40

50

60

70

[1] [2] [3] [4] [5] [6]

How to Insert One Element

Copy the new element back into the array, at the correct location.

Sorted side Unsorted side

v[j+1] = cur;

How to Insert One Element

The last element must also be inserted. Start by copying it...

[0] [1] [2] [3] [4] [5]

Sorted side Unsorted side

Bubble Sort

Bubble Sort uses the same strategy:Find the next itemPut it into its proper place

But uses a different scheme for finding the next item Starting with the last list element, compare

successive pairs of elements, swapping whenever the bottom element of the pair is smaller than the one above it

Bubble Sort

Figure 9.10 Example of a bubble sort

Algorithms

Can you write the algorithms for the selection sort and the bubble sort?

Can you think of a way to make the bubble sort more efficient?

Logarithmic Sorting

* Quick Sort* Merge Sort

Quicksort

Figure 9.12 Ordering a list using the Quicksort algorithm

It is easier to sort a smallernumber of items: Sort A…F, G…L, M…R, and S…Z andA…Z is sorted

Quicksort

QuicksortIf (there is more than one item in list[first]..list[last])

Select splitValSplit the list so that

list[first]..list[splitPoint-1] <= splitVallist[splitPoint] = splitVallist[splitPoint+1]..list[last] > splitVal

Quicksort the left halfQuicksort the right half

Quicksort

Quicksort

Split Set left to first + 1Set right to lastDo

Increment left until list[left] > splitVal OR left > rightDecrement right until list[right] < splitVal OR left > right If (left < right)

Swap list[left] and list[right]While (left <= right)Set splitPoint to rightSwap list[first] and last[right]

Quicksort

Figure 9.13 Splitting algorithm

Quick Sort Code

void Quicksort(Vector<int> &v, int start, int stop) {

if (stop > start) { //base case int pivot = Partition(v, start, stop); //partition Quicksort(v, start, pivot-1); //recursive sort left Quicksort(v, pivot+1, stop);//recursive sort right } }

Partition Code – set up pivot

int Partition(vector<int> & arr, int start, int stop) { int lh = start + 1; //left hand int rh = stop; //right hand int pivot; //variable to hold pivot pivot = arr[start]; //set pivot to first element

Partition Code—Move to center

while(true) { while(lh < rh && arr[rh] >= pivot) rh--; while(lh <rh && arr[lh] < pivot) lh++; if(lh == rh) break; //base case

Partition Code—Swap

while(true) { while(lh < rh && arr[rh] >= pivot) rh--; while(lh <rh && arr[lh] < pivot) lh++; if(lh == rh) break; //base case swap(arr[lh], arr[rh]); }

Partition Code—Left Overs?

if(arr[lh] >= pivot) return start; swap(arr[start], arr[lh]; return lh;

} //end Partition function

Merge Sort—Partition

8 7 4 3 9 5 10

Merge Sort—Partition

8 7 4 3

9 5 10

Merge Sort—Partition

8 7

9 5 4 3 10

Merge Sort—Merge

8

9 4 107

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4 10

7

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4 10

7

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4 10

7

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4

107

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4

107

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9

4 107

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4 107

3

5

Compare -- smallest goes first

Merge Sort—Merge

8

9 4 107

3

5

Merge Sort—Merge

8

9 4 107

3

5

Compare –smallest goes firstCompare—smallest goes first

Choose smallest from each stack

Merge Sort—Merge

8

9 4 107

3

5

Compare –smallest goes firstCompare—smallest goes first

Choose smallest from each stack

Merge Sort—Merge

8

9 4

107

3

5

Compare –smallest firstCompare --smallest first

Merge Sort—Merge

8

9 4 107

3

5

Compare –smallest firstCompare –smallest first

Merge Sort—Merge

8

9 4 107

3

5

Compare –smallest goes first

Merge Sort—Merge

8

9 4 107

3

5

Compare –smallest first

Merge Sort—Merge

8

9 4 107

3

5

Compare –smallest first

Merge Sort—Merge

8

9

4

107

3

5

Compare –smallest first

Merge Sort—Merge

8

9

4

107

3

5

Compare—smallest first

Merge Sort—Merge

8

9

4

10

7

3

5

Compare –smallest first

Merge Sort—Merge

8

9

4

10

7

3

5

Compare –smallest first

Merge Sort—Merge

8

9

4

10

7

3

5

Compare –smallest first

The remainders

Merge Sort—Merge

8

9 4

10

7

3

5

The remainders

Merge Sort—Done

8

9 4 107

3

5

A Quiz

How many shifts will occur before we copy this element back into the array?

[0] [1] [2] [3] [4] [5]

A Quiz

Four items are shifted.

[0] [1] [2] [3] [4] [5]

A Quiz

Four items are shifted.And then the element is copied back into the array.

[0] [1] [2] [3] [4] [5]

Both Selectionsort and Insertionsort have a worst-case time of O(n2), making them impractical for large arrays.

But they are easy to program, easy to debug. Insertionsort also has good performance when the

array is nearly sorted to begin with. But more sophisticated sorting algorithms are

needed when good performance is needed in all cases for large arrays.

Timing and Other Issues

THE END

Presentation copyright 2004 Addison Wesley Longman,For use with Data Structures and Other Objects Using C++by Michael Main and Walter Savitch.

Some artwork in the presentation is used with permission from Presentation Task Force(copyright New Vision Technologies Inc) and Corel Gallery Clipart Catalog (copyrightCorel Corporation, 3G Graphics Inc, Archive Arts, Cartesia Software, Image ClubGraphics Inc, One Mile Up Inc, TechPool Studios, Totem Graphics Inc).

Students and instructors who use Data Structures and Other Objects Using C++ are welcometo use this presentation however they see fit, so long as this copyright notice remainsintact.