MULTI-THREADED PROGRAMMING

Reported by:

Nikko DelumenMary Joy Tapar

4.1 OVERVIEW Thread – basic unit of CPU utilization; it comprises a thread ID, a program counter, a register set, and a stack.

4.1.1 MOTIVATION Many software packages that run on modern desktop PCs are multithreaded.

•Example: A word processor may have a thread for displaying graphics, another for responding to keystrokes, and a third is for performing spelling and grammar checking in background.

threadthread

Single-threaded process Multi-threaded process

•Recall from CHAPTER3 “RPCs allow interprocess communication by providing a communication mechanism similar to ordinary function or procedure calls.”

Typically, RPC servers are multithreaded. When server receives a message, it services the message using a separate thread.

4.1.2 BENEFITS •Responsiveness. Multithreading an interactive application may allow a program to continue running even if part of it is blocked or is performing a lengthy operation, thereby increasing responsiveness to the user.

•Resource Sharing. By default, threads share the memory and the resources of the process to which they belong.

•Economy. Allocating memory and resources for process creation is costly. Because threads share resources of the process to which they belong, it is more economical to create and context-switch threads.

•Utilization of multiprocessor architectures. Threads may be running in parallel on different processors. A single-threaded process can only run on one CPU, no matter how many are available.

4.2 MULTI-THREADING MODELS

•Support for threads may be provided either at the user level, for user threads, or by the kernel, for kernel threads.

4.2.1 Many-to-One Model

User thread

Kernel thread

4.2.2 One-to-One Model

User thread

Kernel thread

Two-level Model

User thread

Kernel thread

4.2.3 Many-to-Many Model

User thread

Kernel thread

4.3 THREAD LIBRARIES

A Thread Library provides the programmer an API for creating and managing threads.

Two Primary Ways of Implementing a Thread Library

1.To provide a library entirely in user with no kernel support. All code and data structures for the library exist in user space.

2. To implement a kernel-level library supported directly by the operating system. Code and data structures for the library exist in kernel space.

4.3.1 PTHREADS

Pthreads refers to the POSIX standard (IEEE 1003.1c) defining an API for thread creation and synchronization.

#include <pthread.h>#include <stdio.h>

int sum;void *runner(void *param);

int main(int argc, char *argv[]){

pthread.t tid;pthread_attr_t attr;

if (argc !=2){fprintf(stderr,”usage: a.out(integer value>\n”);return -1;

}if (atoi (argv[1]) < 0) {

fprintf(stderr,”%d must be >= 0\n”, atoi (argv[1]));

return -1;}

pthread_attr_init(&attr);pthread_create (&tid, &attr, runner, argv[1]);pthread_join (tid,NULL);

printf(“sum=%d\n”, sum);}

void *runner(void *param){

int i, upper = atoi(param)sum = 0;

for (i=1; i<=upper; i++)sum += I;

pthread_exit (0);}

4.3.2 WIN32 THREADS

The technique of creating threads using Win32 thread library is similar to the Pthreads technique in several ways.

#include <windows.h>#include <stdio.h>

DWORD Sum;

DWORD WINAPI Summation(LPVOID Param){

DWORD UPPER = *(DWORD*) Param;for (DWORD I = 0; I <= Upper; i++)

Sum += I;return 0;

}

int main (int argc, char *argv[]){

DWORD ThreadId;HANDLE ThreadHandle;int Param;if (argc !=2){

fprintf(stderr,”An integer parameter is required\n”);

return – 1;}Param=atoi(argv[1]);if (Param<0){

fprintf(stderr,”An integer >= 0 is required\n);return – 1;

}

ThreadHandle=CreateThread(NULL,0,Summation,&Param,0,&ThreadId);

if (ThreadHandle != NULL){WaitForSingleObject(ThreadHandle,

INFINITE);CloseHandle(ThreadHandle);printf(“sum = %d\n”,Sum);

}}

4.3.3 JAVA THREADS

Threads are fundamental model of program execution in a Java program, and the Java language and it’s API provide a rich set of features for the creation and management of threads.

class Sum{

private int sum;public int getSum() {

return sum;}public void setSum (int sum) {

this.sum = sum;}

}

class Summation implements Runnable{

private int upper;private Sum sumValue;public Summation (int upper, Sum sumValue) {

this.upper = upper;this.sumValue = sumValue

}public void run() {

int sum = 0;for (int i=0; i<= upper; i++)

sum+=I;sumValue.setSum(sum);}

}

public class Driver{

public static void main(String[]args){if(args.length >0){

if (Integer.parseInt (args[0])<0)System.err.printIn(args[0]+” must be >= 0.”);

else{Sum sumObject = new Sum();int upper = Integer.parseInt(args[0]);Thread thrd = new Thread(new Summation (upper, sumObject));thrd.start();try {

thrd.join();System.out.printIn

(“The sum of “+upper+” is “+sumObject.getSum());

} catch (InterruptedException ie) { }}

}else

System.err.println(“Usage: Summation <integer value>”);}

}

4.4.3 THREADING ISSUES

In this section, we discuss some of the issues to consider with multithreaded programs.

4.4.2 CANCELLATION

• Thread cancellation – is the task of terminating a thread before it has completed.

Example: if multiple threads are concurrently searching through a database and one thread returns the result, the remaining threads might be canceled.

•Cancellation points – Pthreads refers to such as cancellation points.

4.4.3 SIGNAL HANDLING Signal – used in UNIX systems to notify

a process that a particular event has occurred.

All signals, whether synchronous or asynchronous , follow the same pattern:

1.A signal is generated by the occurrence of a particular event.

2.A generated signal is delivered to a process.

3.One delivered, the signal must be handled.

• Signal Asynchronously – when a signal is generated by an event external to a running process.

Example:include terminating process with

specific Keystrokes ( such as <control> <C> ) and have a timer expire.

Every signal may be handled by one of two possible handlers:

1. A default signal handler2. A user-defined signal handler

• Default Signal Handler – run by the kernel

when handling that signal.• User-defined signal handler – that is called to handle the signal.

• Asynchronous procedure calls (APCs) – the Windows can be emulated using this.

4.4.4 THREAD POOLS

Limits the number of threads that exist at anyone point. This is particularly important on systems that cannot support a large number of concurrent threads.

Example:DWORD WINAPI PoolFunction (AVOID Param) {

/*** this function runs as a separate thread.**/

}

QueueUserWorkItem ( ) function, which is passed three parameters:

• LPTHREAD_START_ROUTINE Function – a pointer to the function that is to run as a separate thread.•PVOID Param – the parameters passed to Function.•ULONG Flags – flags indicating how the thread pool is to create and manage execution of the thread.

4.4.5 THREAD-SPECIFIC DATA

In a transaction-processing system, we might service each transaction in a separate thread.

User thread

Lightweight process

Kernel thread

Figure 4.9 Lightweight process (LWP)

LWP

k

4.4.6 SCHEDULAR ACTIVATIONS

One scheme for communication between the user-thread library and the kernel is known as schedular activation. • upcall – the kernel must inform an application about certain events.•upcall handler – upcalls are handled by the thread libarary and it must run on a virtual processor.

4.5 OPERATING SYSTEM EXAMPLES

4.5.1 WINDOW XP THREADS

it implements the WIN32 API. The WIN32 API is the primary API for the family of Microsoft O.S.

The general components of a thread include:• A thread ID unquely identifying the thread• A register set representing the status of the processor.

• A user stack, employed when the thread is running in user mode, and a kernel stack, employed when the thread is running in kernel mode

•A private storage area used by various run-time libraries and dynamic link libraries (DLLs)

The register set, stacks, and private storage area are known as the context of a thread include:

• ETHREAD – executive thread block• KTHREAD – kernel thread block•TEB – thread environment block

4.5.2 Linux Threads

• Lynux provides the fork ( ) system call• it also provides the ability to create threads using the clone( ) system call• uses the distinguish between processes and threads. Uses the term task – rather process or thread.

Some of these flags are listed below:

FLAG MEANING

CLONE_FS File-system information is shared.

CLONE_VM The same memory space is shared.

CLONE_SIGHAND Signal handlers are shared.

CLONE_FILES The set of open file is shared.

SUMMARY

• THREAD – is a flow of control within a process.• MULTITHREADED PROCESS – contains several different flows of control within the same address space. It includes increased responsiveness to the user, resource sharing within process, economy, and the ability to take advantage of multiprocessor architecture.

• USER-LEVEL THREADS – are threads that are visible to the programmer and are unknown to the kernel.• THREE DIFFERENT TYPES OF MODELS RELATE USER AND KERNEL THREADS:

1. many to one model maps2. one-to-one model maps3. many-to-many model maps

THE END…