1
FILE PROCESSING
Week 10
2
Introduction
• The most convenient way to process involving large data sets is to store them into a file for later processing.
• In order to work with files we need to focus on I/O operations, data transfer and file operations.
3Information for data transfer
Data transfer characteristics are specified by the following items called control information.
• The direction of data transfer (input or output)• The external device, or unit, to or from which data is to be
transferred• The format description that specifies conversion between the
computer-oriented internal form of data and its representation as a character string.
• Positioning action that is to occur at the end of data transfer (Advancing; if the file on the external device is to be repositioned to the end of the current record. Non advancing; if the file position is to remain in its place within the current record) (Optional)
• Exception handling to be performed in the event of an end-of-file, end-of-record, or error condition during data transfer. (Optional)
4
I / O Statements
Direction of TransferThe direction of transfer is determined by the initial
keyword in the statement. The keyword read denotes input, while write denotes output.
External DeviceEach external device is identified with a unique integer
value called a unit number. A given unit number represents the same device in the main program and in all of its modules and subprograms. Thus, unit numbers may be said to have global scope.
5
I / O StatementsI / O Statement Forms
An input or output statement has the following form.
read (unit=2, fmt=”(2i5, a, 2f16.8)”) I, Code, Str, Bugle, Dprwrite (unit=*, fmt=”(f10.3, i6, f10.3,a)”, advance =”no”) A, B, C,” # ”
write (unit=*, fmt=*) Code, X+Y+Z
The positioning specifier advance=”no” in the write statement states that the output file is not to be advanced to a new record after A, B and C have been written to the file. Thus the second write statement will append additional data to the same output record.
6
I/O statements
• input
read (control list) list
read (unit=1,fmt=“(i4,f3.2)”) Inum,Aver
• output
write (control list) list
write (unit=6,fmt=“(i4,f3.2)”) Inum,Aver
print (format specifier) list
print *, Inum, Aver
7
control list• unit specifier : External unit/device to/from data is
transferred
– unit=
• format specifier : Explicit specification of conversion between internal and external data
– fmt=
• positioning, i/o status
• other specifiers
8
Data TransferRECORDS
Information on a file subdivided into records. A record corresponds roughly to a line on a terminal screen or to a printed line. The structure of unformatted records is processor-dependent, since the amount of space required on the external unit depends on the details of processor data representation.
FORMATTED RECORDSA formatted record is composed of characters. These characters may include letters, digits,
and special symbols from the ASCII character set.
NONADVANCING INPUT AND OUTPUTInput and output always positions the input or output file, as a default option, at the end of
the last record to or from which information has been transferred. In some cases this style of input and output is not convenient. It would often be preferable to stop data transfer in the middle of an input or output record and to continue later with the remainder of the same record. Instead of default advancing file-positioning style, output statement may request a non advancing style, whereby the file position may remain within a record after the input or output statement has been executed. (See example 9.5, p400, Meissner`s book)
9
Format specifier
LIST-DIRECTED FORMATTING
An asterisk format specifier indicates list-directed formatting, which is adequate for input in most situations and for output in applications where the precise appearance of the results is not important
10
list directed I/O
• syntax
read (unit=1,fmt=*) Inum,Rnum
write (unit=2,fmt=*) Inum,Rnum
-------- 1 2.31 Inum=1 Rnum=2.31
11
Explicit format controlThe following specification describes the arrangement of five fields within a record
(3f12.0, 2i3)An input field can be specified by the following format code
read (unit=*, fmt=“(3e12.0, 2 i3)”) A, B, C, I, JEach format code in a format description includes the following information:
1) a count, indicating the number of consecutive fields to which it corresponds
2) a conversion mode, indicating by letters such as f, es, i, l or a.
3) a field width
4) a decimal position (optional)
I Format code for integer inputread (unit = *, fmt = “(i3, i4, 2 i6, i8, i3)” ) I, J, K, L, M, N
external appearance field width format code internal value123 3 i3 +123+123 4 i4 +123 -123 6 i6 -123- 1203 6 i6 -1203 -12300 8 i8 -12300- - -__ 3 i3 0
12
format codes
• * list directed
• i integer code i4
• f real code f6.2
• l logical code l
• e exponential code e11.4
• a character code a8
13
Explicit format control
f Format code for real output
write (unit = *, fmt = “(t2, f10.3, f6.0, f8.2, f5.2, f6.3)”, A, B, B, C, H
real variable internal value format code external appearance
A -897.6577 f10.3 _ _ -897.658
B 234. f6.0 _ _ 234.
B 234. f8.2 _ _ 234.00
C -0.12 f5.2 -0.12
H 0. f6.3 _ 0.000
14
Explicit format control
f Format code for real input
read (unit = *, fmt = “(f10.4, f8.0, f5.3, f13.6, f9.0, f8.4, f8.2)”, A, B, C, D, E, F, G
real variable internal value field width external appearance
A -897.6577 10 _ -897.6577
B +234. 8 _ _ + _ 234.
C -0.12 5 - . 12 _
D -897.6577 13 -8.976577E+02
E -0.02032 9 -20.32E-3
F +2.032 8 2032.e-3
G 2032.0 8 2.032E3_
IMPORTANT: If a decimal point appears in the input field, the value of d in the format code is ignored; the actual decimal point overrides the format specification.
15
integer I/O
• syntax
read (unit=1,fmt=“(i3,i5)”) Inum,Jnum
write (unit=2,fmt=“(i3,i5)”) Inum,Jnum
---|----- 1 231 Inum=1 Jnum=231
1 22 Inum=10 Jnum=220
16
real I/O
• syntax
read (unit=1,fmt=“(f3.0,f5.2)”) Rnum,Tnum
write (unit=1,fmt=“(f3.0,f5.2)”) Rnum,Tnum
---|-----1.0 2.3 Rnum=1.0 Tnum=2.3
1 2.3 Rnum=1.0 Tnum=2.3
17
real I/O
write (unit=*,fmt=“(e12.4)”) Avar1 01
----------|-- -1.2345e+08
18
repetitive I/O code
• syntax
read (unit=1,fmt=“(3i3)”) Inum1,Jnum1,Inum2
write (unit=2,fmt=“2(i3,i5)”) Inum1,Jnum1, Inum2,Jnum2
fmt=“2(i3,i5)” .eqv. fmt=“(i3,i5,i3,i5)”
fmt=“(3i3)” .eqv. fmt=“(i3,i3,i3)”
---|-----|---|----- 1 231 2 345 Inum1=1 Jnum1=231
Inum2=2 Jnum2=345
19
format longer than list
read (unit=1,fmt=“(3i3)”) Inum1,Jnum1
write (unit=2,fmt=“2(i3,i5)”) Inum1,Jnum1, Inum2
remainings are ignored
output ex:
---|-----|---|----- 1 123 2
20
list longer than format
read (unit=1,fmt=“(3i3)”) Inum1,Jnum1,Inum2,Jnum2
write (unit=2,fmt=“2(i3,i5)”) Inum1,Jnum1, Inum2,Jnum2&
Inum1,Jnum1, Inum2,Jnum2
format rescan
Output ex:
---|------|---|----- 1 123 2 34
3 22 4 443
21
Explicit format controlFORMAT RESCAN
If there are more list items than format codes in the format description, the input or output process must continue to another record in order to complete the list. For example; suppose that we use the format description (f12.4, i3) which specifies an input record containing only two fields. If five data items are be read, the format must be rescanned to match the remaining items of the list. In the first of the following examples, the rescan point is near the middle of the format; in the second, the rescan point is at the repeat count that immediately follows the opening right parenthesis of the format.
(2 (i5, i4, i3), f5.2, 2(i5, i4, i3), f5.2, i6)
^ rescan point
(2 ( 2 (i5, i4, i3), f5.2), i6)
^ rescan point
22
positioning
• advance= yes / nowrite (unit=*,fmt=“(‘ enter Name and Number‘)”,advance=“no”)
read (unit=*,fmt=“(i3,a6)”)) Name,Inum
write (unit=*,fmt=“(‘ student with name ‘,a6,’ has nb ‘,i4)”) Name,Inum
23
positioning
• space x format codewrite (unit=*,fmt=“(4x,’Enter name’,3x)”,advance=“no”)
read (unit=*,fmt=“(a6)”) Name
write (unit=*,fmt=“(3x,’Name entered is’,3x,a6)”) Name
24
positioning
• tabulate t format codewrite (unit=*,fmt=“(t5,’Enter name’,3x)”,advance=“no”)
read (unit=*,fmt=“(a6)”) Name
write (unit=*,fmt=“(t4,’Name entered is’,t21,a6)”) Name
25
positioning
• next record ( line ) / format code
write (unit=*,fmt=“(//4x,’Enter name’,3x)”,advance=“no”)
read (unit=*,fmt=“(a6)”) Name
write (unit=*,fmt=“(/3x,’Name entered is’/,3x,a6/)”) Name
26
I/O statusexception handling
• iostat=Vrbl (integer)
Vrbl = 0 => Opr succeeded
Vrbl > 0 => Error
Vrbl < 0 => EOF , EOR
27
format specification• Format specification with named constantInstead of a literal character constant, a format specifier may be the name of a character
string that contains the format description.
program test
implicit none
real :: A, B, C
integer :: J, K
character (len = *),parameter::F14="(3f12.0, 2i3)"
read (unit = *, fmt = F14) A, B, C, J, K
write (unit = *, fmt =F14) A, B, C, J, K
stop
end program test
28
Files
Here some examples for open statement:
open (unit = 6, file =“My_Data.bin”, status =“old”, action =“read”,&
form = “unformatted”)
open (unit = J, file =“My_Input.txt”, status =“old”, action =“read”)
open (unit = 31, file =“X23”, status =“old”, action =“read”, &
access =“direct”, recl =720)
29
I / O positioningINPUT POSITIONING
Let’s consider an existing file has been connected to unit 7 for sequential access. A rewind initial position property for the connection was specified in the open statement. Suppose that several read statements are then executed.
1) If the file is unformatted, each read will advance the file by one record.2) If the file formatted, each advancing read statement will advance the file by
one record.3) Each non advancing read from a formatted file will advance the file when a
slash is encountered in the format or when rescan occurs, and the position remains within the current record at the end of execution of the statement.
Let us suppose that the end-of-file indicator is encountered. The file is then positioned following the end-of-file indicator, and indication of the end-of-file condition is returned to the program.
30I / O positioning
OUTPUT POSITIONINGNow let’s consider a file that has to be used for sequential output. It is
connected to unit 13 and contains no records, no indication of the end-of-file condition. A rewind initial position property for the connection was specified in the open statement. Suppose that several write statements are then executed.
1) If the file is unformatted, each write will add one record to the file.2) If the file formatted, each advancing write will add at least one record.3) A non advancing write will add a new record when a slash is
encountered in the format or when rescan occurs, but will not end the record after data transfer.
After the desired data has been transmitted to the file, the statement end file may be executed to append an end-of-file indicator following the last record written.
31Direct access input and output
The connection of a file to a unit has an access method, which is sequential or direct. Direct access means that records may be accessed in an arbitrary sequence. Each record of the file has a unique record number that is established when the record is written and does not change. A Record number specifier in the Control List of each read or write statement indicates which record is to be read or written; this specifier has the form
rec = Record number
Record number is an integer expression with a positive value.
Example for direct access output statement:
write (unit = 3, fmt = *, rec = 76) X, Y, Z, Z5
• write statement sends information to record number 76 of unit 3.
32
Unformatted input and output
The connection of a file to a unit has a form which is formatted or unformatted. Unformatted files usually correspond to so-called binary files, whereas formatted files correspond to text files.
Unformatted records contain information in a processor-dependent form that is obtained by transferring data to and from internal storage without any editing or other transformation. The external representation of the data corresponds exactly to its internal representation. Thus, unformatted data transfer is more efficient because the data is merely copied between the external device and the internal storage of the computer.
Formatted records are composed of characters representing data values; a formatted record corresponds to a printed line. Conversion is required between the internal form of the data and its representation on the file.
33formatted internal data transfer
Formatted internal data transfer changes the representation of data without actually transmitting it to or from an external device. Formatted external data transfer includes two separate processes:
a) The change in representation of data between its internal form and its external form.
b) The transmission of data to or from the external device.
In an internal data transfer statement, the integer expression or asterisk Unit specifier in the control list is replaced by the name of a character variable that serves as a buffer or “internal file”.
34formatted internal data transfer
Formatted internal data transfer changes the representation of data without actually transmitting it to or from an external device. Formatted external data transfer includes two separate processes:
a) The change in representation of data between its internal form and its external form.
b) The transmission of data to or from the external device.
In an internal data transfer statement, the integer expression or asterisk Unit specifier in the control list is replaced by the name of a character variable that serves as a buffer or “internal file”.
35program sicaklikinteger, parameter::satir=365,sutun=27real,dimension(satir,sutun)::sicakreal,dimension(sutun)::ortsaatinteger::i,jopen(unit=1,file="d:\f_world\week_10\sicakliklar.txt",status="old", action="read")do i=1,satir read(unit=1,fmt=*)sicak(i,1:sutun) print*,sicak(i,1:sutun)end dodo j=4,sutun ortsaat(j-3)=(sum(sicak(1:satir,j)))/satirend doopen(unit=2,file="d:\f_world\week_10\sicaklik.ort",status="new",action="write")do i=1,sutun-3 write(unit=2,fmt="(f9.3)")ortsaat(i)enddo end program sicaklik