Sensor modulation transfer function measurement using band-limited laser speckle

Sensor modulation transfer function measurement using band-limited laser speckle

Xi Chen,1* Nicholas George,2 Gennadiy Agranov,1 Changmeng Liu1 and Bob Gravelle1

1Aptina Imaging, 3080 N. First Street, San Jose, CA, 95124, USA

2The Institute of Optics, University of Rochester, Rochester, NY, 14627, USA *Corresponding author: [email protected]

Abstract: A new methodology for image sensor modulation transfer function measurement using band-limited laser speckle is presented. We use a circular opal milk glass diffuser illuminated by a 5mW He-Ne laser and a linear polarizer to generate band-limited speckle on the sensor. The power spectral density cut-off frequency of the speckle is chosen to be twice that of the sensor Nyquist frequency by placing the sensor at the specific Z location along the optical axis. For the speckle input, we calculate the power spectral density at the sensor using the Rayleigh-Sommerfeld integral and then measure the output power spectral density for the speckle pattern captured by the sensor. With these data, the two-dimensional image sensor modulation transfer function (MTF) is calculated.

©2008 Optical Society of America

OCIS codes: (130.6010) Sensors; (030.6140) Speckle; (120.0120) Instrumentation, measurement, and metrology

References and links

1. D. N. Sitter, Jr., J. S. Goddard, and R. K. Ferrell, “Method for the measurement of the modulation transfer function of sampled imaging systems from bar-target patterns,” Appl. Opt. 34, 746-751 (1995).

2. M. Estribeau and P. Magnan, “Fast MTF measurement of CMOS imagers using ISO 12233 slanted edge methodology,” Proc. SPIE 5251, 243-251 (2004).

3. B. T. Teipen and D. L. MacFarlane, “Liquid-crystal-display projector-based modulation transfer function measurements of charge-coupled-device video camera systems,” Appl. Opt. 39, 515-525 (2000).

4. J. E. Greivenkamp and A. E. Lowman, “Modulation transfer function measurement of sparse-array sensors using a self-calibrating fringe pattern,” Appl. Opt. 33, 5029-5036 (1994).

5. M. Sensiper, G. D. Boreman, A. D. Ducharme, and D. R. Snyder, “Modulation transfer function testing of detector arrays using narrow-band laser speckle,” Opt. Eng. 32, 395-400 (1993).

6. S. K. Park, R. Schowengerdt, and M. Kaczynski, “Modulation-transfer-function analysis for sampled image systems,” Appl. Opt. 23, 2572-2582 (1984).

7. N. George, A. Jain, and R. D. S. Melville Jr., “Speckle, diffusers, and depolarization,” Appl. Phys. 6, 65-70 (1975).

8. N. George, A. Jain, and R. D. S. Melville Jr., “Experiments on the space and wavelength dependence of speckle,” Appl. Phys. 7, 157-169 (1975).

9. N. George, “Speckle at various planes in an optical system,” Opt. Eng. 25, 754-764 (1986). 10. P. Z. Peebles, Jr., Probability, random variables, and random signal principles, 3rd Ed. (McGraw-Hill,

Inc., New York, 1993). 11. A. Papoulis, “Generalized sampling expansion,” IEEE Trans. Circuits Syst. 24, 652-654 (1977).

1. Introduction

CMOS image sensors are widely used on digital imaging devices. The modulation transfer function (MTF) of the image sensors is an important characteristic to evaluate the overall imaging system quality. The image sensor MTF reflects the spatial frequency response of the sensor. It is determined by the spatial structure and optical and electrical cross-talk of the pixels. There have been several techniques widely used for measuring sensor MTF. For example, the sensor MTF is measured with bar targets [1], slanted edge technique [2], random targets [3], self-calibrating fringe pattern [4], and laser speckle modulated with a double-slit aperture

#102216 - $15.00 USD Received 30 Sep 2008; revised 10 Nov 2008; accepted 14 Nov 2008; published 20 Nov 2008

(C) 2008 OSA 24 November 2008 / Vol. 16, No. 24 / OPTICS EXPRESS 20047

[5]. Among these methods, the slanted edge method is commonly applied in industry. A super resolution scan can be created with a slanted edge [2], which solves the sample-scene phase problem [6]. The random targets method also solves the sample-scene phase problem. However using either a slanted edge or random targets requires a high quality lens to image the targets or patterns on the sensor. This need for a high quality lens greatly limits the application to image sensors with pixel size less than 2.0µm. The laser speckle modulated with a double-slit aperture provides MTF value at one single frequency for each single measurement as well. Also, only one dimensional MTF data depending on the direction of slit apertures is measured. In this paper we present a new method for image sensor MTF measurements using band-limited laser speckle. The setup is simpler compared to other methods and it is particularly well-suited when the pixels are small. There are no lenses or slit apertures used in the setup. The advantage inherent in the use of a speckle pattern for this input is that it contains an excellent range of spatial frequencies from low to very high values. The limiting spatial frequency on the high side is given approximately by D

Zλ in the setup of Fig. 1. The two-

dimensional sensor MTF data are obtained with each measurement. The method is applicable to sensors with small pixels. In Section 2, we present the theory we used to obtain the sensor MTF using band-limited laser speckle. The way to generate and calculate the speckle pattern and power spectral density is described. In Section 3, the experimental results for a 6.0µm monochrome CMOS sensor and a 2.2µm monochrome CMOS sensor are presented. The calculated input power spectral density is also compared with the measured data. The measured sensor MTF using our band-limited laser speckle method is compared with the data obtained using the standard slanted edge technique. The two methods provide results in excellent agreement, which indicates applicability of our developed methodology to characterization of modern CMOS image sensors with small pixel size.

2. Theory of measuring sensor MTF using band-limited laser speckle

Here we describe our methodology of measuring sensor MTF using laser speckle generated by a circular opal milk glass diffuser and a linear polarizer. The speckle theory involved in this method is explained. The power spectral density (PSD) of the speckle pattern on the sensor plane is calculated. The aliasing artifact involved in the sensor MTF measurement is described. The method to avoid aliasing artifact is also presented.

2.1. Speckle theory for sensor MTF measurement

We consider the linearly polarized speckle patterns. In our experimental setup, it is necessary to use a linear polarizer after the opal milk glass (OMG) diffuser in order to obtain a linearly polarized laser speckle pattern. The intensity of the speckle at the input to the sensor plane is a random process ),( yxI with coordinates ( , )x y at the sensor plane. The output signal from the sensor is denoted as ),( yxS . If the response of the sensor is linear and the system is shift-invariant, then the output signal ),( yxS can be expressed as:

∫∫ −−= ,),(),(),( 111111 dydxyyxxhyxIyxS (1)

where h is the impulse response for the image sensor. As explained in [6], the sensor array is not a spatially shift-invariant system. The response is dependent on the relative location of the point source and pixel center. By using the slanted edge or random targets or laser speckle, the sample-scene phases are averaged. With the averaging of the sample-scene phases and the use of speckle pattern, the sensor array becomes spatially shift-invariant as described by Eq. (1). It is well-known that the ensemble-averaged autocorrelation function of the output signal for a spatially shift-invariant linear system is related to the ensemble-averaged autocorrelation function of the input random signal as:



),,(),(),(),( * yxhyxhyxRyxR IS Δ−Δ−∗ΔΔ∗ΔΔ=ΔΔ (2)

where ),( yxRs ΔΔ is the ensemble-averaged autocorrelation function of the captured

speckle intensity pattern; ),( yxRI ΔΔ is the ensemble-averaged autocorrelation function of the

input speckle intensity pattern; h is the impulse response function of the image sensor. We Fourier transform Eq. (2), then we obtain

2( , ) ( , ) ,S x y I x yPSD f f PSD f f MTF= (3)

where ),( yxS ffPSD is the power spectral density (PSD) of the speckle intensity captured

by the CMOS sensor; ),( yxI ffPSD is the PSD of the input speckle intensity on the sensor

plane; MTF is the modulation transfer function for the sensor. Eq. (3) is consistent with the published literature [5]. To measure this sensor MTF, we need to measure the

( , )S x yPSD f f of the speckle pattern captured by CMOS sensor and calculate the input

( , )I x yPSD f f of the speckle on the sensor plane.

One way to obtain the PSD of the input speckle on the sensor plane is to calculate the scalar electric field on the sensor plane. The experimental setup is shown in Fig. 1. The OMG diffuser has a diameter of D=25mm at the input aperture plane. The distance between this aperture plane and the sensor plane is Z. A 5mW He-Ne laser is used for illumination. The collimated laser light illuminates the OMG diffuser. A linear polarizer is placed behind the OMG diffuser so that only a scalar electric field is considered here. In the following paragraphs we describe the diffuser and the calculation of the intensity ( , )I x y received at the CMOS detector.

Fig. 1. Experimental setup

For creating a fully developed speckle pattern at the CMOS detector, it is well-known that one needs to use a volume-type of thick diffuser so that no specular beam is present. Opal milk glass (300 to 700 μ m thickness) is an ideal choice for this, since from electron microscope studies it is known to consist of tiny (0.1 μ m) spheres of higher index material created by thermally cycling glass around the annealing temperature. The output radiation for an input laser beam is fully depolarized with electric field spatial fluctuations in the exiting plane approaching the theoretical limit of / 2λ , see [7]. Alternatively, one can use an integrating sphere instead of OMG since the 100 or so bounces produces a fine source for speckle experiments. However, we have found that the stability to mechanical vibrations of the OMG provides a superior result.



Interesting too, while the field variations at the output of a 25mm OMG may be on the order of 109 in numerical calculations of a fully developed speckle pattern, one can obtain excellent results taking only 104 random points, as we described below [8]. We first generate the scalar electric field ),( 000 yxE on the aperture plane. For visible

light or laser light, the OMG is like an ideal black body. The output radiation is completely unpolarized and fully speckled. Therefore, the phase of the linearly polarized electric field along the y-axis, ),( 000 yxE , on the aperture plane is a uniformly distributed random variable.

Let us assume the electric field ),( 000 yxE as:

0 0( , )0 0 0 0 0( , ) ( , )* ,i x yE x y A x y e θ−= (4)

where 0 0( , )A x y is the amplitude of the electric field. 0 0( , )A x y is a Gaussian function of

0 0( , )x y measured with a power meter. It is expressed as

2 20 02

ln 5( )

2( / 2)0 0( , ) ,

x yDA x y e

− +

= (5)

where 0 0( , )A x y is normalized at the center of the diffuser; 25D mm= which is the

diameter size of the OMG diffuser. With the power meter, we measure the laser illumination intensity at the edge of the OMG diffuser is one fifth of that at the center of the diffuser. Phase ),( 00 yxθ is a random variable with probability density function of

⎪⎪⎩

⎪⎪⎨

⎧<≤

=

.0

10010

1

)(

otherwise

Pπθ

πθθ (6)

With the random field on the aperture plane given by Eqs. (4) to (6), we can calculate the scalar electric field ( , )yE x y on the sensor plane which is located at Z away from the aperture

plane. We calculate the scalar electric field on the sensor plane using the Rayleigh-Sommerfeld integral which is the exact solution to Maxwell equation with the evanescent waves neglected, as shown below:

2 2 20 0

2( ) ( )

0 0 0 0 0 2 2 20 0

( , , ) ( , ,0) ,( ) ( )

i Z x x y y

y

iz eE x y Z dx dy E x y

Z x x y y

πλ

λ

− + − + −∞ ∞

−∞ −∞

=+ − + −∫ ∫ (7)

where ( , , )yE x y Z is the scalar electric field on the sensor plane, Z is the distance

between the aperture plane at 0z = and sensor plane at z Z= and λ is the illumination laser light wavelength. With Eqs. (4) to (7), we calculate the speckle intensity pattern ( , , )I x y Z

which is the absolute square of ( , , )yE x y Z . The laser illumination intensity on the diffuser

has to be measured accurately for an accurate calculation of ( , , )yE x y Z . The reason that we

numerically calculate PSD of the input speckle pattern on the sensor instead of treating ),( yxI ffPSD as the auto-correlation function of the amplitude of the scalar electric filed on

the aperture plane is the Fresnel-zone approximation of Eq. (7) is not valid anymore when Z is comparable with the diffuser size and sensor size. As a part of the numerical simulation of the delta function sources on the opal milk glass, we also include a random position of this



grid by means of uniformly distributed random points 0 0( , )x y . The integration of Eq. (7) is

replaced by summing the kernel of the integral over the aperture plane numerically. To calculate ( , , )yE x y Z accurately, we sample the aperture plane at 0z = with 100 by 100

random points. While the actual number of independent delta-like sources at the exit plane of the diffuser may be on the order of 109, we show by direct computer studies that results of about 1% accuracy can be attained using this sampling of 100 by 100 points. The calculated speckle pattern with 0.6328 mλ μ= , 25 ,D mm= 87Z mm= is shown in Fig. 2.

mm

mm

-0.05 -0.04 -0.03 -0.02 -0.01 0 0.01 0.02 0.03 0.04 0.05

-0.05

-0.04

-0.03

-0.02

-0.01

0

0.01

0.02

0.03

0.04

0.05

Fig. 2. The input speckle pattern calculated for sensor located at 87Z mm= away from the aperture plane.

The transverse coherence length td of the speckle is 2.2µm. td is interpreted as the

variation needed to decorrelate the auto-correlation function of the speckle. It is known [9]

that the transverse speckle size td is given by

.td ZD

λ= (8)

The size of the speckle td is chosen as the pixel size of the sensor by positioning the

sensor with the right distance Z from the OMG diffuser. To measure the MTF of the sensor with pixel size of P , we locate the sensor at z Z= which is given by

.P

Z Dλ

= (9)

Hence, we obtain 87Z mm= for pixel size of 2.2µm. With this choice of Z , the speckle has a PSD that is high enough at the Nyquist frequency of the sensor and becomes 0 at double the Nyquist frequency. This can be seen in Fig. 3. We calculate the ( , )x yPSD f f of the speckle from the definition of PSD [10] which is

given by



2

,

( , )( , ) lim ,

XY x y

x yX Y

E u f fPSD f f

XY→∞= (10)

where ,X Y are the overall size of the speckle pattern along the x and y axes, respectively.

,X Y should be much larger than the average size of the speckle. For example, we choose

111X Y mμ= = for speckle of 2.2µm size as shown in Fig. 2. In Eq. (10), E • stands for

the operation of ensemble average over independent samples. To obtain an accurate PSD, we ensemble average 150 independent samples. In Eq. (10), ( , )XY x yu f f is the Fourier transform

of the zero-mean speckle intensity, ( , ) ( , )I x y I x y− . ( , )I x y is the mean value of the speckle

intensity ( , )I x y over the spatial range ,X Y . By calculating the Fourier transform of the

zero-mean speckle intensity instead of the speckle intensity ( , )I x y , we exclude the δ-function at the DC component of the PSD. As an example, we show PSD of the calculated 2.2µm size speckle in Fig. 3. The δ-function at zero frequency of the PSD is excluded to calculate the sensor MTF. The solid curve is the calculated PSD plot with ensemble averaging over 150 independent samples. The dashed curve is the polynomial fitting of the calculated PSD curve. The x-axis is the spatial frequency in units of the Nyquist frequency of 2.2µm pixel. We use Ny to stand for the Nyquist frequency. Here Ny=227.3cys/mm for a 2.2µm pixel size sensor.

0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8 20

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Spatial frequency (unit in Ny)

PS

D

Calculated PSD curve with ensemble averageover 150 samplesPolynomial fitted PSD curve

Fig. 3. The PSD of the speckle pattern shown in Fig. 2. The δ-function at zero frequency of the speckle PSD is excluded. The solid curve in black is the calculated PSD plot with ensemble averaging over 150 independent samples. The dashed curve in red is the polynomial fitting of the PSD curve. The x-axis is the spatial frequency in units of the Nyquist frequency. We use Ny to stand for the Nyquist frequency. Here Ny=227.3cys/mm for the 2.2µm pixel size. It is clear that the PSD is much higher than 0 at the Nyquist frequency of the sensor. The cut-off frequency of the PSD is 2Ny.

2.2 Avoid aliasing in the sensor MTF measurement

To maintain high signal at the Nyquist frequency of the sensor, the input PSD for the speckle has a cut-off frequency at 2Ny as shown in Fig. 3. The higher cut-off frequency than Ny causes aliasing artifacts in the PSD of the measured speckle pattern on the sensor. From Eq. (3), we see that the aliasing in ),( yxS ffPSD causes inaccurate measurement of sensor MTF.

To avoid aliasing artifacts in the measurement, we sub-sample the speckle pattern on the sensor with half pixel size so that the sub-sampled speckle image has Nyquist frequency of 2Ny. The sub-sampling is done by recording the speckle pattern on the sensor at a zero



shifting location, then shifting the sensor by a half-pixel along the x-axis location, shifting the sensor by a half-pixel along the y-axis location and shifting the sensor by half-pixels along both the x- and the y-axes location. We then obtain the half-pixel sampled speckle image by combining these four images using the Generalized Sampling Theorem [11]. The

),( yxS ffPSD of the half-pixel sampled speckle image has a Nyquist frequency of 2Ny. There

are no aliasing artifacts on it. Figs. 4 show the concept of our anti-aliasing method. Mathematically, the anti-aliasing by sub-sample is achieved by the following procedure:

1 1

0 0

( , ) [ ( , ) ( , ) ( ) ( )],jib

i j n m

y nP sx mP rI x y h x y I x y

P Pδ δ

∞ ∞

= = =−∞ =−∞

− −− −= ⊗∑∑ ∑ ∑ (11)

where bI is the captured speckle pattern, h is the impulse response function of the image

sensor, I is the input speckle pattern on the sensor, P is the pixel size of the sensor and ir ,

js are the sub-sample shift movements along the x- and y-axes, respectively. ⊗ stands for

the convolution operator. The Fourier transform of Eq. (11) is expressed in Eq. (12) as:

1 1 2 ( )

0 0

( , ) [ ( , ) ( , ) ],ji

nsmri

P Pb x y x y x y

i j n m

m nf f H f f f f e

P P

πχ χ

∞ ∞ − +

= = =−∞ =−∞= − −∑∑ ∑ ∑i (12)

where bχ is the Fourier transform of bI , H is the Fourier transform of h , and χ is the

Fourier transform of I . From Eq. (12), we can see that the Fourier transform of the detected laser speckle pattern consists of the non-aliased term for 0m = , 0n = and higher order

terms when 0m ≠ or 0n ≠ . To avoid aliasing, we choose ir and js as 0 0r = ,

1 0.5r P= , 0 0s = and 1 0.5s P= for the four sub-sample recording positions. With this

choice, the 0, 1m n= = ± term, 1, 0m n= ± = term and 1, 1m n= ± = ± term are all zero in Eq. (12). The even higher orders are not considered because the laser speckle pattern has limited bandwidth of 2Ny.

Fig. 4. (a) The cross-section of the measured speckle ( ,0)s xPSD f shown in dash curve is

aliased due to the sensor Nyquist frequency (Ny) is lower than the speckle PSD cut-off frequency which is twice the Nyquist frequency. The solid curves are the ( ,0)xPSD f without

aliasing. The repeating of the unaliased PSD with a period of 2Ny is due to the discrete sampling of 1/(2 )Ny by the sensor in the space domain.



Fig. 4. (b) The cross-section of the sub-sampled speckle PSD. There is no aliasing artifacts because the sub-sampling has sampling size corresponding to twice the Nyquist frequency of the sensor.

The inaccuracy of the sub-sample shift movements 1r and 1s could lead to non-zero higher

order terms in Eq. (12) and therefore the error in sensor MTF. Let us define the deviation of

1r and 1s from half pixel as xΔ and yΔ . xΔ and yΔ are in the range of (-0.5P, 0.5P). We

require each aliased term such as 1, 0m n= = be less than five percentages of the non-aliased term to guarantee less than five percentages error in sensor MTF measurement. This requirement could be written as Eq. (13) for 1, 0m n= = term.

2

2 2 0.05.xi

Peπ Δ−

− ≤ (13)

To obtain five percentages error in the measurement, 3, 4*10 .x y P−Δ Δ ≤ For a 2.2µm

pixel-sized sensor, the translational stage for the sub-sample movement needs a resolution of 8.75nm. This number is on the same order of magnitude as the sensor pixel alignment tolerance which is a few nanometers. This requirement on the sub-sample shift movement can be met with commercial ultra-precision motor stages which have 1nm resolution.

3. Experimental results

We present the MTF measurement of Aptina’s monochrome CMOS sensor MI350 with 6.0µm pixel size in Section 3.1. We investigate the applicability of the developed technique to measure MTF of the monochrome image sensor to avoid effects of color filters on sensor MTF measurements. The applicability of the developed methodology to color image sensors will be considered in the future. The speckle method is compared with the slanted edge method. The data from two methods are within excellent agreement. The results for another Aptina’s monochrome CMOS sensor MI5100 with 2.2µm pixel size are described in Section 3.2.

3.1 On-axis MTF measurement for a monochrome CMOS sensor with 6.0µm pixels

Using Eq. (9) and a pixel size of 6.0P mμ= , we locate the sensor at 237Z mm= away from the 25mm OMG diffuser. Image sensor works in the linear mode of operation. Integration time is adjusted to provide the signal from the brightest part of the speckle pattern close to the linear full well capacity. All digital correction circuitries are disabled. The speckle pattern is recorded in a raw image data format. To measure the on-axis sensor MTF, the OMG diffuser and the image sensor are both placed perpendicular to the optical axis which is determined by the collimated He-Ne laser light. To obtain the PSD of the speckle on the sensor, we ensemble average over speckle patterns generated with 25 OMG diffusers. For each OMG diffuser, we record speckle patterns at 4 locations- no sensor shift, sensor shifted by 3.0µm along the x-axis with a linear piezoelectric transducer (PZT), sensor shifted by 3.0µm along



the y-axis and sensor shifted by 3.0µm along both the x- and the y-axes. The x-axis is along the row direction of the sensor. The y-axis is along the column direction of the sensor. At each location, multiple frames are recorded and then averaged to eliminate temporal noise of the sensor. As explained in Section 2, we obtain the PSD of the speckle on the sensor,

),( yxS ffPSD , from the half pixel sub-sampled speckle patterns on the sensor. The cross-

sections of ),( yxS ffPSD along the x- and the y-axes are shown in Figs. 5. The spatial

frequency range is from 0 to 2Ny of the sensor. The side lobes in Fig. 5(b) may be due to the limited accuracy of movement along the y-axis of the PZT. The gravity of the PZT stage, sensor and other mechanical mounts may cause the shift of the sensor along the y-axis is not 3µm. This inaccurate shift causes error in the PSD.

0 20 40 60 80 100 120 140 1600

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Spatial frequency (cys/mm)

PS

D

Fig. 5. (a) The x-axis cross-section of the measured PSD the speckle pattern on the 6.0µm pixel size CMOS sensor. The spatial frequency range is from 0 to 2Ny.

0 20 40 60 80 100 120 140 1600

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1


PS

D

Fig. 5. (b) The y-axis cross-section of the measured PSD of the speckle pattern on the 6.0µm pixel size CMOS sensor. The x-axis in the plot is the spatial frequency. The range is from 0 to 2Ny.

The input power spectral density ),( yxI ffPSD is calculated as described in Section 2.

The calculated cross-section of ),( yxI ffPSD is shown in Fig. 6 as the dashed black curve.



To testify the accuracy of the theoretical calculation of ),( yxI ffPSD , we measure the

speckle pattern with a 2.2µm pixel size monochrome CMOS sensor. The measured power spectral density ( , )s x yPSD f f including the 2.2µm pixel size MTF and the PSD of 6µm-size

speckle pattern is plotted in Fig. 6 as the black solid curve. The loss of smoothness in the measured power spectral density curve is due to the limited number of ensemble average. The curve will be smooth if we do ensemble average over more diffusers. To take the 2.2µm pixel-size monochrome CMOS sensor MTF into account, the product of the theoretical calculation of ),( yxI ffPSD and the square of 2.2 µm sensor MTF is plotted as the red

dotted curve in Fig. 6. The measurement of 2.2 µm sensor MTF is described in Section 3.2 and the data are shown in Fig. 9. Comparing the three curves in Fig. 6, we can conclude that the theoretical calculation of the input PSD of the speckle on the sensor plane, ),( yxI ffPSD ,

is very accurate.

0 20 40 60 80 100 120 140 1600

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1


PS

D

Measured PSD with a2.2um pixel size sensorTheoretical calculationof PSDTheoretical PSD *Measured

2.2um pixel size sensor MTF2

Fig. 6. The comparison between the theory and measurement of the input power spectral

density, ),( yxI ffPSD . The average speckle size is 6µm. The theoretical calculation is

shown in black dashed curve. The measured data is shown in black solid curve. The measured

),( yxI ffPSD data is captured with a 2.2µm sensor. The product of the theoretical

calculation of ),( yxI ffPSD and the square of 2.2µm sensor MTF is shown as the dotted

red curve. The theoretical calculation and experimental data agree with each other very well. Using Eq. (3) with calculated input ( , )I x yPSD f f and the measured ),( yxS ffPSD data

for a 6.0µm CMOS sensor, we obtain the MTF data for the 6.0µm monochrome CMOS sensor. The measured sensor MTF along the x-axis is shown in Fig. 7 as the dotted blue curve. The polynomial fitting of it is shown in Fig. 7 as the solid red curve. As a comparison, the measured MTF along the x-axis using the slanted edge technique is shown in Fig. 7 as the dash-dot green curve. To obtain the MTF data using the slanted edge technique, the ISO12233 target is imaged by a diffraction-limited lens with F# of 9.0 onto the CMOS sensor. A red color filter is used for illumination. The lens F# is chosen to match the equivalent F# of

/Z D in the speckle setup. The lens MTF is measured by the Fisba interferometer. The lens and sensor overall MTF is estimated using the Imatest software from the slanted edge image. We obtain the sensor MTF using the slanted edge technique by dividing the overall MTF with the diffraction-limited lens MTF. From Fig. 7, we can see that the laser speckle method and the ISO12233 slanted edge technique provide very similar sensor MTF results. The



agreement between the two measurements proves the accuracy of the laser speckle method for MTF measurement of a sensor.

0 10 20 30 40 50 60 70 800

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1


MTF

Measured sensor MTF using speckle methodFitted sensor MTF from measured sensor MTF datausing speckle methodMeasured sensor MTF using slanted edge method

Fig. 7. The 6.0µm monochrome CMOS sensor MTFs along the x-axis. The dotted blue curve is the measured sensor MTF using laser speckle method; the solid red curve is the polynomial fitting of the measured sensor MTF data using speckle method; the dash-dot green curve is the measured sensor MTF using the slanted edge method. The range of the spatial frequency is from 0 to the Nyquist frequency of the 6.0µm sensor.

3.2 On-axis MTF measurement for a monochrome CMOS sensor with 2.2µm pixels

With the development of CMOS technology, the pixel size has shrunk dramatically. With small pixel size less than 2µm, the slanted edge technique is limited by the lens quality. Due to the fact that laser speckle method does not require using a lens, we consider this approach as a very promising technique for measuring the MTF of modern CMOS image sensors with small and super small pixels. In this section, we describe the experimental results for measuring MTF of Aptina’s MI5100 monochrome image sensor with 2.2µm pixel size. To obtain the input PSD of the speckle with cut-off frequency at twice the Nyquist frequency of the sensor, the sensor is placed at 87Z mm= away from the OMG diffuser. The same procedures for a 6.0µm sensor MTF measurement are repeated. The input power spectral density ),( yxI ffPSD is calculated and shown in Fig. 3. The measured ),( yxS ffPSD

along the x-axis is shown in Fig. 8.



0 50 100 150 200 250 300 350 400 4500

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1


PS

D

Fig. 8. The measured power spectral density, ),( yxS ffPSD , cross-section along the x-axis

for a 2.2µm pixel size monochrome CMOS sensor. The range of the spatial frequency is from 0 to twice the Nyquist frequency.

Using Eq. (3), we could derive the MTF for the sensor. The cross-section of the MTF along the row direction is shown in Fig. 9. As a comparison, the MTF of the sensor is measured using the slanted edge technique with a lens of F# 3.5. These two techniques provide very close results as shown in Fig. 9. This proves the applicability of measuring small pixel sensors with band-limited speckle pattern.

0 50 100 150 2000

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1


MTF

Measured sensor MTF along the x-axis usingspeckle techniqueFitted MTF from measured data using speckle techniqueMeasured sensor MTF using slanted edge technique

Fig. 9. The cross-section of MTF along the x-axis for a 2.2µm pixel-size monochrome CMOS sensor. The black solid curve is the measured sensor MTF using laser speckle technique. The red dash curve is the polynomial fitting of the measured MTF using speckle technique. The green dash-dot curve is the measured sensor MTF using the slanted edge technique with a F#3.5 lens. The range of the spatial frequency is from 0 to the Nyquist frequency of a 2.2µm sensor .

4. Conclusions

For high-performance integrated optical and digital imaging systems, it is essential to have the capability for measuring the response of the sub-systems and the overall system. In this paper we describe a new method for measuring the MTF, hence the performance of the CMOS detector. We show quantitatively that this metrology system for the MTF is accurate and presents results in agreement with MTF measurements using the standard ISO 12233 slanted edge technique. Importantly, we assert that this novel speckle method is particularly



advantageous for sensors even with pixel size down to 1µm. Moreover, the speckle method can be used to measure the MTF of the sensor alone since it does not require the use of a high-quality lens nor the fabrication of special test masks. To measure sensor MTF at high spatial frequencies around the Nyquist frequency of the sensor, we place the sensor at Z away from the diffuser. Z is defined by Eq. (9). For the speckle, we present how to calculate the input power spectral density ),( yxI ffPSD using

the Rayleigh Sommerfeld integral. To testify the accuracy of our calculation, we measure the PSD of 6µm-size speckle by a 2.2µm pixel-size sensor. The theoretical calculation and measurement data are presented in Fig. 6. They agree with each other very well. Two monochrome CMOS sensors are measured. To avoid aliasing artifacts due to the insufficient sampling of the speckle patterns by the sensors, we sub-sample the speckle patterns by shifting the sensors with half pixel size steps. The anti-aliasing concept is shown in Figs. 4. The error due to inaccurate sub-sample shift movements is discussed. The requirement on sub-sample shift accuracy for five percentages error or less is provided in Eq. (13). The MTF data for a 6.0µm pixel sensor are shown in Fig. 7 compared with the MTF data measured by the ISO12233 slanted edge method. The two results are in excellent agreement. The MTF data for a 2.2µm pixel sensor are shown in Fig. 9. The results obtained with the speckle technique and the slanted edge technique are very close. This agreement proves the accuracy of our laser speckle technique. As a next step we are planning to extend this new MTF measurement technique on color sensors and sensors with shifted µlenses used in mobile applications.

Acknowledgments

We acknowledge Dr. Wanli Chi at the Institute of Optics, University of Rochester for his helpful discussions and suggestions. We acknowledge our colleagues Doug Fettig, Ian Clark, Sergey Velichko, Feng Li, Dmitry Bakin, Donna Cao, Elaine Jin, Igor Karasev, and Stephen Beveridge for their support.



Date post:	01-Oct-2016
Category:	Documents
Upload:	bob
View:	214 times
Download:	2 times

Sensor modulation transfer function measurement using band-limited laser speckle

Documents