+ All Categories
Home > Documents > ISSCC 2005 / SESSION 19 / IMAGERS / 19A depth map is evaluated by measuring TOF of a ray of light as...

ISSCC 2005 / SESSION 19 / IMAGERS / 19A depth map is evaluated by measuring TOF of a ray of light as...

Date post: 24-Mar-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
3
364 2005 IEEE International Solid-State Circuits Conference 0-7803-8904-2/05/$20.00 ©2005 IEEE. ISSCC 2005 / SESSION 19 / IMAGERS / 19.10 19.10 A Single Photon Detector Array with 64×64 Resolution and Millimetric Depth Accuracy for 3D Imaging Cristiano Niclass, Edoardo Charbon Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland 3D imaging, the capability of reproducing a depth map from an arbitrary object or scene, has a variety of uses in science, engi- neering, medicine and entertainment. Depth can be optically determined by measuring the time-of-flight (TOF) of a light source pulsed at a fixed repetition rate. At least two implementa- tions of this concept have been proposed in the literature. In the first approach a rangefinder uses a single collimated laser beam to scan the scene by means of a high-precision, high-cost mechan- ical device [1]. The second approach is based on an array of con- ventional CMOS pixels independently measuring TOF from the target’s reflection of a wide cone of light [2]. Due to major per- pixel read-out circuitry, only small linear arrays of pixels are practical and limited accuracy is achieved at a cost of powerful lasers. Recently, a 3D imager achieving sub-millimeter depth accuracy with very-low system power dissipation was demon- strated [3]. The core of the system, an array of 8×4 single photon avalanche diodes (SPADs), exhibits low jitter and high sensitivi- ty, thus requiring low photon count to achieve picosecond TOF precision. In this paper, a 3D imager of the second generation based on SPAD technology is presented. The main improvements include a complete pixel redesign to enable higher sensitivity, pitch reduc- tion, and a massive array expansion. TOF is now computed on each pixel independently by means of an accurate CMOS time-to- digital-converter (TDC). The imager achieves millimeter accura- cies to 3.75m. The light source, an uncollimated low-power pulsed laser with 635nm wavelength, enables a scene of several cubic meters to be surveyed. The sensing element is a 32×32 pixel array fabricated in 0.8μm CMOS technology. A lateral resolution of 64×64 pixels is achieved by means of a low-cost micro-scanning device embedded in the chip package. SPAD technology is described in detail in [4]. Figure 19.10.1 shows the cross-section, photomicrograph, and schematic of a pixel. The photo-multiplication region is formed at the deep n- wellp+ junction. When reverse-biased above the breakdown voltage V bd by an excess voltage V e , the optical gain is infinity. To avoid overheating the device, the avalanche is quenched via a resistive load. During avalanche, a steep current pulse is gener- ated that, in turn, causes a voltage pulse. The voltage pulse is regenerated by means of an inverter designed to generate a digi- tal output. After the quenching phase, the SPAD must return to the original bias voltage; during this time, known as dead time, it remains inactive. The probability an avalanche is triggered is the photon detection probability η. Thermal and tunneling generation effects produce spurious pulses at a given rate, or dark count rate (DCR). The schematic of a pixel shows a SPAD detector, quenching tran- sistor T q , an inverter, and a switch to route the digital signal to the nearest column. The switch is controlled by ROWSEL that activates the entire row. PMOS T q replaced the poly resistance in [3] to save area. Lateral n-well inter-diffusions [3] are replaced by p-wells (Fig. 19.10.1). Though edge breakdown prevention is as effective, pixel pitch is reduced by 23%. Since the output of SPADs is digital, the sensor architecture may be highly simpli- fied. Figure 19.10.2 illustrates the optical response of a pixel. Due to the high sensitivity of SPADs, remarkable dead time and the absence of read-out noise, a dynamic range of 120dB is obtained. Figure 19.10.3 shows the photomicrograph of the die. The archi- tecture includes the SPAD array, row and column decoders, a power supply bus for core and V op , and a 15b counter for 2D sen- sor operation for a total area of 7mm 2 . A depth map is evaluated by measuring TOF of a ray of light as it is independently reflected by each point in the scene. Depth is computed as d = TOF (c/2), where c is the speed of light. A CMOS TDC is started by the laser trigger and stopped by the pulse gen- erated by a SPAD. The device, a ATMD-F1 by ACAM, employs a technique based on racing set-up times on a delay line whose mean propagation delay is locked by a PLL for temperature sta- bility. Depth accuracy is enhanced by averaging M independent measurements. The fillfactor of SPADs is generally 1~10%, compared to 20~60% in CMOS APS. Due to the single photon sensitivity of SPADs, this parameter is not critical for performance. A small fillfactor how- ever, in combination with zero optical crosstalk, is used to our advantage to enhance x-y resolution. The idea is to simulate higher pixel density by capturing several images of the same object from different points of view. This task can be achieved by exploiting the movement of the target or by transversally rotat- ing the lens [5]. In this design the choice is to fix the lens and the target and to move the SPAD array instead, using the transla- tional forces of low-cost piezo-electric actuators. This solution allows a simple, robust and compact micro-mechanical setup, no closed-loop control, and high accuracy. The maximum possible x- y resolution enhancement is E max =X/xY/y, where X, Y are horizontal and vertical pitch and x, y are horizontal and vertical sizes of the pixel active area. In this case, for a X/Y pitch of 58μm and a 7μm active area diameter, E max =64, while E=4 is selected. The micro-scanning scheme is depicted in Fig. 19.10.4 for E=4. The actuators were embedded into the package of the sensor, thus minimizing the impact on miniaturization. The 3D imager is tested with a pulsed laser with repetition rate f R =40MHz, thus ensuring a range D=3.75m. The light is focused onto the sensor chip by means of a standard camera lens. Figure 19.10.5 shows the electro-optical setup, with the fabricated micro- scanner in the inset. A peak power P s =250mW was selected with pulse width T P =100ps. The time uncertainty σ(τ) of one measure- ment is estimated to 350ps, while the TDC resolution was set to 60ps. Utilizing M=10 4 measurements, a 100-fold theoretical improvement, or an rms depth accuracy σ(d)=0.53mm, is expect- ed, while the measured overall rms accuracy is 1.3mm. The degradation is due to non-uniform illumination thereby effective- ly reducing the average number of valid TOF measurements achievable per pixel. The imager is used to take detailed depth maps of a human face as shown in Fig. 19.10.6. Acknowledgements: The project was supported by grant of the Swiss National Science Foundation – Grant Nr.: 620-066110. The authors would like to thank Pierre-André Besse, Alexis Rochas, and André Guignard. References: [1] J. Massa et al., “Optical Design and Evaluation of a Three-Dimensional Imaging and Ranging System based on Time-Correlated Single-Photon,” Applied Optics, vol. 41, no. 6, pp. 1063-1070, Feb., 2002. [2] O.M. Schrey et al., “A 4×64 Pixel CMOS Image Sensor for 3D Measurement Applications,” Proc. ESSCIRC, pp. 333-336, Sept., 2003. [3] C. Niclass et al., “A CMOS Single Photon Avalanche Diode Array for 3D Imaging,” ISSCC Dig. Tech. Papers, pp. 120-121, Feb., 2004. [4] A. Rochas, “Single Photon Avalanche Diodes in CMOS technology,” Ph.D. Thesis, Swiss Federal Institute of Technology, Lausanne, 2003. [5] O. Landolt et al., “Visual Sensor with Resolution Enhancement by Mechanical Vibrations,” Proc. Advanced Research in VLSI, pp. 249-64, 2001. ˆ
Transcript
Page 1: ISSCC 2005 / SESSION 19 / IMAGERS / 19A depth map is evaluated by measuring TOF of a ray of light as it is independently reflected by each point in the scene. Depth is computed as

364 • 2005 IEEE International Solid-State Circuits Conference 0-7803-8904-2/05/$20.00 ©2005 IEEE.

ISSCC 2005 / SESSION 19 / IMAGERS / 19.10

19.10 A Single Photon Detector Array with 64×64Resolution and Millimetric DepthAccuracy for 3D Imaging

Cristiano Niclass, Edoardo Charbon

Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland

3D imaging, the capability of reproducing a depth map from anarbitrary object or scene, has a variety of uses in science, engi-neering, medicine and entertainment. Depth can be opticallydetermined by measuring the time-of-flight (TOF) of a lightsource pulsed at a fixed repetition rate. At least two implementa-tions of this concept have been proposed in the literature. In thefirst approach a rangefinder uses a single collimated laser beamto scan the scene by means of a high-precision, high-cost mechan-ical device [1]. The second approach is based on an array of con-ventional CMOS pixels independently measuring TOF from thetarget’s reflection of a wide cone of light [2]. Due to major per-pixel read-out circuitry, only small linear arrays of pixels arepractical and limited accuracy is achieved at a cost of powerfullasers. Recently, a 3D imager achieving sub-millimeter depthaccuracy with very-low system power dissipation was demon-strated [3]. The core of the system, an array of 8×4 single photonavalanche diodes (SPADs), exhibits low jitter and high sensitivi-ty, thus requiring low photon count to achieve picosecond TOFprecision.

In this paper, a 3D imager of the second generation based onSPAD technology is presented. The main improvements include acomplete pixel redesign to enable higher sensitivity, pitch reduc-tion, and a massive array expansion. TOF is now computed oneach pixel independently by means of an accurate CMOS time-to-digital-converter (TDC). The imager achieves millimeter accura-cies to 3.75m. The light source, an uncollimated low-power pulsedlaser with 635nm wavelength, enables a scene of several cubicmeters to be surveyed. The sensing element is a 32×32 pixel arrayfabricated in 0.8µm CMOS technology. A lateral resolution of64×64 pixels is achieved by means of a low-cost micro-scanningdevice embedded in the chip package.

SPAD technology is described in detail in [4]. Figure 19.10.1shows the cross-section, photomicrograph, and schematic of apixel. The photo-multiplication region is formed at the deep n-wellp+ junction. When reverse-biased above the breakdownvoltage Vbd by an excess voltage Ve, the optical gain is infinity. Toavoid overheating the device, the avalanche is quenched via aresistive load. During avalanche, a steep current pulse is gener-ated that, in turn, causes a voltage pulse. The voltage pulse isregenerated by means of an inverter designed to generate a digi-tal output. After the quenching phase, the SPAD must return tothe original bias voltage; during this time, known as dead time, itremains inactive. The probability an avalanche is triggered is thephoton detection probability η. Thermal and tunneling generationeffects produce spurious pulses at a given rate, or dark count rate(DCR).

The schematic of a pixel shows a SPAD detector, quenching tran-sistor Tq, an inverter, and a switch to route the digital signal tothe nearest column. The switch is controlled by ROWSEL thatactivates the entire row. PMOS Tq replaced the poly resistance in[3] to save area. Lateral n-well inter-diffusions [3] are replaced byp-wells (Fig. 19.10.1). Though edge breakdown prevention is aseffective, pixel pitch is reduced by 23%. Since the output ofSPADs is digital, the sensor architecture may be highly simpli-fied. Figure 19.10.2 illustrates the optical response of a pixel. Dueto the high sensitivity of SPADs, remarkable dead time and the

absence of read-out noise, a dynamic range of 120dB is obtained.Figure 19.10.3 shows the photomicrograph of the die. The archi-tecture includes the SPAD array, row and column decoders, apower supply bus for core and Vop, and a 15b counter for 2D sen-sor operation for a total area of 7mm2.

A depth map is evaluated by measuring TOF of a ray of light asit is independently reflected by each point in the scene. Depth iscomputed as d = TOF (c/2), where c is the speed of light. A CMOSTDC is started by the laser trigger and stopped by the pulse gen-erated by a SPAD. The device, a ATMD-F1 by ACAM, employs atechnique based on racing set-up times on a delay line whosemean propagation delay is locked by a PLL for temperature sta-bility. Depth accuracy is enhanced by averaging M independentmeasurements.

The fillfactor of SPADs is generally 1~10%, compared to 20~60%in CMOS APS. Due to the single photon sensitivity of SPADs, thisparameter is not critical for performance. A small fillfactor how-ever, in combination with zero optical crosstalk, is used to ouradvantage to enhance x-y resolution. The idea is to simulatehigher pixel density by capturing several images of the sameobject from different points of view. This task can be achieved byexploiting the movement of the target or by transversally rotat-ing the lens [5]. In this design the choice is to fix the lens and thetarget and to move the SPAD array instead, using the transla-tional forces of low-cost piezo-electric actuators. This solutionallows a simple, robust and compact micro-mechanical setup, noclosed-loop control, and high accuracy. The maximum possible x-y resolution enhancement is Emax=X/xY/y, where X, Y arehorizontal and vertical pitch and x, y are horizontal and verticalsizes of the pixel active area. In this case, for a X/Y pitch of 58µmand a 7µm active area diameter, Emax=64, while E=4 is selected.The micro-scanning scheme is depicted in Fig. 19.10.4 for E=4.The actuators were embedded into the package of the sensor, thusminimizing the impact on miniaturization.

The 3D imager is tested with a pulsed laser with repetition ratefR=40MHz, thus ensuring a range D=3.75m. The light is focusedonto the sensor chip by means of a standard camera lens. Figure19.10.5 shows the electro-optical setup, with the fabricated micro-scanner in the inset. A peak power Ps=250mW was selected withpulse width TP=100ps. The time uncertainty σ(τ) of one measure-ment is estimated to 350ps, while the TDC resolution was set to60ps. Utilizing M=104 measurements, a 100-fold theoreticalimprovement, or an rms depth accuracy σ(d)=0.53mm, is expect-ed, while the measured overall rms accuracy is 1.3mm. Thedegradation is due to non-uniform illumination thereby effective-ly reducing the average number of valid TOF measurementsachievable per pixel. The imager is used to take detailed depthmaps of a human face as shown in Fig. 19.10.6.

Acknowledgements:The project was supported by grant of the Swiss National ScienceFoundation – Grant Nr.: 620-066110. The authors would like to thankPierre-André Besse, Alexis Rochas, and André Guignard.

References:[1] J. Massa et al., “Optical Design and Evaluation of a Three-DimensionalImaging and Ranging System based on Time-Correlated Single-Photon,”Applied Optics, vol. 41, no. 6, pp. 1063-1070, Feb., 2002.[2] O.M. Schrey et al., “A 4×64 Pixel CMOS Image Sensor for 3DMeasurement Applications,” Proc. ESSCIRC, pp. 333-336, Sept., 2003.[3] C. Niclass et al., “A CMOS Single Photon Avalanche Diode Array for 3DImaging,” ISSCC Dig. Tech. Papers, pp. 120-121, Feb., 2004.[4] A. Rochas, “Single Photon Avalanche Diodes in CMOS technology,”Ph.D. Thesis, Swiss Federal Institute of Technology, Lausanne, 2003.[5] O. Landolt et al., “Visual Sensor with Resolution Enhancement byMechanical Vibrations,” Proc. Advanced Research in VLSI, pp. 249-64,2001.

ˆ

Page 2: ISSCC 2005 / SESSION 19 / IMAGERS / 19A depth map is evaluated by measuring TOF of a ray of light as it is independently reflected by each point in the scene. Depth is computed as

365DIGEST OF TECHNICAL PAPERS •

Continued on Page 604

ISSCC 2005 / February 8, 2005 / NOB HILL / 5:00 PM

Figure 19.10.1: Simplified cross-section, photomicrograph and schematic ofa pixel. VDD=5V, Vop=-25.5V, and Ve = |Vop|+VDD-Vbd. Figure 19.10.2: Pixel optical response and dynamic range.

Figure 19.10.3: Chip photomicrograph.

Figure 19.10.5: Camera set-up. Figure 19.10.6: 3D surface of a human face at a TOF range of 3m.

Figure 19.10.4: x-y resolution enhancement via micro-scanning.

58 m

7 m

58 m

(+29 m, 0)

(0,-29 m)

(-29 m, 0)

(0,+29 m)

PULSED LASER

CMOS SPAD SENSOR

CMOSTDC

TARGET

MICRO-SCANNER

19

Page 3: ISSCC 2005 / SESSION 19 / IMAGERS / 19A depth map is evaluated by measuring TOF of a ray of light as it is independently reflected by each point in the scene. Depth is computed as

604 • 2005 IEEE International Solid-State Circuits Conference 0-7803-8904-2/05/$20.00 ©2005 IEEE.

ISSCC 2005 PAPER CONTINUATIONS

Figure 19.10.7: Performance summary.

Measure Symbol Value Unit

Photo Detection probability

η 12 %

Dark count rate DCR 350 Hz

Pixel Fill factor - 1 %

Jitter - 50 ps

Dynamic range DR 120 dB

Dead time td < 40 ns

Distance range D 3.75 m

Time uncertainty σ(τ) 350 ps

RMS Distance accuracy σ(d) 1.3 mm

Sensor Mean number of measurements per second

- 3x104 1/s

Power dissipation Ptot < 6 mW

Sensitivity - 1.3x10-3 Lx

Repetition rate fR 40 MHz

Peak power SP̂ 250 mW

Source Average power SP < 1 mW

Wavelength λ 635 nm

RMS Pulse width Tp < 100 ps


Recommended