Staring array: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
Stevenkan (talk | contribs)
mNo edit summary
Citation bot (talk | contribs)
Removed proxy/dead URL that duplicated identifier. Removed access-date with no URL. | Use this bot. Report bugs. | #UCB_CommandLine
 
(45 intermediate revisions by 34 users not shown)
Line 1: Line 1:
{{Short description|Image sensor made of light-sensing pixels}}
A '''staring array''', '''staring-plane array''', '''focal-plane array''' (FPA) or '''focal-plane''' is an image sensing device consisting of an array (typically rectangular) of light-sensing pixels at the focal plane of a lens. FPAs are used most commonly for imaging purposes (e.g. taking pictures or video imagery), but can also be used for non-imaging purposes such as [[spectrometry]], [[LIDAR]], and [[wave-front sensing]]. Technically the term "FPA" can refer to a variety of imaging device types, but in common usage it refers to two-dimensional devices that are sensitive in the [[infrared]] spectrum. Devices sensitive in other spectra are usually referred to by other terms, such as [[CCD]] (charge-coupled device) and [[CMOS image sensor]] in the visible spectrum. FPAs operate by detecting photons at particular wavelengths and then generating an electrical charge, voltage, or resistance in relation to the number of photons detected at each pixel. This charge, voltage, or resistance is then measured, digitized, and used to construct an image of the object, scene, or phenomenon that emitted the photons.
{{Redirect|Focal-plane array|arrays used in radio telescopes|Focal-plane array (radio astronomy)}}
{{more citations needed|date=August 2018}}

A '''staring array''', also known as '''staring-plane array''' or '''focal-plane array''' ('''FPA'''), is an [[image sensor]] consisting of an array (typically rectangular) of light-sensing pixels at the [[focal plane]] of a [[lens]]. FPAs are used most commonly for imaging purposes (e.g. taking pictures or video imagery), but can also be used for non-imaging purposes such as [[spectroscopy|spectrometry]], [[lidar|LIDAR]], and [[wave-front sensing]].

In [[radio astronomy]], the [[focal-plane array (radio astronomy)|FPA]] is at the [[Focus (optics)|focus]] of a [[radio telescope]]. At optical and infrared wavelengths, it can refer to a variety of imaging device types, but in common usage it refers to two-dimensional devices that are sensitive in the [[infrared]] spectrum. Devices sensitive in other spectra are usually referred to by other terms, such as CCD ([[charge-coupled device]]) and [[CMOS image sensor]] in the visible spectrum. FPAs operate by detecting photons at particular wavelengths and then generating an electrical charge, voltage, or resistance in relation to the number of photons detected at each pixel. This charge, voltage, or resistance is then measured, digitized, and used to construct an image of the object, scene, or phenomenon that emitted the photons.


Applications for infrared FPAs include [[guided missile|missile]] or related weapons guidance sensors, infrared astronomy, manufacturing inspection, thermal imaging for firefighting, medical imaging, and infrared phenomenology (such as observing combustion, weapon impact, rocket motor ignition and other events that are interesting in the infrared spectrum).
Applications for infrared FPAs include [[guided missile|missile]] or related weapons guidance sensors, infrared astronomy, manufacturing inspection, thermal imaging for firefighting, medical imaging, and infrared phenomenology (such as observing combustion, weapon impact, rocket motor ignition and other events that are interesting in the infrared spectrum).


==Comparison to scanning array==
Staring arrays are distinct from [[scanning array]] and TDI ([[time-domain integration]]) imagers in that they image the desired field of view without scanning. Scanning arrays are constructed from linear arrays (or sometime very narrow 2-D arrays) that are rastered across the desired field of view using a rotating or oscillating mirror to construct a 2-D image over time. A TDI imager operates in similar fashion to a scanning array except that it images perpendicularly to the motion of the camera. A staring array is analogous to the film in a typical camera; it directly captures a 2-D image projected by the lens at the image plane. A scanning array is analogous to looking through a narrow slit, and then rastering your head and the slit perpendicularly to the direction of the slit to build a 2-D image. A TDI imager is analogous to looking through a vertical slit out the side window of a moving car, and building a long, continuous image as the car passes the landscape.
{{further|Push broom scanner|Whisk broom scanner}}


Staring arrays are distinct from [[scanning array]] and TDI ([[time-delay integration]]) imagers in that they image the desired field of view without scanning. Scanning arrays are constructed from linear arrays (or very narrow 2-D arrays) that are rastered across the desired field of view using a rotating or oscillating mirror to construct a 2-D image over time. A TDI imager operates in similar fashion to a scanning array except that it images perpendicularly to the motion of the camera. A staring array is analogous to the film in a typical camera; it directly captures a 2-D image projected by the lens at the image plane. A scanning array is analogous to piecing together a 2D image with photos taken through a narrow slit. A TDI imager is analogous to looking through a vertical slit out the side window of a moving car, and building a long, continuous image as the car passes the landscape.
Staring arrays are superior to scanning arrays in every meaningful performance aspect, and the latter were developed and used only because of historical difficulties in fabricating 2-D arrays of sufficient size and quality for direct 2-D imaging. Modern FPAs are available with up to 2048 x 2048 pixels, and larger sizes are in development by multiple manufacturers. 320 x 256 and 640 x 480 arrays are available and affordable even for non-military, non-scientific applications.


Scanning arrays were developed and used because of historical difficulties in fabricating 2-D arrays of sufficient size and quality for direct 2-D imaging. Modern FPAs are available with up to 2048 x 2048 pixels, and larger sizes are in development by multiple manufacturers. 320 x 256 and 640 x 480 arrays are available and affordable even for non-military, non-scientific applications.
The difficulty in constructing high-quality, high-resolution FPAs derives from the materials used. Whereas visible imagers such as CCD and CMOS image sensors are fabricated from silicon, using mature and well-understood processes, IR sensors must be fabricated from other, more exotic materials because silicon is sensitive only in the visible and near-IR spectra. Infrared-sensitive materials commonly used in IR detector arrays include mercury-cadmium-telluride ([[HgCdTe]], "MerCad", or "MerCadTel"), Indium Antimonide ([[InSb]], pronounced "Inns-Bee"), Indium Gallium Arsenide ([[InGaAs]], pronounced "Inn-Gas"), and Vanadium Oxide ([[VOx]], pronounced "Vox"). A variety of lead salts can also be used, but are less common today. None of these materials can be grown into crystals anywhere near the size of modern silicon crystals, nor do the resulting wafers have nearly the uniformity of silicon. Furthermore, the materials used to construct arrays of IR-sensitive pixels cannot be used to construct the electronics needed to transport the resulting charge, voltage, or resistance of each pixel to the measurement circuitry. This set of functions is implemented on a chip called the multiplexer, or read-out IC ([[ROIC]]), and is typically fabricated in silicon using standard CMOS processes. The detector array is then '''hybridized''' or bonded to the ROIC, typically using indium bump-bonding, and the resulting assembly is called an FPA.


==Construction and materials==
Some materials (and the FPAs fabricated from them) operate only at [[cryogenic]] temperatures, and others (such as VOx [[microbolometers]]) can operate at uncooled temperatures. Some devices are only practical to operate cryogenically as otherwise the thermal noise would swamp the detected signal. Devices can be cooled evaporatively (typically by liquid nitrogen [[LN2]] or liquid helium) or by using a [[thermo-electric cooler]].


The difficulty in constructing high-quality, high-resolution FPAs derives from the materials used. Whereas visible imagers such as CCD and CMOS image sensors are fabricated from silicon, using mature and well-understood processes, IR sensors must be fabricated from other, more exotic materials because silicon is sensitive only in the visible and near-IR spectra. Infrared-sensitive materials commonly used in IR detector arrays include [[mercury cadmium telluride]] (HgCdTe, "MerCad", or "MerCadTel"), [[indium antimonide]] (InSb, pronounced "Inns-Bee"), [[indium gallium arsenide]] (InGaAs, pronounced "Inn-Gas"), and [[vanadium(V) oxide]] (VOx, pronounced "Vox"). A variety of lead salts can also be used, but are less common today. None of these materials can be grown into crystals anywhere near the size of modern silicon crystals, nor do the resulting wafers have nearly the uniformity of silicon. Furthermore, the materials used to construct arrays of IR-sensitive pixels cannot be used to construct the electronics needed to transport the resulting charge, voltage, or resistance of each pixel to the measurement circuitry. This set of functions is implemented on a chip called the [[multiplexer]], or [[readout integrated circuits]] (ROIC), and is typically fabricated in silicon using standard CMOS processes. The detector array is then '''hybridized''' or bonded to the ROIC, typically using indium bump-bonding, and the resulting assembly is called an FPA.
A peculiar aspect of nearly all IR FPAs is that the electrical responses of the pixels on a given device tend to be non-uniform. In a perfect device every pixel would output the same electrical signal when given the same number of photons of appropriate wavelength. In practice nearly all FPAs have both significant pixel-to-pixel offset and pixel-to-pixel photo-response non-uniformity [[PRNU]]. When un-illuminated, each pixel has a different "zero-signal" level, and when illuminated the delta in signal is also different. This non-uniformity makes the resulting images impractical for use until they have been processed to normalize the photo-response. This correction process requires a set of known characterization data, collected from the particular device under controlled conditions. The data correction can be done in software, in a [[DSP]] or [[FPGA]] in the camera electronics, or even on the ROIC in the most modern of devices.

Some materials (and the FPAs fabricated from them) operate only at [[cryogenic]] temperatures, and others (such as resistive amorphous silicon (a-Si) and VOx [[microbolometer]]s) can operate at uncooled temperatures. Some devices are only practical to operate cryogenically as otherwise the [[Johnson–Nyquist noise|thermal noise]] would swamp the detected signal. Devices can be cooled evaporatively, typically by [[liquid nitrogen]] (LN2) or liquid helium, or by using a [[thermo-electric cooler]].

A peculiar aspect of nearly all IR FPAs is that the electrical responses of the pixels on a given device tend to be non-uniform. In a perfect device every pixel would output the same electrical signal when given the same number of photons of appropriate wavelength. In practice nearly all FPAs have both significant pixel-to-pixel offset and pixel-to-pixel [[photo response non-uniformity]] (PRNU). When un-illuminated, each pixel has a different "zero-signal" level, and when illuminated the delta in signal is also different. This non-uniformity makes the resulting images impractical for use until they have been processed to normalize the photo-response. This correction process requires a set of known characterization data, collected from the particular device under controlled conditions. The data correction can be done in software, in a [[Digital signal processor|DSP]] or [[Field-programmable gate array|FPGA]] in the camera electronics, or even on the ROIC in the most modern of devices.


The low volumes, rarer materials, and complex processes involved in fabricating and using IR FPAs makes them far more expensive than visible imagers of comparable size and resolution.
The low volumes, rarer materials, and complex processes involved in fabricating and using IR FPAs makes them far more expensive than visible imagers of comparable size and resolution.


Staring plane arrays are used in modern [[air to air missile]]s and [[anti-tank missile]]s such as the [[AIM-9X Sidewinder]], [[AIM-132 ASRAAM|ASRAAM]] <ref>[http://www.raf.mod.uk/equipment/airtoair.html Air-to-Air Weapons - Royal Air Force]</ref> and [[FGM-148 Javelin|Javelin]].<ref>[http://www.designation-systems.net/dusrm/m-148.html FGM-148 Javelin - Designation Systems]</ref>
Staring plane arrays are used in modern [[air-to-air missile]]s and [[anti-tank missile]]s such as the [[AIM-9X Sidewinder]], [[AIM-132 ASRAAM|ASRAAM]]<ref>[http://www.raf.mod.uk/equipment/airtoair.html Air-to-Air Weapons - Royal Air Force]</ref>

[[Crosstalk|Cross talk]] can inhibit the illumination of pixels.<ref name=":0" />

== Applications ==

=== 3D LIDAR Imaging ===
Focal plane arrays (FPAs) have been reported to be used for 3D [[Lidar|LIDAR]] imaging.<ref name=":0">Goldberg, A.; Stann, B.; Gupta, N. (July 2003). "Multispectral, Hyperspectral, and Three-Dimensional Imaging Research at the U.S. Army Research Laboratory" (PDF). ''Proceedings of the International Conference on International Fusion [6th]''. 1: 499–506.</ref><ref>{{Cite book|last1=Marino|first1=Richard M.|last2=Stephens|first2=Timothy|last3=Hatch|first3=Robert E|last4=McLaughlin|first4=Joseph L.|last5=Mooney|first5=James G.|last6=O'Brien|first6=Michael E.|last7=Rowe|first7=Gregory S.|last8=Adams|first8=Joseph S.|last9=Skelly|first9=Luke|editor1-first=Gary W|editor1-last=Kamerman|title=Laser Radar Technology and Applications VIII|date=2003-08-21|chapter=A compact 3D imaging laser radar system using Geiger-mode APD arrays: system and measurements|chapter-url=https://www.spiedigitallibrary.org/conference-proceedings-of-spie/5086/0000/A-compact-3D-imaging-laser-radar-system-using-Geiger-mode/10.1117/12.501581.short?SSO=1|volume=5086|pages=1–15 |doi=10.1117/12.501581|s2cid=110267445}}</ref><ref>{{Cite web|title=Jigsaw : A Foliage-Penetrating 3 D Imaging Laser Radar System|last1=Marino|first1=Richard M.|last2=Davis|first2=William Rhett|date=2004|s2cid=18046922}}</ref>

==== Improvements ====
In 2003, a 32 x 32 pixel [[Breadboard#Advanced solderless breadboards|breadboard]] was reported with capabilities to repress cross talk between FPAs. Researchers at the [[United States Army Research Laboratory|U.S. Army Research Laboratory]] used a [[collimator]] to collect and direct the breadboard’s laser beam onto individual pixels. Since low levels of voltage were still observed in pixels that did not illuminate, indicating that illumination was prevented by [[crosstalk]]. This cross talk was attributed to [[capacitive coupling]] between the [[Microstrip|microstrip lines]] and between the FPA’s internal conductors. By replacing the receiver in the breadboard for one with a shorter focal length,  the focus of the collimator was reduced and the system’s threshold for signal recognition was increased. This facilitated a better image by cancelling cross talk.<ref name=":0" />

Another method was to add a flat thinned substrate membrane (approximately 800 angstroms thick) to the FPA. This was reported to eliminate pixel-to-pixel cross talk in FPA imaging applications.<ref>{{Cite journal|last1=D.|first1=Gunapala, S.|last2=V.|first2=Bandara, S.|last3=K.|first3=Liu, J.|last4=J.|first4=Hill, C.|last5=B.|first5=Rafol, S.|last6=M.|first6=Mumolo, J.|last7=T.|first7=Trinh, J.|last8=Z.|first8=Tidrow, M.|last9=D.|first9=LeVan, P.|date=May 2005|title=1024 x 1024 pixel mid-wavelength and long-wavelength infrared QWIP focal plane arrays for imaging applications|url=https://trs.jpl.nasa.gov/handle/2014/39300}}</ref> In another an [[avalanche photodiode]] FPA study, the etching of trenches in between neighboring pixels reduced cross talk.<ref>{{Cite journal|last1=Itzler|first1=Mark A.|last2=Entwistle|first2=Mark|last3=Owens|first3=Mark|last4=Patel|first4=Ketan|last5=Jiang|first5=Xudong|last6=Slomkowski|first6=Krystyna|last7=Rangwala|first7=Sabbir|last8=Zalud|first8=Peter F.|last9=Senko|first9=Tom|editor1-first=Eustace L|editor1-last=Dereniak|editor2-first=John P|editor2-last=Hartke|editor3-first=Paul D|editor3-last=Levan|editor4-first=Ashok K|editor4-last=Sood|editor5-first=Randolph E|editor5-last=Longshore|editor6-first=Manijeh|editor6-last=Razeghi|date=2010-08-19|title=Design and performance of single photon APD focal plane arrays for 3-D LADAR imaging|url=https://spie.org/Publications/Proceedings/Paper/10.1117/12.864465|journal=Detectors and Imaging Devices: Infrared, Focal Plane, Single Photon|volume=7780|pages=77801M|publisher=SPIE|doi=10.1117/12.864465|bibcode=2010SPIE.7780E..1MI|s2cid=120955542}}</ref>

==See also==
* [[Focal-plane array (radio astronomy)]]


==References==
==References==
<div class="references-small">
<references/>
<references/>
</div>


[[Category:Missile guidance]]
[[Category:Infrared imaging]]
[[Category:Infrared imaging]]
[[Category:Image sensors]]

Latest revision as of 23:41, 25 October 2023

A staring array, also known as staring-plane array or focal-plane array (FPA), is an image sensor consisting of an array (typically rectangular) of light-sensing pixels at the focal plane of a lens. FPAs are used most commonly for imaging purposes (e.g. taking pictures or video imagery), but can also be used for non-imaging purposes such as spectrometry, LIDAR, and wave-front sensing.

In radio astronomy, the FPA is at the focus of a radio telescope. At optical and infrared wavelengths, it can refer to a variety of imaging device types, but in common usage it refers to two-dimensional devices that are sensitive in the infrared spectrum. Devices sensitive in other spectra are usually referred to by other terms, such as CCD (charge-coupled device) and CMOS image sensor in the visible spectrum. FPAs operate by detecting photons at particular wavelengths and then generating an electrical charge, voltage, or resistance in relation to the number of photons detected at each pixel. This charge, voltage, or resistance is then measured, digitized, and used to construct an image of the object, scene, or phenomenon that emitted the photons.

Applications for infrared FPAs include missile or related weapons guidance sensors, infrared astronomy, manufacturing inspection, thermal imaging for firefighting, medical imaging, and infrared phenomenology (such as observing combustion, weapon impact, rocket motor ignition and other events that are interesting in the infrared spectrum).

Comparison to scanning array[edit]

Staring arrays are distinct from scanning array and TDI (time-delay integration) imagers in that they image the desired field of view without scanning. Scanning arrays are constructed from linear arrays (or very narrow 2-D arrays) that are rastered across the desired field of view using a rotating or oscillating mirror to construct a 2-D image over time. A TDI imager operates in similar fashion to a scanning array except that it images perpendicularly to the motion of the camera. A staring array is analogous to the film in a typical camera; it directly captures a 2-D image projected by the lens at the image plane. A scanning array is analogous to piecing together a 2D image with photos taken through a narrow slit. A TDI imager is analogous to looking through a vertical slit out the side window of a moving car, and building a long, continuous image as the car passes the landscape.

Scanning arrays were developed and used because of historical difficulties in fabricating 2-D arrays of sufficient size and quality for direct 2-D imaging. Modern FPAs are available with up to 2048 x 2048 pixels, and larger sizes are in development by multiple manufacturers. 320 x 256 and 640 x 480 arrays are available and affordable even for non-military, non-scientific applications.

Construction and materials[edit]

The difficulty in constructing high-quality, high-resolution FPAs derives from the materials used. Whereas visible imagers such as CCD and CMOS image sensors are fabricated from silicon, using mature and well-understood processes, IR sensors must be fabricated from other, more exotic materials because silicon is sensitive only in the visible and near-IR spectra. Infrared-sensitive materials commonly used in IR detector arrays include mercury cadmium telluride (HgCdTe, "MerCad", or "MerCadTel"), indium antimonide (InSb, pronounced "Inns-Bee"), indium gallium arsenide (InGaAs, pronounced "Inn-Gas"), and vanadium(V) oxide (VOx, pronounced "Vox"). A variety of lead salts can also be used, but are less common today. None of these materials can be grown into crystals anywhere near the size of modern silicon crystals, nor do the resulting wafers have nearly the uniformity of silicon. Furthermore, the materials used to construct arrays of IR-sensitive pixels cannot be used to construct the electronics needed to transport the resulting charge, voltage, or resistance of each pixel to the measurement circuitry. This set of functions is implemented on a chip called the multiplexer, or readout integrated circuits (ROIC), and is typically fabricated in silicon using standard CMOS processes. The detector array is then hybridized or bonded to the ROIC, typically using indium bump-bonding, and the resulting assembly is called an FPA.

Some materials (and the FPAs fabricated from them) operate only at cryogenic temperatures, and others (such as resistive amorphous silicon (a-Si) and VOx microbolometers) can operate at uncooled temperatures. Some devices are only practical to operate cryogenically as otherwise the thermal noise would swamp the detected signal. Devices can be cooled evaporatively, typically by liquid nitrogen (LN2) or liquid helium, or by using a thermo-electric cooler.

A peculiar aspect of nearly all IR FPAs is that the electrical responses of the pixels on a given device tend to be non-uniform. In a perfect device every pixel would output the same electrical signal when given the same number of photons of appropriate wavelength. In practice nearly all FPAs have both significant pixel-to-pixel offset and pixel-to-pixel photo response non-uniformity (PRNU). When un-illuminated, each pixel has a different "zero-signal" level, and when illuminated the delta in signal is also different. This non-uniformity makes the resulting images impractical for use until they have been processed to normalize the photo-response. This correction process requires a set of known characterization data, collected from the particular device under controlled conditions. The data correction can be done in software, in a DSP or FPGA in the camera electronics, or even on the ROIC in the most modern of devices.

The low volumes, rarer materials, and complex processes involved in fabricating and using IR FPAs makes them far more expensive than visible imagers of comparable size and resolution.

Staring plane arrays are used in modern air-to-air missiles and anti-tank missiles such as the AIM-9X Sidewinder, ASRAAM[1]

Cross talk can inhibit the illumination of pixels.[2]

Applications[edit]

3D LIDAR Imaging[edit]

Focal plane arrays (FPAs) have been reported to be used for 3D LIDAR imaging.[2][3][4]

Improvements[edit]

In 2003, a 32 x 32 pixel breadboard was reported with capabilities to repress cross talk between FPAs. Researchers at the U.S. Army Research Laboratory used a collimator to collect and direct the breadboard’s laser beam onto individual pixels. Since low levels of voltage were still observed in pixels that did not illuminate, indicating that illumination was prevented by crosstalk. This cross talk was attributed to capacitive coupling between the microstrip lines and between the FPA’s internal conductors. By replacing the receiver in the breadboard for one with a shorter focal length,  the focus of the collimator was reduced and the system’s threshold for signal recognition was increased. This facilitated a better image by cancelling cross talk.[2]

Another method was to add a flat thinned substrate membrane (approximately 800 angstroms thick) to the FPA. This was reported to eliminate pixel-to-pixel cross talk in FPA imaging applications.[5] In another an avalanche photodiode FPA study, the etching of trenches in between neighboring pixels reduced cross talk.[6]

See also[edit]

References[edit]

  1. ^ Air-to-Air Weapons - Royal Air Force
  2. ^ a b c Goldberg, A.; Stann, B.; Gupta, N. (July 2003). "Multispectral, Hyperspectral, and Three-Dimensional Imaging Research at the U.S. Army Research Laboratory" (PDF). Proceedings of the International Conference on International Fusion [6th]. 1: 499–506.
  3. ^ Marino, Richard M.; Stephens, Timothy; Hatch, Robert E; McLaughlin, Joseph L.; Mooney, James G.; O'Brien, Michael E.; Rowe, Gregory S.; Adams, Joseph S.; Skelly, Luke (2003-08-21). "A compact 3D imaging laser radar system using Geiger-mode APD arrays: system and measurements". In Kamerman, Gary W (ed.). Laser Radar Technology and Applications VIII. Vol. 5086. pp. 1–15. doi:10.1117/12.501581. S2CID 110267445.
  4. ^ Marino, Richard M.; Davis, William Rhett (2004). "Jigsaw : A Foliage-Penetrating 3 D Imaging Laser Radar System". S2CID 18046922. {{cite web}}: Missing or empty |url= (help)
  5. ^ D., Gunapala, S.; V., Bandara, S.; K., Liu, J.; J., Hill, C.; B., Rafol, S.; M., Mumolo, J.; T., Trinh, J.; Z., Tidrow, M.; D., LeVan, P. (May 2005). "1024 x 1024 pixel mid-wavelength and long-wavelength infrared QWIP focal plane arrays for imaging applications". {{cite journal}}: Cite journal requires |journal= (help)CS1 maint: multiple names: authors list (link)
  6. ^ Itzler, Mark A.; Entwistle, Mark; Owens, Mark; Patel, Ketan; Jiang, Xudong; Slomkowski, Krystyna; Rangwala, Sabbir; Zalud, Peter F.; Senko, Tom (2010-08-19). Dereniak, Eustace L; Hartke, John P; Levan, Paul D; Sood, Ashok K; Longshore, Randolph E; Razeghi, Manijeh (eds.). "Design and performance of single photon APD focal plane arrays for 3-D LADAR imaging". Detectors and Imaging Devices: Infrared, Focal Plane, Single Photon. 7780. SPIE: 77801M. Bibcode:2010SPIE.7780E..1MI. doi:10.1117/12.864465. S2CID 120955542.