- This article is filed under:
- » View All
Improving Image Resolution with Wide Angle Lenses
by Mark Peterson and Andrea Iniguez, VP Advanced Technology, VP Business Development - Theia Technologies Posted 09/13/2019
Despite inflammatory media accounts proclaiming the end of the megapixel race in the security industry, recent conversations with camera OEMs suggest otherwise. In fact, camera companies appear poised to up the ante and move forward with plans to increase camera resolution, following the lead of cell phone and digital camera companies before them. Nokia, for example has come out with their 41 megapixel cell phone camera. While the camera may indeed provide 41 megapixels of native resolution, the image resolution is likely limited by the lens. Without a good megapixel lens, the claims of multi megapixel resolution are just so much marketing hype. With so much hype in the news, it is helpful to clarify how resolution is defined and what factors determine image resolution.
Resolution has many definitions; no one definition is correct for all situations. We’ll list only the definitions relevant to the video surveillance industry here.
Definition 1: Resolution can be expressed as the number of TV lines or pixels of the image sensor used to record an image. The greater the number of lines, the greater detail or larger field of view can be recorded with the camera. For analog cameras this is the usual definition. The number of TV lines in the image can be 320, 480, 570, etc.
Definition 2: Resolution can be expressed as the total number of pixels. With megapixel cameras, the resolution is generally the total number of pixels, divided by 1,000,000, and rounded off. Table 1 below shows examples of typical megapixel camera resolutions.
Megapixels Total number of pixels Vertical pixels Horizontal pixels
HD* 720 921,600 720 1280
1.3 MPix 1,310,720 1024 1280
HD* 1080 2,073,600 1080 1920
2 MPix 1,920,000 1200 1600
3 MPix 3,145,728 1536 2048
5 MPix 4,915,200 1920 2560
Table 1: Number of pixels for different megapixel camera formats.
*There are two definitions for HD video. Twice as much resolution in a 1080 HD cameras means twice as much detail or field of view compared to a 720 HD camera.
Resolution can be the level of detail with which an image can be reproduced or recorded. The detail in an image is determined by resolution. At the image sensor resolution is expressed as line pairs per millimeter (lpm) commonly used by lens designers and optical engineers. As the total number of pixels on an image sensor increases, the pixel size gets smaller and requires a higher quality lens to achieve best focus. These high quality lenses, including those manufactured by Theia Technologies, are rated for megapixel or multi megapixel cameras meaning the image will be sharply in focus at the camera resolution it is rated for.
Definition 4: Resolution can be specified in pixels per foot or meter at the object. This mapping of the image sensor dimensions onto the object is most intuitive for calculating what level of detail can be seen in the image. Fundamentally it is the horizontal field of view (HFOV) of the camera divided by the horizontal number of pixels. This gives a pixels per foot number that can be related to image quality. This is the definition that we will expand upon further in the rest of this white paper.
There is not yet an industry standard for the level of sharpness required in every video surveillance application. The more pixels on a target, the higher the resolution will be and the more likely recognition and positive identification will be made. However, higher detail requires higher resolution cameras or more cameras and thus more bandwidth and storage. There is a balance that must be made between level of detail and project budget.
In Table 2 below, an image is shown at different levels of resolution from “high detail” for clear identification at 60pix/ft to “motion tracking” for wide field of view at 10pix/ft. Each image has the same number of pixels but as the field of view increases, the pixels per foot in the image decreases. Because there are no more pixels in one image compared to another, there is no effect on the amount of data transferred over the network and no degradation of network performance by going to either higher image resolution or greater field of view.
Table 2: As field of view increases the pixels per foot decreases so that each picture has the same number of pixels and thus causes the same amount of network loading.
Wide angle field of view
Another advantage of the higher resolution available from megapixel cameras is the ability to cover a much wider area with the same or better resolution compared to analog cameras. Because the total available pixels spread across the field of view is greater, the field of view can be increased without decreasing image resolution.
Table 3 below compares the field of view of different cameras at a distance of 32 feet from the subject at the same image resolution. As the camera resolution (total number of pixels) increases, so does the field of view at constant image resolution (pixels per foot). Clearly the higher the number of pixels in the camera, the wider the field of view at a constant image resolution. This increase in field of view is also shown in Figure 1 below.
Camera Image width Resolution Lens focal length Field of view Field of view increase
Analog Not so wide 18 pix/ft 4.5 mm 58? (36 ft)
1.3MPix Wide angle 18 pix/ft 2.2 mm* 96? (71 ft) 2X
3MPix Super wide 19 pix/ft 1.7 mm* 120? (110 ft) 3X
5MPix Ultra wide 18 pix/ft 1.3 mm* 132? (144 ft) 4X
Table 3: Image width increases with total number of pixels at constant image resolution.
*For the same field of view, rectilinear lenses (see below) and lenses with barrel distortion will have different focal lengths. A 180? fisheye lens may have a focal length of 2.2mm because it has more than 80% distortion whereas a rectilinear lens can have a focal length of 1.3mm and field of view of only 125?.
Figure 1: Field of view increases with increasing camera resolution (total number of pixels) without any change in image resolution (pixels per foot). The 3 and 5 megapixel images are cropped vertically to eliminate uninteresting sky and ground areas of the image. This cropping reduces the total number of pixels but doesn’t affect the pixels per foot resolution
Rectilinear v. fisheye
The shorter the lens focal length, the wider the field of view. Greater than about 90 degrees, most lenses start to show curved, barrel distorted images that compress the image at the edges. Rectilinear lenses such as those using Theia Technologies’ Linear Optical Technology® don’t exhibit barrel distortion and thus maintain image resolution out to the edge of the image.
Traditional wide angle lenses with barrel distortion (also known as fisheye distortion) cause the image to look curved and bulged out in the center. Rectilinear lenses, like those made for the security industry by Theia Technologies, keep lines that appear straight in the real world straight on the image sensor. This has the benefit of increasing the resolution of the image at the edges (i.e. an object will cover more pixels in the image when the object is at the edge of the image) whereas lenses with barrel distortion cause the image to be compressed at the edges and resolution is reduced. With typical distorted wide angle lenses, potentially valuable information is lost in the lens and no software, dewarping or otherwise, can recapture or reconstruct this lost information in the image. Any dewarping will create an image that looks like that from a rectilinear lens but at lower resolution. With a rectilinear lens, the image is spread over a greater number of pixels at the edges, increasing the probability of detection and identification.
Objects in a plane
With a rectilinear lens, objects in a common plane perpendicular to the camera have the same image resolution at the center and edge even though the objects at the edges are much farther away from the camera. This is shown in Figures 2 and 3 below.
Figure 2: Objects in a plane perpendicular to the camera have the same image resolution at the center and edge of the image.
Figure 3: These targets are in a 10x10ft grid. At 20ft from the camera using Theia’s SY110 lens with 120deg field of view, the HFOV is 60 feet. Targets at the edge of the image are twice as far from the camera but can be seen as clearly as those in the center of the image along the same plane.
This rectilinearity creates an effect called 3D stretching or lean-over in which objects at the image edge seem to be stretched because they are being “flattened” onto a plane along the tangent angle from the lens. With rectilinear lenses, the wider the field of view, the more noticeable this effect. This effect is not what most people are used to seeing but it has the advantage of increased resolution (pixels per foot) for objects at the edge of the image compared to lenses with barrel distortion. For lenses with barrel distortion, the objects at the edge of the image will be smaller than those in the center and they will curve towards the center.
Figure 4 below shows this 3D stretching. The length of the black car near the edge of the image is flattened onto the image plane along a steep tangent angle so it appears stretched. But the width of the two cars is the same because they are in the same plane perpendicular to the camera. Because the effect is only present when objects have length parallel to the camera in the third (depth) dimension, such as the length of the cars, it is called 3D stretching.
Figure 4: 3D stretching. The objects are projected onto the image plane along the tangent line causing objects at the image edge with dimensions parallel to the lens axis to appear stretched.
Objects in an arc
With a rectilinear lens, the calculation of resolution of objects in an arc with the camera at the center is a little more complicated. As an object moves from the center of the image towards the edge in an arc without changing the distance to the camera, the object will increase in resolution significantly. This is shown in figures 5 and 6 below.
Figure 5: Objects in a circle, equidistant from the camera, will increase in resolution as they move from the image center to edge.
This case, shown in Figure 6 below, clearly shows the resolution increase as objects move around the arc at constant distance from the camera. The image of the person standing 11.5ft from the camera will increase in width due to 3D stretching as they move to the edge of the image. At the image edge, they may be more clearly identified compared to the center and compared to a lens with barrel distortion. Lenses with barrel distortion will not show an increase in object width.
Figure 6: As subjects move in a circle with the camera at the center, they increase in size due to 3D stretching, making them more recognizable towards the edges of the image. This 135? field of view was captured using Theia’s SY125 lens.
Resolution Performance of lenses based on Linear Optical Technology™
The charts below show image resolution and horizontal field of view (HFOV) as a function of camera distance for Theia’s rectilinear lenses. For example, if 20 pixels per foot is required for a general surveillance application with a 5MPix camera and Theia’s SY110 lens, the camera would need to be 37 feet away from an object in the center of the image. As the object moves perpendicular to the camera as described in Figure 1, the image resolution will remain 20 pixels per foot even though the object is getting farther from the camera. The resolution of wide angle, non-rectilinear lenses will decrease as the object moves along this line.
Figures 7a and 7b: Image resolution and field of view calculation based on Theia’s lenses. Both these charts are also available in metric units from Theia’s image resolution calculator web page.
Given a lens and camera, it is possible to calculate the image resolution by using the simple equations below. If the field of view is not known, it can be calculated for a rectilinear lens using the equation in Table 4. If the lens has barrel distortion it is best to look up the HFOV in the specification sheet.
Rectilinear lens field of view as a function of lens focal length: Example
A 5MPix camera with Theia’s SY110 lens has a field of view of 80 feet at a distance of 23 feet.
Table 4: Rectilinear lens HFOV as a function of focal length. Chip width depends on the camera. The most common sizes are listed in Table 8.
Once the horizontal field of view is calculated and the camera is known, the image resolution is simply the ratio of the pixels to HFOV.
Image resolution as a function of field of view Example
The same 5MPix camera as above has an image resolution of 32 pixels/foot at a distance of 23 feet.
Table 5: Resolution in pixels per foot or meter depending on the units of image width. Number of pixels is also listed in Table 8 for the most common megapixel cameras.
Lens focal length for given image resolution calculation
For a design with a known resolution requirement, it is possible to invert the equations above to calculate the lens focal length required for a given camera. This equation is shown in below.
Lens focal length for a known camera Example
To maintain 32 pixels/foot resolution at 23 feet from the camera, a 1.7mm lens is required. Longer focal length gives a smaller field of view but higher image resolution.
Table 6: Lens focal length for a known camera. Chip_width and Focal_length are both in millimeters. Camera_dist and image_resolution are either both English or metric units.
For objects in the same plane, the edge resolution equals the center resolution. However, for objects in an arc, equidistant from the camera, the edge resolution is related to the center resolution by the cosine of the maximum HFOV angle. This equation is shown in Table 7 below.
Edge resolution based on center resolution Example
The previous example has 32pixels/foot image resolution in the center. With Theia’s SY110 lens with 120? field of view, the edge image resolution increases to 64pixels/foot.
Table 7: Edge resolution is greater than center resolution for an object moving in an arc about the camera.
The variables in the equations depend not only on the lens choice but camera choice as well. Different camera resolutions have different chip sizes, therefore different fields of view for the same lens. Below are tables of data for the most common megapixel cameras and the corresponding fields of view for two of Theia’s rectilinear lenses.
Camera 1.3MPix 2MPix 3MPix 5MPix
Chip size 1/3” 1/2” 1/2” 1/2.5”
Chip_width 4.8mm 6.4mm 6.4mm 5.76mm
# pixelshoriz 1280 1600 2048 2560
SY110 HFOV 110? 126? 126? 120?
SY125 HFOV 125? 140? 140? 135?
Table 8: Common chip sizes for megapixel cameras and corresponding angular fields of view for two rectilinear lenses.
In summary, there are many definitions of resolution. The two most commonly used in the security industry are total number of pixels in a camera and the pixels per foot in an image. As the total number of pixels increases, the detail in the image or the field of view or both can be increased. For wide angle lenses, rectilinear lenses increase the image resolution at the edges of the image improving the possibility of detection and identification.
For any further explanation please contact Theia Technologies:
VP Advanced Technology
VP Business Development
Theia Technologies | 29765 SW Town Center Loop W, Suite #4 | Wilsonville, OR 97070 |503 570-3296