Basics of Photogrammetry
Basics of Photogrammetry
4
Photography - The First Part of Photogrammetry ........................................................4 Field of View........................................................................................................................5 Focusing...............................................................................................................................6 Exposure...............................................................................................................................6 Camera Exposure ..............................................................................................................6 Background Exposure .......................................................................................................6 Target Exposure..................................................................................................................7 Metrology - The Second Part of Photogrammetry ......................................................8 Triangulation .......................................................................................................................9 Resection...........................................................................................................................10 Self-Calibration.................................................................................................................11 Bundle Adjustment ..........................................................................................................12 Measuring Accuracy ......................................................................................................13 Scaling Photogrammetry ...............................................................................................14 Multiple Scale Distances.................................................................................................15 Long Scale Distances......................................................................................................15
Metrology ............................................................................................................ 8
Defining a Coordinate System ....................................................................... 18 MEASUREMENTS................................................................................................20 Types of Measurements................................................................................... 20 Initial and Repeat Measurements.................................................................. 21 Completely or Partially Overlapping Measurements.................................. 21 PLANNING FOR MEASUREMENTS .....................................................................24 Planning for Different Types of Measurements............................................. 24 Design for Completely Overlapping Measurements .................................. 24 Design for Partially Overlapping Measurements ......................................... 28 Design for "Left-Right" Measurements............................................................ 28 Design for "Front-Back" Measurements ......................................................... 30 Design for "Box" Measurements ...................................................................... 32 Procedures for Different Types of Measurements ........................................ 33 Final Planning Tips............................................................................................. 34 Planning Summary and Checklist .................................................................. 35
V-STARS Planning Checks:..............................................................................................35
TARGETING .......................................................................................................36 Introduction to Targeting ................................................................................ 36 Retro-reflector Targets and Their Characteristics......................................... 36 Target Angle...................................................................................................... 37 1
Target Thickness................................................................................................ 37 Target Sizes ........................................................................................................ 37 Target Types ...................................................................................................... 39 Individual self-adhesive stick on targets........................................................ 39 Target Tape ....................................................................................................... 40 Hard-body tooling targets............................................................................... 40 Coded targets .................................................................................................. 42 Target Handling and Care.............................................................................. 42 Attaching the AutoBar .................................................................................... 43 Attaching the Scale Bar(s) .............................................................................. 44 TARGETING SUMMARY AND CHECKLIST..........................................................45 Targeting Checklist........................................................................................... 45 APPENDIX A......................................................................................................46 Frequently Asked Questions About Photogrammetry ................................ 46 How accurate is V-STARS? .............................................................................. 47 How many photographs are needed for a measurement?...................... 49 How many points are needed for a measurement? .................................. 50 Do I need scale for the measurement?........................................................ 50 How do I compensate for scale changes due to temperature? ............. 51 Can the object move while it is being measured? ..................................... 51 Do I need to use special targets with the system?...................................... 52 What size should the targets be?................................................................... 52 Can I use different size targets on the same measurement? .................... 52 How obliquely can I view the targets?.......................................................... 53 Do I need to provide special lighting for the system? ................................ 53 Do I have to consider the lighting during the measurement?................... 53 Do I need to know the camera location when I take a picture?............. 53 How steady must the camera be when taking a picture?........................ 53 How far away do I have to get from the object to measure it?............... 54 Where should I locate the camera to get a good measurement? ......... 54 How can I calibrate the camera and make sure the measurement is accurate? ......................................................................................................... 54 GLOSSARY ........................................................................................................56 AutoBar .............................................................................................................. 56 AutoStart............................................................................................................ 56 CMM................................................................................................................... 56 Coded targets .................................................................................................. 57 Coded target nuggets .................................................................................... 57 Driveback .......................................................................................................... 57 Field of View...................................................................................................... 57 Focusing............................................................................................................. 57 F-number ........................................................................................................... 58 Flash Synchronization....................................................................................... 58 Free-format........................................................................................................ 58
Orientation ........................................................................................................ 58 Photogrammetry .............................................................................................. 58 Resection ........................................................................................................... 58 Retro-reflective ................................................................................................. 59 RMS ..................................................................................................................... 59 Scale bar ........................................................................................................... 59 SuperStart .......................................................................................................... 59 Theodolite.......................................................................................................... 59 XYZ File................................................................................................................ 60 INDEX ................................................................................................................61
Photography
Photography - The First Part of Photogrammetry
Taking photographs is, of course, essential for making a photogrammetric measurement. To obtain the high accuracy, reliability and automation the system is capable of, photographs must be of the highest quality. Fortunately, because of the design of the system, photography with V-STARS is actually simpler than normal photography. The three main considerations for good photography are: 1. Field of View 2. Focusing 3. Exposure
Field of View
The camera's field of view defines how much it sees and is a function of the focal length of the lens and the size (often called the format) of the digital sensor. For a given lens, a larger format sensor has a larger field of view. . Similarly, for a given size sensor, a shorter focal length lens has a wider field of view. The relationship between format size, lens focal length and filed of view is shown below
The standard lenses available with V-STARS are so-called medium angle lenses and have about 50 wide fields of view. The wider the field of view, the more you see from a given location. For a medium angle lens, a convenient rule of thumb is that you will generally need to get back as far from the object as the size of the object. For example, you will get about three meters (ten feet) back to see a three-meter (ten foot) object. In general, there is a tradeoff between the field of view of a lens and accuracy. Although wider-angle lenses need less room around the object, they also tend to be less accurate. (The reasons for this are beyond the scope of this introduction.) Thus, you generally want to use the longest focal length lens you can. The medium angle lenses provided with V-STARS represent a good compromise between field of view and accuracy. For instances where space is limited, wider-angle lenses are available from GSI, however, accuracies will generally be 20 to 40% less than with the medium angle lenses.
Focusing
One consideration for normal photography is, of course, focusing the lens so the image is sharp. The range of acceptable sharpness is called the depth of focus. The depth of focus of a lens is a function of many factors, including: the focal length of the lens, the format size, the distance from the camera to the object, the size of the object, and the f-number of the lens. As you can appreciate from all the factors listed above, the depth of focus can be a complex function. V-STARS has been designed so that images will be in acceptable focus for points between 0.5 meters (20 inches) and 60 meters (200 feet) from the camera. Fixing the focus effectively eliminates the depth of focus problem.
Exposure
Camera Exposure
For photogrammetry purposes, it is desirable to set the targets bright and the background dim. When retro-reflective targeting is used, the target and background exposures are almost completely independent of each other. The target exposure is completely determined by the flash power while the background exposure is determined by the ambient illumination. The amount of background exposure is controlled by the shutter time. Eliminating the background exposure makes the targets easier to find and measure. However, if there is no background image whatsoever, trying to figure out which target is which can be difficult. Usually, a compromise is reached and the background exposure is set so the object is dim enough to not interfere with target measurement, but still bright enough that it can be seen when enhanced.
Background Exposure
The shutter time is used to control the background exposure. When the camera is off-line, the shutter time is selected using the mode switches that are located on the top of the camera next to the display. The available shutter times on an INCA2 range from 8 milliseconds to 8 seconds. The INCA2 camera has an AUTO Exposure feature that can be used to automatically set the shutter speed. The default setting is to use the AUTO Exposure. If AUTO Exposure is selected, the shutter exposure is set automatically the first time you take a picture on a job.
Target Exposure
The flash power setting for the target exposure depends on the distance from the camera to the targets, and the target size. The following diagram gives recommended flash power settings at varying distances. If you are shooting the object in sections, use the size of the sections. The tables assume the recommended target size (which is also listed) is used. If the targets are smaller than this, you may want to increase the flash power setting one step to help compensate. The tables assume the default lens f-number of F11 is used with an INCA. It is important to check the lens and make sure it is set to f11, the default setting for the lens.
Metrology
Metrology - The Second Part of Photogrammetry
Photography in its broadest sense is a process that converts the real 3dimensional world into flat 2-dimensional images. The camera is the device that makes this transformation or mapping from 3 dimensions to 2 dimensions. Unfortunately, we cannot map the 3-dimensional world onto two dimensions completely so some information is lost (primarily the depth).
Photogrammetry in its broadest sense reverses the photographic process described above. It converts or maps the flat 2-dimensional images back into the real 3-dimensional world. However, since information is lost in the photographic process, we cannot reconstruct the 3-dimensional world completely with just one photograph. As a minimum, we require two different photographs to reconstruct the 3-dimensional world. If this process was perfect, the two photographs are more than enough information to perfectly reconstruct the 3-dimensional world they represent. Unfortunately, the photography and measuring process is not perfect so the reconstruction of the 3-dimensional world is also imperfect. However, we can take more photographs and use the extra information in them to improve the process. The 3-dimensional coordinates we
produce from the measurements of multiple photographs are the end result of photogrammetry. Photogrammetry uses the basic principle of Triangulation, whereby intersecting lines in space are used to compute the location of a point in all three dimensions. However, in order to triangulate a set of points one must also know the camera position and aiming angles (together called the orientation) for all the pictures in the set. A process called Resection does this. Finally, because the V-STARS camera is a precision measuring instrument, it must be calibrated so its errors can be defined and removed. One of the most powerful features of V-STARS is its ability to produce this camera calibration as a byproduct of the measurement in a process called Self-calibration. Although each of these techniques is best described separately, they are actually all performed simultaneously in a process called the Bundle Adjustment.
Triangulation
Triangulation is the principle used by both photogrammetry and theodolites to produce 3-dimensional point measurements. By mathematically intersecting converging lines in space, the precise location of the point can be determined. However, unlike theodolites, one can measure multiple points at a time with virtually no limit on the number of simultaneously triangulated points.
In the case of theodolites, two angles are measured to generate a line from each theodolite. In the case of photogrammetry, it is the twodimensional (x, y) location of the target on the image that is measured to produce this line. By taking pictures from at least two different locations and measuring the same target in each picture a "line of sight" is developed from each camera location to the target. If the camera 9
location and aiming direction is known (we describe how this is done in Resection), the lines can be mathematically intersected to produce the XYZ coordinates of each targeted point.
Resection
Resection is the procedure used to get the final position and aiming (called the orientation) of the camera when a picture is taken. Typically all the points that are seen and known in XYZ in the image are used to determine this orientation. V-STARS uses the AutoStart or SuperStart operation to get the preliminary camera orientation. This orientation is based on the AutoBar or any known coded targets. For a strong resection, you should have at least twelve well-distributed points in each photograph. If your measurement does not have this many points, or they are not well distributed, it is recommendable to add points. Points that are added to strengthen the solution are called "fill-in" points. If the XYZ coordinates of the points on the object are known (we describe in Triangulation how this is done), we can compute the camera's orientation. It is important to realize that both the position and aiming direction of the camera are needed. It is not sufficient to know only the camera's position since the camera could be located in the same place but be aimed in any direction. Consequently, we must know the camera's position which is defined by three coordinates, and where it is aimed which is defined by three angles. Thus, although three values are needed to define a target point (three coordinates for its position), we need six values to define a picture (three coordinates for position, and three angles for the aiming direction).
10
Self-Calibration
Although the cameras and lenses used in the V-STARS system are of the highest quality, they must still be precisely calibrated to remove errors that are still present in the system. Some of these error terms can be described in terms of their physical cause while others are more empirically derived. In any case, all of these error terms are automatically solved for by V-STARS along with the XYZ coordinates of the target points and the orientation (position and aiming angles) of each picture in a process called the Bundle Adjustment. This ability to calibrate the camera as a byproduct of the measurement is called Self-calibration and it means the camera will be calibrated at the time of measurement, and under the environmental conditions that exist (temperature, humidity, etc.) at the time of measurement. This is far superior to relying on an old and possibly outdated laboratory calibration that may have been done under dramatically different conditions than existed at the time of measurement. There are certain requirements that must be met in order to selfcalibrate a camera, but they are usually easy to do. First, the measurement must have what is called roll diversity. This usually means you must take some photographs with the camera horizontal and some photographs with the camera vertical. . Although you will get better results if you take about half of your shots oneway and half the other, this is not critical. What is critical is that you must have at least one picture that is rolled approximately 90 differently than the others If you do not, you cannot self-calibrate the camera. Instead, you will have to rely on a pre-existing calibration that is less reliable and less accurate. A second requirement is that you must measure a minimum number of photographs taken from a minimum number of different locations. You should measure at least six photographs if the object is two-dimensional (the object is essentially flat) or four photographs if the object is threedimensional. Also, the photographs should be taken from at least three different locations. Since most jobs will take at least this many photographs there is usually no reason not to self-calibrate the camera. In fact, we strongly recommend that you always take enough photographs to self-calibrate the camera because it is so quick and easy to take and measure extra photographs.
11
A final requirement is that you must have a minimum number of welldistributed points on each photograph and for the entire measurement. Specifically, you should have at least twelve well-distributed points on each photograph, and at least twenty points for the entire measurement. Well-distributed means the points are distributed fairly evenly throughout the photograph. It is much better for example to have twelve points distributed evenly throughout the picture than to have fifty clustered together in one small area. If you do not happen to need this many points for the measurement or they are not well distributed, we recommend you add points to the measurement. As you will see, it is very quick and easy to add extra points to the measurement so feel free to do so.
Bundle Adjustment
The Bundle Adjustment is the program that processes the photographic measurements to produce the final XYZ coordinates of all the measured points. In order to do this, it must Triangulate the target points, Resect the pictures and Self-calibrate the camera. The Bundle Adjustment program is called STAR, which stands for Self-Calibration, Triangulation and Resection. The real power of the bundle adjustment is that it is able to do all three of these things simultaneously. If you review the descriptions of Triangulation and Resection, it appears there is a problem. In order to triangulate the measured points, we must know the orientation of the pictures.
Z y Image Space c Az, El, Roll 0 0 0 (X ,Y ,Z ) (xij, yij) x
Y Object Space
(X, Y, Z)J
However, in order to orient the pictures, we must know the coordinates of the measured points. How do we get started here? The answer is the bundle adjustment has the capability to figure them both out simultaneously and to self-calibrate the camera as well! This is where the name bundle adjustment comes from because it bundles all these things together and solves them all at the same time. The Bundle Adjustment does need a little help though. It must have the preliminary orientation for each photograph in order to get started. This preliminary orientation is accomplished with the AutoStart or SuperStart procedures that are done for every photograph.
12
When STAR is finished it then produces the following: 1. XYZ coordinates (and accuracy estimates) for each point 2. The XYZ coordinates and 3 aiming angles (and accuracy estimates) for each picture. 3. The camera calibration parameters (and their accuracy estimates).
Measuring Accuracy
V-STARS in the single camera mode provides accuracies comparable to those achieved by other large volume, high accuracy coordinate measurement systems such as Digital Theodolites, Co-ordinate Measuring Machines (CMMs), and Laser Trackers. Typical accuracies are 25 to 50 microns (0.001" to 0.002") on a 3-meter (ten foot) object for the INCA2 and 50 to 100 microns (0.002" to 0.004") on a 3-meter (ten foot) object for the E3 system. However, the accuracy of a photogrammetric measurement can vary significantly since accuracy depends on several inter-related factors. The most important are: 1. The resolution (and quality) of the camera you are using, 2. The size of the object you're measuring, 3. The number of photographs you're taking, and 4. The geometric layout of the pictures relative to the object and to each other. The diagram below illustrates the effects of the four factors and there influence on accuracy.
13
The diagram represents a pyramid with the four factors at the base of the pyramid and high accuracy at the top of the pyramid. To get higher accuracy ( a higher pyramid) you need more of the items shown on the lines of the pyramid (higher resolution, smaller size, more photos, and wider, but not too wide, geometry). See Appendix A. How Accurate is V-STARS? for a more detailed description of each of these factors.
Scaling Photogrammetry
Photogrammetric measurements are inherently dimensionless. An example of this is shown below. The picture of the first car could be a picture of a full-size car or of a matchbox model; there is no way to tell. However, if we know the size of something that is also in the picture, we can now say something about the size of the car. (Theodolites are another inherently dimensionless technology).
To scale a photogrammetric measurement, we must have at least one known distance. If we know the actual coordinates beforehand of some targeted points, we can compute the distances between these points and use these to scale the measurement. Another possibility is to use a fixture with targets on it and measure this along with the object. The distance between the targets on the bar is
14
known and can be used to scale the measurement. Such fixtures are commonly called scale bars. See also Attaching the Scale Bar (s), and the questions in Appendix A regarding scale.
15
The list above is a general guide. However, every measurement project is different, and therefore the content and even sometimes the order of the steps given above may be different depending on the project requirements and sometimes operator preference. For example, on some projects, you will take all pictures first (to minimize time on-site typically) and then measure them, while on others you will measure each picture after it is taken. On other projects, you will take and measure some pictures, and then process them to get preliminary results so you can make measuring the remaining pictures easier. Still, all the steps listed above are carried out in some fashion on every project. Each of these steps is described in detail in the following chapters.
16
Also, remember that V-STARS never measures the points of interest directly. Instead, V-STARS measures retro-reflective targets that are placed on, or in a known relationship to, the points of interest. If a point of interest cannot be seen directly, often some form of offset target can be devised to measure the point indirectly.
Size and Shape - What is the size and shape of the object? The size and shape (convex, concave, single-sided, multiple sided, etc.) will determine how complex the measurement will be, how much room you will need around the object, and the level of accuracy you can obtain. The size and shape will also determine what type and size of targets will be used. Targeting - Can the points of interest on the object be targeted? If they cannot, you must use another method (V-STARS in the multiple camera mode using the touch probe for example, See the V-STARS/M manual for details). Targeting the object to obtain the measurements you desire can often be one of the most challenging and time consuming aspects of a project. See Targeting for more information.
Notice the terms desired and required are both used. It is important to distinguish what level of accuracy is wanted and what level of accuracy is acceptable. Taking more pictures can increase photogrammetric accuracy significantly. It is important to realize that this accuracy improvement will reach a diminishing point of return. This tradeoff must be considered when deciding how many photographs to take. See Measuring Accuracy for more details on the factors (including the number of photographs) that affect accuracy. It is also important to define the level of accuracy in a clear and unambiguous way. There are many ways of specifying accuracy. For example, is the accuracy specified an absolute range (meaning no value should be outside the entire range) or is it an RMS value (meaning, on average, 67% of the values will be within plus or minus the accuracy specification).
Room - How much room is there around the object? This question relates to visibility again. The amount of room around the object will determine if the project is even feasible, and if it is, will determine to some extent the number of photographs you take. Remember that for the standard medium angle lens provide with V-STARS, the rule of thumb is you will see about as much of the object as your distance back from the object. For example, if you are 3 meters from the object you can see about 3 meters of the object. If there is not enough room to see the entire object in the photograph, you can still measure the object by photographing it in
17
overlapping sections (this technique is called mosaicing) but this makes the measurement more complicated.
Scale - Will scale be used? If so, how will it be applied to the object? Although this may seem a bit trivial at first, figuring out where to put the scale bar(s) so they do not block targets or are themselves blocked can be one of the more challenging aspects of a measurement. Add in the fact that it is desirable to have the scale bar be about the length of the object you are measuring, and that it must be rigidly attached to the object, and that if scale is important then we recommend using multiple scale distances, and this seemingly trivial task can sometimes be downright daunting. See Scaling Photogrammetry, and the questions on scale in Appendix A.
18
lines, planes, etc.) that are targeted in some way. In any case, it is important that the points representing the user-defined coordinate system be targeted precisely or else the accuracy of the transformation will be degraded. In fact, the accuracy of placing the targets precisely on the user coordinate system's defining features often is the determining factor in overall measurement accuracy. Fortunately, many different Target Types are available to help with this. See the WINTRANS manual for details on performing coordinate transformations. Coordinate systems are also called axis systems since the coordinate system is often defined by aligning certain points to the coordinate axes. In this document, coordinate system and axis system are used interchangeably and mean the same thing.
19
Although every photogrammetric project is somewhat different, we have separated them into broad categories to help describe general approaches for performing a successful measurement.
Measurements can be classified as initial or repeat, and as completely overlapping or partially overlapping. The two categories are not mutually exclusive; initial measurements can be completely overlapping or partially overlapping, and so can repeat measurements. In general, a completely overlapping, repeat measurement is the easiest type of measurement while an initial, partially overlapping measurement is the most difficult.
20
21
For example, we cannot even say how far the panels are from each other or how they are oriented to each other. If we now measure the panels with enough partial overlap that a line of points is seen in common between the two panels, we have now connected the two panels together but not with sufficient overlap to completely determine the relationship between the two panels.
The common line only acts like a hinge, the two panels are connected there but they could be at any angle to each other that this "hinge" connection allows. Therefore, the overlap must be more than just a line of points; it must be at least two-dimensional.
22
If we now add a third point in common between the two measurements that is away from the line (so the three points form a triangle), the "hinge" is now locked in place and the relationship between the two panels is established. Therefore, as a minimum, there must be three points, forming a triangle that is seen in common between the two sets of photography.
Of course, by adding more points and more overlap the tie between the two panels is more strongly established. The strongest tie between the two panels is established when all pictures see all of both panels; and we find ourselves back to the completely overlapping type of measurement.
23
24
3. Try to keep angles to retro-reflective targets less than 60 (for good, bright target images). To help illustrate the design for a completely overlapping measurement consider the measurement of a 2 meter by 1 meter flat granite surface plate with retro-reflective targets on its surface. The camera has a medium angle field of view lens so we will need to get about 2 meters above the surface plate to see the entire object. The key question is how many photographs should we take and from where to get high accuracy? To start off, let's consider two photographs taken on opposite sides of the plate.
As we move the cameras further apart, two things happen. First, the intersection angles between the two cameras gets larger which is good since it helps improve accuracies, but also the angle to the retro-reflective targets also gets larger which is eventually bad since the targets will ultimately become too dim to be measured.
25
As a rule of thumb, a good compromise between quality of intersection angles and quality of target image is found by locating the camera so it makes a 45 angle with the center of the object. This also keeps the angle to the retro-reflective targets that are furthest away from the camera less than the limit of 60. A nice thing about using an angle of approximately 45 to the center of the object is the camera location is easy to figure out; at 45, the distance out from the center of the object is equal to the distance back from the object. We can now add more pictures all around the object as desired to increase accuracy. Sometimes we can overcome the limitation caused by the retro-reflective viewing angle by using special targets instead of the regular, flat ones. For example, angled targets could be used at the edge of the plate, instead of flat targets to make the viewing angle more favorable. Also, several manufacturers make "tooling" retro-reflective targets that consist of a target that can be placed in a precision bushing and rotated to the best viewing angle. Of course, in both cases, the offset from the center of the target to the surface plate must be removed to get the measurement of the surface itself. The shape of the object also has an effect on the camera locations. For example, if the object was not flat but instead concave (for example, the reflective surface of a parabolic antenna), the retro-reflective targets at the far edge of the object would point more favorably towards the camera and now the camera intersection angles can be larger to get more accuracy.
Conversely, if the object were convex (for example, the back surface of the antenna), the camera intersection angles would have to be smaller so the retro-reflective targets at the edges could be imaged. In fact, depending on the curvature of the surface, the camera intersection angles may have to be so severely compromised, that it would be better to design the measurement so the object is measured with partial overlap.
26
In addition, your plan must consider blockage. Remember, we want to try to see ALL targets from at least four different locations. If part of the object cannot be seen (for example, the antenna feed may block part of the surface), try to take extra pictures from other locations that see the blocked targets. However, it can often be difficult to get good geometry if the blockage is severe. (A good example of this is trying to measure targets at the bottom of a long, thin cylinder.) If blockage or other limitations limit the number of favorable views we can get of the object or a portion of the object, we can improve accuracy somewhat (10-20% typically) by taking another photograph from the same location. You can improve accuracy further (another 10-20% typically) by taking the photographs with the camera rolled at a different angle for each picture.
27
28
For example, consider a rectangular room. To measure one of the long walls of the room you must get back against the other long wall, but the rectangular nature of the room does not allow you to get back far enough to see the entire wall.
In this case, you can divide the object up into areas and use the techniques described in Design for Completely Overlapping Measurements to make sure you have designed an accurate measurement for each area. In this example, we have divided the wall into left and right halves and taken pictures from approximately the four corners of each half. Thus, each half is seen in four photographs from four different locations. This is fine so far, but notice that there is no common coverage between the two halves so the entire measurement is not connected. (In practice, you will usually have at least some common coverage in the middle, but for the sake of this example, we assume there is none). There are a couple of different ways to connect the halves together. First, we can take more photographs in the middle that are aimed right at the center of the wall. For example, we can take two pictures in the center of the wall; one at the top, and one at the bottom. These photographs see part of the left and right halves and serve to tie everything together. This first approach is fine and is easy to do because you do not have to move the camera to any new positions.
29
However, another approach is to further divide the wall into a "middle" half and shoot in the four corners of this area. Since this area now sees part of the left and right halves, the entire measurement is now connected together. Although this approach is a little harder than the previous one because you have to move the camera to these new positions, this approach is somewhat more accurate due to the greater geometric diversity. The approach to use depends on the requirements. If speed is of the essence, use the first approach. If accuracy is the primary concern, use the second approach. Of course, these techniques can be extended if the wall needs to be shot in more than two sections.
30
Usually eight to twelve well-distributed targets are all that is needed to provide a strong tie between the front and back. One possible solution is to put targets on the fixture holding the panel or on the floor around the panel that can be seen from both sides. However, if the panel is not rigidly attached to the holding fixture or the floor, we cannot do this because these tie points must be stable with respect to the panel. Also, the viewable areas on the floor or fixture may not allow for a very good distribution of the tie points. Remember, just a line of common points is not sufficient. Another approach is to put targets on the edge or top of the panel that can be seen from both sides. However, this presents some difficulties. If the panel is too thin we cannot put the usual selfadhesive targets on the edge unless we mount them to a hard carrier that can then be attached to the edge. If the panel is steel the hard carrier could be magnetic; if it is not, glue can be used. Even if self-adhesive targets can be put on the edges, seeing them can still be difficult since they are now perpendicular to the front and back sides. One solution is to put so called "back-to-back targets" on the edges that consist of a carrier that attaches to the edge so the target is now parallel to the face of the panel. Then, the target consists of two self-adhesive targets placed back-to-back so the target is retro-reflective on both sides. The back-to-back target is mounted in the carrier so it is rigid and now the target can be seen from both sides. However, since the back and front of the target are not the same point (they are separated by the thickness of the two target surfaces which is about 0.2mm or 0.008") this approach should not be used when high accuracy is needed. A better approach to use when high accuracy is needed is to use so-called "turnable targets". These are precisely made target carriers designed to be mounted in a precision bushing so they can be rotated. The target is constructed so the center of the target is at the center of rotation of the target carrier.
31
The bushings can be attached to the panel edges and then right-angle targets are placed in the bushings. The targets can then be turned so they are parallel to the face being photographed. Because the target maintains the same location when rotated (within +/- 12 microns or 0.0005"), the targets serve as good tie points.
32
photographs, and to have strong connections between all the separate areas. Even if you are not measuring the top of the box, you may find it very useful to add targets here since these may very well be seen from many different locations around the box. This will tie all the photographs together very strongly. One problem with this though is you may have difficulty seeing flat targets placed on the top surface. In this case, you will find it useful to again use turnable, right angle targets. They would be placed in bushings that are attached to the top surface. You can then turn these to face the camera as you go around the box.
33
be put in the same location it was on the initial measurement. If the AutoBar is left attached to the object, this is usually no problem, but if the AutoBar was removed, it must be placed back in its original position. Often, an alignment fixture of some sort can be used to help accomplish this. Scale bar(s) are generally required on initial measurements if good scaling of the object is needed (see Appendix A about scale and its use). Scale bars may not be needed on repeat measurements. If some of the points on the object do not move from measurement to measurement (points on a stable frame holding the object for example), they can be used as scale points. If scale bars are used, it is helpful if you can put them back on the object in nearly the same location as before, but this is not necessary. Type of Measurement Repeat, Completely Overlapping Repeat, Partially Overlapping Initial, Completely Overlapping Initial, Partially Overlapping AutoBar Optional1 Optional1 Required Required Coded Targets2 Required Required Required Required Scale Bar(s) Optional Optional1 Required Required
1 AutoBar must be placed back in original location. 2 So the measurement can be completely automated.
34
35
36
enhancement features available in V-STARS to enhance the object. See Background Exposure section for details on exposing the background.
Target Angle
Although retroreflective targets have several advantages over conventional targets they tend to lose their special reflective properties when viewed at steep angles and become dim and unmeasurable. The targets shouldn't be viewed from more than 60 to 65 off-axis for the best results.
Target Thickness
In some measurements the target thickness may need to be removed to get the location of the point of interest. Retro-reflective targets are physically 100 microns (0.004") thick but what really matters is the optical thickness. The optical thickness depends on whether the target is masked (has a black background around the retro-reflective material) or unmasked (has no background). Masked targets have an optical thickness of 110 microns (0.0044") and unmasked targets have an optical thickness of 63 microns (0.0025"). The optical thickness should be taken into account and removed when necessary. Generally most CAD programs can automatically remove target thickness when CAD modeled surfaces are measured. In most other cases it is necessary to have a local plane available to define the direction in which the offset should be compensated for.
Target Sizes
The target size must be large enough to be measured accurately. For an accurate measurement, the target image should be at least 3 pixels wide and 3 pixels high. The appropriate target size for a measurement depends on several factors. These include the distance from the camera to the object, the resolution of the camera you are using, the lens focal length, and the target exposure. V-STARS has been designed to measure the standard size targets used throughout industry over a wide range without losing accuracy.
37
A convenient rule of thumb to use for target size is that the target diameter should be at least 1/1000th of the object size (or one millimeter per meter). For example, if the object is 3 meters (10 feet) in size, the target should be at least 3mm (1/8") in diameter. If you are shooting an object in sections, then the minimum target diameter should be 1/1000th times the average size of the sections you are photographing. Although V-STARS can accurately measure targets of this size, we recommend using targets that are twice the minimum size since they will be easier to find and measure. The rule of thumb described above is fast and easy to use, and is fine for most circumstances. The diagram below is useful in helping you determine what target size to use with an INCA camera.
For best results, we recommend you try to use the same size targets on a measurement whenever possible. However, target sizes, which vary by up to 2 to 1 in size, are usually acceptable.
38
Target Types
Many different types of retro-reflective targets are available. These include:
39
In general, you should avoid mixing masked and unmasked targets on the same job because they have different optical thickness.
Target Tape
This is a continuous roll of self-adhesive black tape with retro-reflective targets at regular intervals. This material is especially useful for measuring surfaces since it is much faster to apply (and remove) than individual targets. Tape is available with different target sizes and intervals. Some typical examples are shown below.
40
and 90 targets are especially useful because when mounted in a precision bushing they can be turned towards the camera without losing accuracy. Spherical hard-body targets are also available. These targets are similar to the hard-body tooling targets above but the retro-reflective target is spherical so the target does not need to be turned. Unfortunately, these targets are not as accurate as the hard body tooling targets (they are accurate to 100 microns or 0.004") but they are especially useful as a substitute for turnable targets when the target is hard to reach.
41
Coded targets
Coded targets are a special type of target that the V-STARS software can recognize and automatically decode. Each code is made up of a unique pattern of squares and a central dot. Currently there are 132 coded targets available. Coded targets come in 3mm, 6mm and 12mm dot sizes.
Target Scratch
42
1. Avoid touching the retro-reflective material since the natural oil and dirt from your hands can hurt the retro-reflective effect and make the target dim and unmeasurable.
WRONG
RIGHT
RIGHT
3. You should store the targets in a clean, dry area (inside a sealed storage container is best). 4. You cannot use retro-reflective targets when they are wet since the water changes the index of refraction and destroys the retro-reflective effect. Dry targets by rubbing or dabbing them gently with a cloth or tissue and allow them to dry. 5. Use masking tape to lift off dirt and grim from the target. If this is not effective, clean targets with rubbing alcohol or denatured alcohol by gently rubbing the retroreflective material with an alcohol dampened cloth or tissue. Be sure to let the target dry completely before you use it.
Do not use acetone or similar solvents or the target may be permanently damaged
43
glue gun provided with the system to glue the AutoBar to the object. Whenever possible, the AutoBar should be placed so it is easy to see and are not blocked by the object. Usually placing the AutoBar somewhere in the middle of the object is best but is not necessary. Also, the AutoBar should not block other target points. If an AutoBar is moved during the measurement, you can usually still continue the measurement but you can no longer use the AutoBar. The standard size AutoBar provided with the system can be used at a range of up to 10 meters (33 feet). For larger distances, a larger AutoBar can be used. Some larger sizes are available from GSI If you are going to use the AutoBar for a repeat measurement, it must be placed back in the same locations it was in for the initial measurement. If the AutoBar has not been removed, this is usually not a problem. If the AutoBar has been removed, you will usually need to design some sort of fixture that allows you to return the AutoBar to its original location.
44
45
46
47
Number of Photographs All other factors being equal, increasing the number of photographs will increase the accuracy of the measurement. Since V-STARS measures by triangulation, each target must be measured in at least two photographs for the point to be triangulated. If a target is seen in more than two photographs, the accuracy will increase. However, the accuracy increase is not linear. As a rule of thumb, the accuracy increases with the square root of the increase in the number of photographs. So, to increase the accuracy of a two-photo measurement by a factor of two, you must take not twice as many photographs but four time as many, or eight in this case. To increase accuracy by another factor of two, you would have to take 32 photographs. Obviously, one quickly reaches a point of diminishing returns when simply taking more photographs to increase accuracy. That said, it is worth mentioning that additional photographs also increase reliability because they reduce the influence of poor measurements. For that reason, we recommend trying to have each target seen in at least three (and preferably four) photographs. These pictures should be taken from different stations. Geometry Since V-STARS measures by triangulation, the geometry of the camera stations can have a considerable influence on measurement accuracy. Typically, one should try to get intersection angles of 90 or so between the lines of sight of the camera stations for the best results. Smaller intersection angles will progressively reduce accuracies. The figure below illustrates this. The thin lines around the thick lines show how errors in detecting the true centroid of target image produce errors in determining the location of the target.
Final Discussion on Accuracy As you can see from the above discussion, accuracies can vary considerably. However, if you use the INCA camera, and take six to eight 48
photographs with good geometry, and each photograph sees the entire object you should obtain accuracies of 25 to 50 microns (0.001" to 0.002") on a 15 foot object. The effects of the four factors mentioned above on accuracy are illustrated by the diagram below. The diagram can be thought of as a pyramid with the four factors at the base of the pyramid and high accuracy at the top of the pyramid. To get higher accuracy ( a higher pyramid) you need more of the items shown on the lines of pyramid (higher resolution, smaller size, more photos, wider (not too wide though) geometry).
49
50
periphery of the object, or extend outside the boundaries of the object being measured. For the best results, the Scale Bar(s) should be comparable to the size of the object being measured. Finally, it is very important to realize the Scale Bar(s) must be rigidly attached to the object being measured. That is, a Scale Bar CANNOT move relative to the object being measured while the object is being measured. If it does move during this time, the scale measurements will be corrupted, and can't be used. (If the Scale Bar has moved during the measurement, the operator will be able to detect the movement when looking at the measurement results).
positions with the turntable. Of course, the object must be rigid enough to maintain its shape when being rotated. If the object is moved, it is important that the Scale Bars be mounted so that they move with the object. If not, the scale measurement is corrupted, and can't be used.
What size should the targets be? Can I use different size targets on the same measurement?
The target size depends on the distance from the camera to the object. A rough rule of thumb is to use a target 2 millimeter (0.040") in diameter for every meter of object size. For example, you should use a 6 mm diameter target for a 3 meter object. If necessary, you can use smaller target sizes by increasing the strobe power. For best results, we recommend you try to
52
use the same size targets on a measurement whenever possible. However, target sizes which vary by up to 2 to 1 in size are usually acceptable. See Target Sizes for more information.
Do I need to provide special lighting for the system? Do I have to consider the lighting during the measurement?
The strobe system provided with V-STARS is all that is needed to illuminate the targets, and the target exposure is independent of the ambient light. However, you should set the shutter time to underexpose the background. This makes the targets easier to find and measure. See Background Exposure for information on how to expose the background.
Do I need to know the camera location when I take a picture? How steady must the camera be when taking a picture?
You don't have to know where the camera is since V-STARS figures out where the camera is located automatically using GSI's AutoStart procedure. With AutoStart, the operator only has to measure four known points (which can't be collinear) on the image and V-STARS will figure out where the camera is. If you don't have good coordinates for any points on the object (a first time measurement, for example) you can use our AutoBar to get the camera location. Since the targets are illuminated by a nearly instantaneous flash from the strobe, the camera doesn't have to be steady. This is one of the greatest
53
advantages of photogrammetry over other large-volume, high-accuracy measurement technologies. The camera can be used on scaffolding, lifts, ladders, etc. and can be used in environments where movement or vibration is occurring.
How far away do I have to get from the object to measure it? Where should I locate the camera to get a good measurement?
The distance from the camera to the object is very easy to determine. Simply get back far enough to see the object you want to measure (or the part of the object you want to measure if you are measuring the object in sections). As a rule of thumb, you will need to get the same distance back from the object as the size of the object. For example, you will need to get about ten feet back to measure a ten foot object. See Field of View for more details. If you haven't done so already, read question 1 above about factors affecting accuracy, especially the fourth factor regarding geometry. Of course, getting good geometry isn't the only consideration when considering where to locate the camera for a good measurement. You must also locate the camera so every target is ultimately seen in at least two (preferably four) photographs with strong geometry. On objects with lots of blockage and or complex surfaces, figuring out where to locate the cameras to get a good measurement can be a challenge.
How can I calibrate the camera and make sure the measurement is accurate?
V-STARS normally automatically calibrates the camera as a byproduct of the measurement in a process called self-calibration. Self-calibration is a very powerful technique that allows the camera to be calibrated at the time of measurement under the conditions that exist at the time of the measurement. In order to self-calibrate the camera you must take a minimum of six photographs if the object is essentially flat, and a minimum of four photographs if the object isn't flat. If self-calibration can't be used on a particular measurement, pre-calibrated values can be used but accuracies may be somewhat lower. See Self-Calibration for more details. V-STARS also provides internal estimates of accuracy for each measured point. These internal estimates of accuracy have been extensively 54
compared to external measures of accuracy (repeatability, artifacts, known distances, measurements by other systems, etc.) and have been found to be consistent and reliable. This is important because often in everyday measurements one does not have access to external measures of accuracy and must rely on the internal accuracy estimate as a quality indicator.
55
Glossary AutoBar
The AutoBar provided with the V-STARS system is a fixture with five targets arranged in the form of a cross. The target's known coordinates are used by GSI's AutoStart procedure to determine the camera's orientation relative to the AutoBar. The AutoBar is securely attached on or near the measured object, preferably in a highly visible location. The AutoBar's default coordinate system has its origin at target1 at the bottom of the AutoBar. The positive Z axis goes thru point 3 at the top of the bar. The positive X axis is up out of the AutoBar.
AutoStart
The procedure used in V-STARS to get the preliminary orientation (location and aiming) of each photograph taken in a measurement. In order to AutoStart , one must merely measure four target points with known X, Y, Z coordinates. The only requirement is that the four points should not lie on a line. AutoStart is often used in conjunction with the AutoBar provided with the V-STARS system to make measurements fast, easy and automatic.
CMM
Abbreviation for Coordinate Measuring Machine. A widely used family of machines that make 3 dimensional measurements of objects. Typically, the machine has a head with a measuring tip attached to it that can be moved around in a 3-dimensional space (usually the head is attached to rails and a gantry. The location of the head is encoded so that everywhere it touches the object the 3-dimensional coordinates are measured.
56
Coded targets
Coded targets consist of a central circle surrounded by a pattern of squares. The different pattern of squares around each target uniquely identifies that target. When used properly, coded targets allow measurements to be done completely automatically.
Driveback
When approximate coordinates are available for all or some of the target points on a measurement, they can be measured automatically. After the photograph is oriented (using the AutoStart or SuperStart procedures), V-STARS converts each X,Y,Z target coordinates into predicted x,y image coordinates and then searches for the target in that area.
Field of View
The camera's field of view defines how much it sees and is a function of the focal length of the lens and the size (often called the format) of the digital sensor. For a given lens, a larger format sensor has a larger field of view. Similarly, for a given size sensor, a shorter focal length lens has a wider field of view.
Focusing
The range of acceptable sharpness is called the depth of focus. The depth of focus of a lens is a function of many factors, including: the focal length of the lens, the format size, the distance from the camera to the object, the size of the object, and the f-number of the lens. V-STARS has been designed so that images will be in acceptable focus for points between 0.5 meters (20 inches) and 60 meters (200 feet) from the camera. Fixing the focus effectively eliminates the depth of focus problem
57
F-number
The F-number is the ratio of the lens focal length to the diameter of the lens iris. The f-number provides an indication of the light sensitivity of the lens. The lower the f-number, the more light sensitive the lens is. However, lower f-numbers also reduce the depth of focus.
Flash Synchronization
The camera's flash must fire at the same time that the camera's shutter is completely open or else the retro-reflective targets will not be exposed.
Free-format
Free-format fields do not have to occupy any particular columns of the record. Each field simply must end with a blank or comma or tab character. A free-format field may also have any number of leading blanks.
Orientation
Orientation is the term used for the cameras position and aiming in space. The orientation of a camera is defined by its coordinates (X,Y,Z) and by its aiming direction (defined by three angles). GSI's AutoStart and Resection procedures are used to accurately determine the camera's orientation.
Photogrammetry
Photogrammetry, as its name implies, is a 3-dimensional coordinate measuring technique that uses photographs as the fundamental medium for metrology (or measurement). Photography describes the photographic principles involved in photogrammetry, while Metrology describes the techniques for producing 3-dimensional coordinates from two-dimensional photographs.
Resection
Resection is the procedure used to get the final position and aiming (called the orientation) of the camera when a picture is taken. Typically all the points that are seen and known in XYZ in the image are used to determine this orientation.
58
Retro-reflective
A property which causes light to be reflected very efficiently back to the light source. The retro-reflective targets used by V-STARS act much like highway reflectors but are much more efficient. By using a low-powered flash located at the camera to illuminate the targets, the resulting target images are very bright and easy to find and measure
RMS
Root-Mean-Square - a statistical measure of the dispersion or spread of a group of data. The name comes from the fact that the RMS is equal to the square Root of the Mean (average) of the sum of Squares of the values in the data set. With regards to resections, the RMS provides a measure of the quality of the resection.
Scale bar
A fixture that has two or more targets with known distances. The distance(s) between the target(s) are used to scale the measurement.
SuperStart
The SuperStart command will open the picture and complete the following processes: 1) 2) 3) 4) Scan image for potential targets Determine the whether an AutoBar is present Decode any codes that are present. Use the known (coordinated) coded targets and AutoBar found to determine the location in space (resection) of the image. 5) Driveback to any points in the Driver file.
Theodolite
A precise angle measuring instrument. It consists of a sighting telescope which can be moved in azimuth and elevation. The azimuth and elevation angels are very precisely encoded. Using two widely separated instruments operators can sight through the telescopes on a common point and produce the 3-dimensional coordinates of the point by triangulation.
59
XYZ File
Each record of an XYZ file has a valid Point Label followed by the point's X, Y and Z coordinates. Sometimes, accuracy estimates for the point in X,Y and Z may also be included, but these are not used by V-STARS. The format for an XYZ file is shown below. Point Label Point Coordinates (X,Y,Z) 0.0010 0.0008 0.0015 Point Accuracies (X,Y,Z) 0.0018 0.0003 0.0005
Examples of some records are given below: POINT1 12.5122 -2.2231 3.4456 0.0012 REF22 -1.3132 3.5932 5.3768 0.0004 LINE1 19.5422 -6.8776 2.7896 0.0022 All the fields are free-format.
60
Index
Accuracy ............................................................................................................. 13 Accuracy Factors Geometry ......................................................................................................... 48 Number of Photographs................................................................................. 48 Object Size ....................................................................................................... 47 Resolution ......................................................................................................... 47 Appendix A.......................................................................................................... 46 AutoBar........................................10, 15, 18, 21, 33, 34, 35, 36, 43, 44, 45, 56, 59 Attaching the................................................................................................... 43 Glossary ............................................................................................................ 56 AutoStart ................................................................................10, 12, 21, 56, 57, 58 Glossary ............................................................................................................ 56 Bundle Adjustment ...................................................................................9, 11, 12 CMM - Glossary ................................................................................................... 56 Coded targets.........................................................................................33, 42, 57 Glossary ............................................................................................................ 57 Nuggets - Glossary .......................................................................................... 57 Coordinate System Defining a ......................................................................................................... 18 Driveback............................................................................................................. 59 Glossary ............................................................................................................ 57 Exposure ............................................................................................................. 4, 6 Background ................................................................................................. 6, 37 Camera .............................................................................................................. 6 Target............................................................................................................ 7, 36 FAQ Can I use different size targets on the same measurement?................... 52 Can the object move while it is being measured?.................................... 51 Do I have to consider the lighting during the measurement? ................. 53 Do I need scale for the measurement?....................................................... 50 Do I need to know the camera location when I take a picture.............. 53 Do I need to provide special lighting for the system? ............................... 53 Do I need to use special targets with the system?..................................... 52 How accurate is V-STARS? ............................................................................. 47 How can I calibrate the camera and make sure the measurement is accurate?..................................................................................................... 54 How do I compensate for scale changes due to temperature? ............ 51 How far away do I have to get from the object to measure it?.............. 54 How many photographs are needed for a measurement? .................... 49 How many points are needed for a measurement? ................................. 50 How obliquely can I view the targets? ........................................................ 53 How steady must the camera be when taking a picture? ...................... 53 What size should the targets be?.................................................................. 52 Where should I locate the camera to get a good measurement? ........ 54 Field of View ...................................................................................................... 4, 5 61
Glossary ............................................................................................................ 57 Flash Synchronization - Glossary ....................................................................... 58 F-number - Glossary ............................................................................................ 58 Focusing ............................................................................................................. 4, 6 Glossary ............................................................................................................ 57 Free-format .......................................................................................................... 58 Free-format - Glossary ........................................................................................ 58 Frequently Asked Questions .............................................................................. 46 Measurements Completely or Partially Overlapping......................................................21, 28 Design for..............................................................................................28, 30, 32 Design for Completely Overlapping ......................................................24, 29 Design for Partially Overlapping ................................................................... 28 Different Type Procedures.............................................................................. 33 Initial and Repeat............................................................................................ 21 Planning for Different Types of....................................................................... 24 Planning the ..................................................................................................... 16 Types of............................................................................................................. 20 Metrology......................................................................................................... 8, 58 Orientation........................................................................................................... 58 Glossary ............................................................................................................ 58 Photogrammetry.....................................................................................4, 8, 9, 58 Basics................................................................................................................... 4 Glossary ............................................................................................................ 58 Photography...................................................................................................... 4 Photography................................................................................................4, 8, 58 Planning Summary and Checklist..................................................................... 35 Planning Tips ........................................................................................................ 34 Resection .......................................................................................9, 10, 12, 35, 58 Glossary ............................................................................................................ 58 Retro-reflective..................................................................................24, 34, 37, 42 Glossary ............................................................................................................ 59 RMS .................................................................................................................17, 59 Glossary ............................................................................................................ 59 Scale ...............................................................................................................34, 44 Attaching the................................................................................................... 44 Glossary ............................................................................................................ 59 Long Distances ................................................................................................ 15 Multiple Distances ........................................................................................... 15 Scaling Photogrammetry.......................................................................14, 18, 44 Self-Calibration........................................................................................11, 12, 35 SuperStart.....................................................................................10, 12, 21, 57, 59 Glossary ............................................................................................................ 59 Target Angle................................................................................................................. 37 Handling and Care ......................................................................................... 42 Hard-body tooling targets ............................................................................. 40 Retro-reflector Targets and Their Characteristics ....................................... 36 62
self-adhesive stick on...................................................................................... 39 Sizes .............................................................................................................37, 44 Tape .................................................................................................................. 40 Thickness ........................................................................................................... 37 Types ...........................................................................................................19, 39 Targeting Introduction to ................................................................................................. 36 Targeting Checklist ............................................................................................. 45 Theodolite - Glossary .......................................................................................... 59 Triangulation ....................................................................................4, 9, 10, 12, 35 V-STARS Planning Checks: ................................................................................. 35 XYZ File - Glossary ................................................................................................ 60
63