Hunnish 注:本文对AOI(自动光学检测)应用的阐述比较全面和清晰。就目前而言,AOI算是机器视觉比较成功的应用,今后的市场前景也非常光明。现转帖于此,做个参考。
=========
Applying Automated Optical Inspection
by Ben Dawson, Ph.D., DALSA Coreco, ipd Group
The goal is to develop an accurate, fast AOI system as flexible and easy to train as a human.
Automated optical inspection (AOI) uses lighting, cameras, and vision computers to make precise, repeatable, high-speed evaluations of a wide range of products. Human vision has limited accuracy and is slow but very flexible and easy to train. Mechanical gauging is accurate and precise but slow and cannot be used to evaluate changes in visual appearance.
A machine vision or AOI system can take millions of data points (pixels) in a fraction of a second. These data points are used for visual inspection and precision measurement. With modest effort and cost, an AOI system can resolve about 25 microns. With increasing effort and cost, measurement resolution can approach a micron.
Typical applications for AOI include the following:
• Gauging the diameters and concentricity of holes in automotive parts.
• Ensuring that lids and labels are properly applied to food and pharmaceutical products.
• Evaluating molded parts against three-dimensional (3-D) CAD data.
• Ensuring that all parts are present in a product assembly.
• Checking for cracks, flaws, contamination, scratches, and other defects.
• Optical character recognition (OCR).
• Grading agricultural products such as seed corn or fruit.
From these applications, you see that AOI systems are used for inspecting parts that have limited and known variations. For defect or flaw detection, the AOI system looks for differences from a perfect part. Agricultural inspections might check for variations in part color, perhaps to find ripe fruit. To successfully apply AOI, you need to set up the AOI system for specific types of parts and limit the visual appearance of those parts.
An AOI system also must be set up or trained to inspect visual features of the parts. For example, you must tell the AOI system what features to measure on an automotive part or teach it the color of ripe fruit for sorting agricultural products. We are working on making setup and training easier, but current technology is nowhere near a human’s ability to understand and quickly learn what parts and features to inspect.
What Is in an AOI System?
Figure 1 is a schematic diagram of a typical AOI system. This particular system inspects automotive bearings for cracks and flaws, but the components and methods are similar for other AOI applications.
Figure 1. Schematic Diagram of an AOI System
|
In this example, bearings are released by a feed cogwheel and slide down an inclined track. The track has rails that limit the part’s side-to-side movement. This kind of mechanical restraint is known as staging or fixturing. Staging positions the part in a known location and decreases variability in where the parts are and how they look. This reduces the computation required by the vision computer so that parts are quickly inspected.
As the bearing slides down the track, it interrupts a laser beam. A part-in-place (PiP) sensor detects this interruption and signals the vision computer that the part is in a known location. The vision computer then triggers the five cameras to simultaneously acquire images of the bearing. When a PiP sensor cannot be used to trigger image acquisitions, the vision computer must detect when a part is present by analyzing the images, and this slows down the system.
Lighting the part is critical for AOI. Obviously, the AOI system must be able to see the parts and features to do the inspection. Beyond this, lighting amplifies features of interest and suppresses visual features that are noise.
For example, many products reflect the light sources, causing bright highlights in the image. Highlights can obscure features in the image that we want to inspect. In this example, we use a large, diffused red LED light directly above the part. The cameras are set at an angle so they can see both the top and sides of the part, but there is no highlight. This allows the visualization and detection of fine cracks in the part as well as chip-outs along the top edge.
Staging and lighting are critical for an AOI system because they reduce variability in part images and act as preprocessors to select image data for the vision computer. Without this preprocessing, the vision computer would be too slow or unable to do the inspection.
You may be able to use an AOI system that has built-in staging and lighting, but often these have to be designed for your AOI task. A variety of standard lights and mechanical components helps with this task.
The camera’s lens forms an image of the bearing on the camera’s sensor, typically a CCD or CMOS image array sensor. Inexpensive machine vision quality lenses are used in this inspection, but inspecting small parts or high precision and accuracy measurements requires more expensive lenses. Again, the optics may be included in the AOI system or chosen for your specific task.
The camera translates the pattern of light from the part into an electronic image. Cameras designed for AOI systems have square (1:1 aspect ratio) pixels to simplify measurements, progressive scanning rather than interlaced scanning, a fast shutter, and an asynchronous trigger for acquiring images.
The progressive scanning and fast shutter reduce blurring of the part’s image due to movement of the part. The trigger is necessary to synchronize the image acquisition with the presence of the part.
The brains of an AOI system are a vision computer and its software. This computer analyzes the images to extract measurements, counts, colors, and other visual features needed to do the inspection. The results of the inspection are used to reject defective parts.
In this example, a compressed air kicker is activated to remove defective bearings from the line. The vision computer also sends statistics and process data to a database.
Another Example: Grading Corn
The AOI task in Figure 2 is to find the ratio of bad (dark) corn kernels to the total of good (yellow and orange) and bad kernels. This ratio is used to grade seed corn lots; lots with fewer bad kernels sell for more.
Figure 2. Image of Corn Kernel Inspection
|
A typical AOI measurement task assumes ridged, well-defined parts and that any variation beyond some tolerance is a defect. Here, the parts are not well defined in size and shape, so trying to use a caliper tool to measure kernel size would be useless and frustrating. Instead, we use the known colors of good and bad kernels to approximate the desired ratio.
The staging and lighting consist of the operator taking a scoop of corn from a lot and spreading the kernels on a light table so the kernels are not overlapping. Since this is done on a sample evaluation basis, automating the staging is not worth the cost and effort.
The ratio measurement must be consistent over time and across operators. The evaluation task must apply objective standards to classify bad and good corn kernels.
We teach the AOI system the color and color variation of known good and bad corn kernels and the color of the background. The ratio we want is approximated well enough by taking the ratio of pixels with bad colors to the pixels with bad or good colors, ignoring the background color. While not as exact as if we had counted each kernel, it is a lot faster and removes the operator’s subjective judgment from the evaluation.
Advances in Applying AOI
Many of the problems in applying AOI arise from the limited intelligence and flexibility of an AOI system. We can pick up a part, examine it with various views and lighting, do a lot of neural processing, and draw conclusions based on our knowledge about objects and the materials they are made from. An AOI system has to rely on staging to present the part and has a limited time to examine the part. It doesn’t understand objects and materials and has very limited processing capabilities.
Improvements in lighting, computing capability, and vision software have made AOI systems smarter and more flexible, though still far from human visual intelligence.
Lighting preprocesses the image to amplify features you want to in-spect and suppress noise. Advances in lighting have improved the capabilities of vision systems, in part by reducing the computation required by the vision computer.
The adoption of standard LED-based lighting has improved AOI systems because it is very stable and easily controlled when compared to the older incandescent and fluorescent lighting solutions. For example, we can strobe an LED light source to give a brief and intense flash of light that stops part motion. This is difficult to do with older lighting technology.
Another lighting method projects a pattern of light on an object, often by using a laser with a holographic lens. The distortions of this structured light pattern can be measured and processed to recover the object’s 3-D structure, at least what we can see of it. AOI systems using structured light can, for example, compare complex objects such as engine blocks to the designed shape in CAD files.
Another major boost to the intelligence of AOI systems comes from the rapid improvement in PCs. AOI tasks that previously required special computing hardware now are done with generic PCs along with hardware for image acquisition, communications, and synchronization. Demanding inspection tasks, such as inspecting LCD flat-panel screens, still require the horsepower of a dedicated vision processor.
The biggest advance in applying AOI is the improvement in the vision computer’s software. In the not-so-good old days, you could expect to spend many months laboriously programming the vision computer for your task. The thrust of recent software development makes this task much easier by providing interfaces to hide the hardware details and incorporating the specialized knowledge needed to do AOI tasks.
The mantras of AOI vision computer vendors currently are ease of setup and ease of use. With a specialized AOI system, perhaps for 3-D measurement using structured light, the setup and operator interfaces can be very easy to use because the task domain is very limited and well specified.
If you need a custom AOI system, then you, an integrator, or a vision component vendor have to write the AOI software. Rapid application development (RAD) packages, such as ipd’s Sherlock™, make this relatively easy. These packages typically have an easy-to-use interface with features such as drag-and-drop selection of tools and operations and online help.
If you need extra computing power or find the RAD package limiting, there are many mature software libraries. Just be prepared for a long learning curve.
Many AOI tasks can be solved with a good set of general vision tools. These tools include visual search, measurement, defect detection, and bar-code and OCR reading.
Vision computer vendors have developed packages that bundle these tools inside a graphical user interface. No programming is required, and most of the specialized knowledge needed to solve an AOI task is incorporated in the software.
Summary
AOI has many applications but is limited to well-specified parts in well-controlled settings. It would be nice to have an AOI system as flexible and as easy to train as a human but with the speed, accuracy, and resolution of a computer vision system. Such systems are many years off, but that doesn’t discourage us from continually improving existing AOI systems.
The three major efforts in putting together an AOI system are building the part staging, getting the right lighting, and programming the vision computer. Improvements and standardization of lighting and mechanical fixtures have made the first two tasks much easier. The improvement in computing power and vision software, particularly the focus on easy-to-setup and easy-to-use vision software, continues to make it simpler to program the vision computer.
Developing a fully custom vision system using traditional software libraries can take many months of work. Using a RAD package reduces the time to weeks.
For many common AOI applications, new programming-free software packages can cut development time to a few days. In all cases, get help with staging, lighting, optics, and the camera choice.
About the Author
Ben Dawson, Ph.D., is director of strategic development at DALSA Coreco, ipd Group. He earned M.S.E.E. and Ph.D. degrees from Stanford University and also was on the staff of M.I.T. Dr. Dawson has written more than 50 scientific and technical papers on human and machine vision. DALSA Coreco, ipd Group, 900 Middlesex Turnpike, Building 8, Second Floor, Billerica, MA 01821-3929, 978-670-2050, e-mail: bdawson@goipd.com
分享到:
相关推荐
在实际的AOI应用中,可能还需要考虑以下问题: - **数据格式**:确定PLC和AOI系统之间数据交换的格式,如JSON、XML或自定义格式。 - **安全性**:确保通信的安全性,可能需要实施加密和身份验证措施。 - **实时性**...
《AB PLC在Logix平台上的AOI应用详解》 在自动化行业中,Allen Bradley(AB)的PLC(可编程逻辑控制器)系统因其稳定性和灵活性而备受赞誉。此资源 "[MMS_045618]AOI for Logix platform.rar" 提供了一个关于如何在...
二、AOI应用简介: AOI可以在多个生产阶段使用,包括炉前、炉后、2D锡膏检测、DIP段(插件及波峰焊后)和红胶工艺。它能够检测的缺陷包括:缺件、偏位、旋转、侧立、立碑、翻件、极反、错料、破损、错位等元件本体...
在AOI应用中,Sequencer可能用于指导机器视觉系统执行一系列检查步骤,如图像捕获、特征识别、缺陷分析等。 1. **AB PLC基础知识**:AB PLC是基于Ladder Logic编程的,这是一种图形化的编程语言,类似于电路图,...
《AB PLC在QTS-CLX-PVX PROVOX Module REV 1.1中的AOI应用详解》 在工业自动化领域,AB PLC(Allen Bradley Programmable Logic Controller)以其稳定性和灵活性深受工程师们的青睐。本资料主要探讨的是AB PLC在QTS...
《AOI评估与应用分析》一文深入探讨了自动光学检测仪(AOI)在电子制造业中的重要性及其评估与应用策略。随着电子组件日益微型化,传统的手工检测已无法满足现代工业的质量控制需求,AOI凭借其高稳定性和精准度成为...
在AOI应用中,模拟输入可能涉及相机的曝光时间调整、光源亮度控制,甚至检测到的信号强度,这些都直接影响到图像质量和检测精度。 在AB PLC的编程环境中,如RSLogix 5000,开发者会使用Ladder Logic或其他编程语言...
本方案重点介绍了AOI技术在PCB检测中的应用,并分析了其在不同工艺流程中的优势与不足,以便于合理配置AOI资源,提高AOI效率,避免资源浪费。 首先,AOI系统的核心是通过光学成像技术来检测PCB上元件的贴装质量和...
太阳能AOI(Angle of Incidence)光源测试是光学检测领域中的一个重要环节,特别是在光伏行业中,AOI测试用于确保太阳能电池板...对于想要深入理解太阳能AOI测试以及LabVIEW应用的人员来说,这是一个非常有价值的资源。
在工业自动化领域,AOI(Automatic Optical Inspection)是一种广泛应用的检查技术,用于自动检测产品制造过程中的缺陷。本文将深入探讨如何基于Halcon这一强大的机器视觉库,利用多线程技术设计AOI软件,以提高检测...
基于深度学习与板卡控制的AOI识别算法应用研究.pdf 本文提出了一种基于深度学习与板卡控制的AOI识别算法,旨在提高AOI识别的稳定性和可重复性。该算法首先基于卷积神经网络模型,进行AOI识别问题的分析,并选择合适...
多线程技术在基于HALCON的AOI中的应用.pdf
6. AOI技术的应用:AOI技术广泛应用于PCB制造、组装和测试等领域。该技术可以检测PCB上的缺陷,提高PCB的质量和可靠性。 7. AOI参数设置的重要性:AOI参数设置是AOI检测的关键步骤。该步骤需要根据实际应用的需要,...
本文将重点探讨在PCB生产中树脂塞孔工艺的应用及其通过自动光学检测(AOI)设备进行质量控制的重要性。 PCB制造技术的进步之一是树脂塞孔工艺的应用。这一工艺相较于传统的镀铜塞孔和绿油塞孔,具有多方面的优势。...
而AOI技术的应用可以有效降低人工检测成本,提升检测精度和效率。 PCB制造过程中,主要的硬件组成包括成像系统、台面伺服驱动和计算机逻辑比较系统。成像系统负责采集PCB的图像信息,台面伺服驱动系统确保PCB板能够...
AOI技术在表面贴装质量智能检测中的应用研究 AOI技术在表面贴装质量智能检测中的应用研究
AOI(Automated Optical Inspection,自动光学检测)是一种自动检测技术,广泛应用于电子制造industry,用于检测PCB(Printed Circuit Board,印刷电路板)上的零件缺陷。AOI参数原理说明PPT学习教案是对AOI技术的...