• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Electrical Engineering News and Products

Electronics Engineering Resources, Articles, Forums, Tear Down Videos and Technical Electronics How-To's

  • Products / Components
    • Analog ICs
    • Battery Power
    • Connectors
    • Microcontrollers
    • Power Electronics
    • Sensors
    • Test and Measurement
    • Wire / Cable
  • Applications
    • 5G
    • Automotive/Transportation
    • EV Engineering
    • Industrial
    • IoT
    • Medical
    • Telecommunications
    • Wearables
    • Wireless
  • Learn
    • eBooks / Handbooks
    • EE Training Days
    • Tutorials
    • Learning Center
    • Tech Toolboxes
    • Webinars & Digital Events
  • Resources
    • White Papers
    • Educational Assets
    • Design Guide Library
    • Digital Issues
    • Engineering Diversity & Inclusion
    • LEAP Awards
    • Podcasts
    • DesignFast
  • Videos
    • EE Videos and Interviews
    • Teardown Videos
  • EE Forums
    • EDABoard.com
    • Electro-Tech-Online.com
  • Bill’s Blogs
  • Advertise
  • Subscribe

If you are working with video signal processing here are some tools to consider, Part 1

September 1, 2023 By Jeff Shepard

Computer and machine vision based on video signal processing and analysis is a critical function in systems like autonomous vehicles, medical imaging diagnostic equipment, facial recognition and eye tracking applications, smart cities, supply chain management, and robotics. It requires rapid and accurate object and feature recognition and extraction. Implementation of computer vision is complex and can benefit from using artificial intelligence (AI), machine learning (ML), convolutional neural network (CNN) inferencing engines, and other advanced computing techniques.

Designers of computer vision systems need tools that assist in merging high-performance hardware and software. Sources where designers can get the needed electronic design automation (EDA) tools include component suppliers, general and specialist EDA tool makers, and even focused industry organizations that offer open-source EDA solutions. This first of two FAQs is focused on tools available from component suppliers and EDA tool makers. Part two explores the EDA tool options from industry organizations.

Component suppliers
Video processing is a hardware-intensive activity and component suppliers like Nvidia and Intel offer EDA tools including software development kits (SDKs) to assist designers in using their silicon. Nvidia, for example, offers a collection of tools for developing accelerated video processing using its graphics processing units (GPUs). Some of the available tools include:

  • RTX Broadcast Engine SDKs that use AI to transform live streams.
  • Optical Flow SDK is dedicated to computing the relative motion of pixels between images.
  • GPUDirect for Video helps IO board designers develop drivers for transferring video frames in and out of Nvidia GPU memory.
  • Capture SDK for capture and video compression.
  • VRWorks 360 Video SDK enables developers to capture, stitch, and stream 360-degree videos.

Intel also offers an extensive suite of intellectual property (IP) tools for video, image, and vision processing using their field programmable gate arrays (FPGAs). Intel’s Video and Image Processing Suite of IPs includes cores that range from simple building block functions, such as clocked video and color space conversion to complex functions that can implement programmable polyphase scaling, arbitrary non-linear distortion correction, 3D look-up tables, adaptive tone mapping, and so on (Figure 1).

Figure 1. Representative IPs available in the Intel video and vision processing suite (Image: Intel).

These IPs use Intel FPGA streaming video data interfaces for video I/O, based on the standard AXI4-Stream protocol. Designers can mix and match the Intel video IPs with their own proprietary IPs for unique applications. In addition, custom image processing signal chains can be developed using Intel’s Platform Designer SKD to automatically integrate embedded processors and peripherals and generate arbitration logic.

Toolmakers
Designers can also select from focused video processing EDA tools as well as offerings from broad-line EDA tool makers. For example, MVTech has a range of tools for implementing machine vision in agriculture, robotics, logistics, printing, manufacturing, and other applications. HALCON is MVTech’s comprehensive SDK for machine vision and has an integrated development environment (IDE). Among the tools provided are:

  • Deep Counting can be used to count many objects quickly and accurately as well as to detect their position.
  • Deep OCR reads texts reliably, regardless of their orientation and font. It can identify text with arbitrary printing type or unseen character types as well as support improved readability in noisy and low-contrast environments.
  • 3D Gripping Point Detection can be used to detect surfaces suitable for gripping on any object.

General tool makers like MathWorks also offer algorithms and EDA tools that can support a variety of hardware environments for processing, analyzing, and presenting video information. The MatLab Computer Vision Toolbox supports the design and testing of computer vision, three-dimension (3D) vision, and video processing applications.

Designers can use deep learning (DL) and machine learning (ML) algorithms like you only look once (YOLO), single shot detector (SSD), and advanced custom fields (ACF) to develop custom object detection functions. DL algorithms like U-Net and Mask recursive convolutional neural networks (R-CNNs) are available for semantic and instance segmentations. Segmentation and detection algorithms are also available to analyze images that are too large to fit into the available memory. In addition, pre-trained models are available for detecting common objects, pedestrians, and faces.

The algorithms can be used on GPUs or multicore processors for faster performance. The Toolbox supports C/C++ code generation to speed integration with existing code libraries in embedded systems. Designers can automate calibration workflows for single, stereo, and fisheye cameras. Visual and point cloud simultaneous localization and mapping (SLAM) are supported as well as stereo vision and structure from motion analysis. Algorithms are available for object detection and tracking and feature detection, extraction, and matching (Figure 2).

Figure 2. Machine vision algorithms are available for feature detection and extraction (Image: MathWorks).

Summary
Machine and computer vision is important in a wide range of industrial, transportation, medical, and consumer applications. Designing vision systems is complex and requires a mix of high-performance hardware and sophisticated software. Fortunately, there’s a variety of EDA tools available from component suppliers, dedicated EDA tool makers, and even focused industry organizations. Tools from focused industry organizations will be the topic in part 2 of this series.

References
Computer vision toolbox, MathWorks
Machine vision software, MVTech
Video and Image Processing Suite, Intel
Video Processing Technologies, Nvidia

You Might Also Like

Filed Under: Analog IC Tips, FAQ, Featured Tagged With: FAQ

Primary Sidebar

EE Engineering Training Days

engineering

Featured Contributions

Integrating MEMS technology into next-gen vehicle safety features

Five challenges for developing next-generation ADAS and autonomous vehicles

Robust design for Variable Frequency Drives and starters

Meeting demand for hidden wearables via Schottky rectifiers

GaN reliability milestones break through the silicon ceiling

More Featured Contributions

EE Tech Toolbox

“ee
Tech Toolbox: 5G Technology
This Tech Toolbox covers the basics of 5G technology plus a story about how engineers designed and built a prototype DSL router mostly from old cellphone parts. Download this first 5G/wired/wireless communications Tech Toolbox to learn more!

EE Learning Center

EE Learning Center
“ee
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for EE professionals.
“bills
contribute

R&D World Podcasts

R&D 100 Episode 10
See More >

Sponsored Content

Designing for Serviceability: The Role of Interconnects in HVAC Maintenance

From Control Boards to Comfort: How Signal Integrity Drives HVAC Innovation

Built to Withstand: Sealing and Thermal Protection in HVAC Sub-Systems

Revolutionizing Manufacturing with Smart Factories

Smarter HVAC Starts at the Sub-System Level

Empowering aerospace E/E design and innovation through Siemens Xcelerator and Capital in the Cloud

More Sponsored Content >>

RSS Current EDABoard.com discussions

  • Industrial Relay Board Design for Motorcycle Use
  • Safe Current and Power Density Limits in PCB Copper(in A/m² and W/m³) simulation
  • The Analog Gods Hate Me
  • Egs002
  • Help with hall effect sensors for a milwuakee impact driver

RSS Current Electro-Tech-Online.com Discussions

  • Raise your hand if your car had one of these:
  • Simple LED Analog Clock Idea
  • Kawai KDP 80 Electronic Piano Dead
  • Tektronix 2235 channel 1 trace unstable
  • How to make string LEDs?
Search Millions of Parts from Thousands of Suppliers.

Search Now!
design fast globle

Footer

EE World Online

EE WORLD ONLINE NETWORK

  • 5G Technology World
  • Analog IC Tips
  • Battery Power Tips
  • Connector Tips
  • DesignFast
  • EDABoard Forums
  • Electro-Tech-Online Forums
  • Engineer's Garage
  • EV Engineering
  • Microcontroller Tips
  • Power Electronic Tips
  • Sensor Tips
  • Test and Measurement Tips

EE WORLD ONLINE

  • Subscribe to our newsletter
  • Teardown Videos
  • Advertise with us
  • Contact us
  • About Us

Copyright © 2025 · WTWH Media LLC and its licensors. All rights reserved.
The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media.

Privacy Policy