Jul 11, 2023

How to Tell a Good Lidar From a Bad One - Part One

The datasheet looks great, the sales pitch was dazzling and even with the working knowledge from earlier posts about how to determine the actual range, the sensor seems to meet all your requirements on paper.


Or does it? There are a couple of behaviors of Lidar sensors that are not well understood, not even by people who manufacture them. This post will cover one of those.


Divergence


This is not a post about the popular book series set in a post-apocalyptic dystopian society. This is a post about something much more exiting than that: The effects of laser beam divergence on shapes of detected objects. This is a much overlooked phenomenon in the Lidar detection world. Many datasheets don't even mention this value even though it has significant effects and is a major contributor to the maximum tracking and classification range a Lidar based perception system can reach.

 

What is divergence?


"In electromagnetics, especially in optics, beam divergence is an angular measure of the increase in beam diameter or radius with distance from the optical aperture or antenna aperture from which the beam emerges."

 

 Or in normal English: "The further from the laser, the wider the beam."

 

Anyone who has ever held a flashlight has experienced beam divergence. You point a flashlight at a wall and walk towards it and the size of the brightest light spot on the wall gets smaller the closer you get.

LiDAR Divergence Graphic

"Designed by microvector/Freepik"

What many people do not know is that the same applies to laser pointers. In a quick experiment I took a laser pointer about one meter from a wall and then compared it with the same pointer about seven meters from the same wall. Below are the two spot sizes.

LiDAR Laser Pointer Test

Now, for this experiment, I did not have access to a lab-grade laser, but just a cheap laser pointer you can buy off Amazon with some clear lens aberrations shown in the image on the right. The camera has trouble capturing the true spot size because it does not have enough HDR capability.


Hopefully, it still gets the point across that, even with a laser, the difference in spot size can be significant between 1 and just 7 meters. I measured this to be an increase of 30%. Now imagine the spot size at 100 meters and beyond, ranges at which Lidar are attempting to operate in. 


A laser of this quality creates a spot size of 8mm at about 8m distance. This roughly translates to a divergence of 0.5 degrees. Most Lidar claim a divergence of between 0.1 and 0.5 degrees FWHM (Full Width at Half Maximum), though most manufacturers do not list this on their datasheets.

 

I will spare you the details of what 'Full Width at Half Maximum" means and how the Gaussian energy curve affects things exactly. Just know that advanced Lidar simulations have predicted the effects I am about to describe below and practical experiments have backed up the predictions that the simulator made. 

 

What effect does spot size have in the Lidar world?

 

In short: a lot. It can skew things, smudge things, create bloom effects and make objects appear larger than they really are.

 

Let's start with a basic setup to explain the effect of divergence.

 

Here we have a Lidar emitted light pulse travelling towards a wall. In this first instance, the wall is perfectly perpendicular to the direction of the beam. 

Underneath the pulse is a graph of the return energy detected by the sensor. For simplicity, I will be ignoring the delay of the signal to travel all the way back to the sensor as it has no impact on this specific case.

LiDAR Pulse Test Diagram

Now watch as the light pulse travels and hits the wall. Notice how the return signal changes:

In the above example there is a clear and sharp peak in the signal. With some form of peak-detection algorithm, the sensor will calculate the 'center' of the peak and that is the range that the Lidar sensor will use and send to the perception system. In the above example, the calculated range lines up very well with the actual range. In fact, increased spot size would have no effect on the calculated range.


Now we angle the wall:

Because of the angle, the return peak becomes wider. Still, the peak detection algorithm is able to determine the center of the peak and, as you can see, it lines up nicely with the center of the spot size. 


Let's look at a corner of a wall and see how it behaves:

Hold on, the range the sensor calculated does not match up with the corner of the wall, instead it seems to 'hover' in front of it! This is exactly what divergence does: it smooths out corners and smudges objects. 


Without showing the animation, imagine what the effect would be if the corner is flipped and the walls angle away from the sensor.


If you guessed that the detected range would be beyond the actual corner, you would be correct. Divergence works with corners in both directions.


Now also imaging making the spot size wider and try to predict the range as it relates to the spot size. 


If you guessed that the range moves away from the corner as the spot size gets bigger, you would be correct.


To show that this is not just theoretical, here is a comparison of two actual Lidar units. This is a top down view of a room with two different Lidar units in an identical location covering the corner of my office.

LiDAR High Beam Divergence Test

The top image creates a distinctive curve at the corner of a wall. The bottom Lidar has a much tighter curve, but what is more important is that the bottom Lidar is able to detect the little bump to the left of the corner (in the blue circle). That is actually the door frame. The top Lidar cannot detect it at all because it is too smudged to be able to tell.


What is most interesting about this? The top Lidar is more expensive and has much higher resolution than the bottom Lidar. On paper the top Lidar beats the bottom one in every listed category, but in practice, the bottom Lidar significantly outperforms the top Lidar in perception and the ability to make actual decisions based on the data.


The full (exaggerated) effect on a square object will look something like this. The below diagram shows a very standard Lidar setup. The purple dots are the resulting point cloud. 


Note: The dotted lines indicate the total vertical field of view, not the divergence per beam.

LiDAR low and high beam divergence diagram

Not only is the bottom object smudged, it also appears larger and may blend in with objects around it. I will explain this phenomenon in a separate post as this one is getting pretty long already.


The below image shows the relationship between resolution and divergence:

LiDAR Resolution and divergence Diagram

The bottom image has twice the resolution (purple dots). Does it have an advantage over the top image? What if we double the resolution again (blue dots), does it add any actual useful information?


No, it does not. Imagine the above situation but with a camera. You have an 8K camera, but the pixels bleed into each other. What's the point of having 8K? You're just wasting bandwidth.


This hopefully illustrates why more resolution is not always better. More resolution is only better if the rest of the sensor specs can back it up. If the horizontal angular resolution of a Lidar is 0.10 degrees and the divergence is 0.2 degrees, then what's the point? 


I have always told all my customers: "I'd rather have 16 good beams than 100 bad ones."


So, when selecting a sensor, see the whole picture. Look past the datasheet and at the actual quality of the unit. The above scenarios are very basic tests that anyone can perform while you are evaluating sensors. 


In a future article I will cover additional things to consider like temperature, vibration, reliability, lifecycle, blooming, 'streaming points'.

Naval Research Laboratory
18 Jan, 2024
Bowler Pons, a leading provider of cutting-edge technology solutions, is thrilled to announce that it has been awarded a multi-year $3,835,726 Firm Fixed Price (FFP) contract by the Naval Research Laboratory (NRL) to continue delivering highly skilled Information Technology (IT) design, development, and support services to the NRL’s Optical Sciences Division (OSD). NRL OSD plays a critical role in advancing the state-of-the-art and exploring the realm of the possible in optical technologies. By partnering with Bowler Pons, the NRL will benefit from our expertise in developing and supporting the IT infrastructure and environment critical to enable these advancements to take place. Our team of seasoned professionals is committed to ensuring seamless operations, robust security, and optimal performance across the NRL’s IT landscape. “Building upon the past five years supporting NRL OSD, we are honored to have been selected as the sole provider for this vital contract scope to the lab,” said Nate Cimo Co-Owner of Bowler Pons. “Our team is excited to collaborate with the NRL and continue contributing to the success of their mission.” For more information about Bowler Pons and our capabilities, please visit our website or email Nate Cimo at nate@bowlerpons.com About Bowler Pons Solutions Consultants, LLC Bowler Pons is a Minority-Owned, Service-Disabled, Veteran-Owned Small Business (SDVOSB), and SBA 8(a) Certified consultancy with expertise spanning Engineering, Research & Development, Cybersecurity, Information Technology, and Program & Project Management. With a foundation built upon comprehensive security acumen, from information and network security to physical security technology design, development, integration, and support, Bowler Pons offers core services focused on delivering client-specific solutions that are aimed at fostering progress in the modern world of technological challenges. Headquartered in Annapolis, Maryland, and spread throughout the U.S. in strategic DoD and Navy concentration areas, Bowler Pons is rapidly growing in the Federal and DoD markets. More information about Bowler Pons can be found at www.bowlerpons.com.
AFWERX Challenge Logo Graphic
09 Jan, 2024
Las Vegas, NV — January 18th, 2024 Bowler Pons , the innovative techno logy solutions company, has been handpicked to participate in the prestigious AFWERX Expedient Basing Open Innovation Challenge Showcase , set to take place in Las Vegas on January 18th, 2024 . This exclusive event brings together government agencies and industry leading innovators to explore groundbreaking ideas that will shape the future of technology for the military. Out of an impressive pool of 759 proposals , only 120 candidates were chosen to showcase their forward-leaning concepts and industry-best technologies to AFWERX and USAF attendees. Bowler Pons stands proudly among this elite group, a testament to our unwavering commitment to excellence and innovation. Mark Holmes, Co-owner of Bowler Pons stated, “Our committed team of experts at Bowler Pons has relentlessly pursued the development of innovative, cutting-edge solutions that push the limits of technological advancement for our military clients. Led by our Head of Innovation, Jerone Floor, Bowler Pons continues to explore the realm of the possible with both emerging and unexplored technologies to solve tomorrow’s challenges. With a focus on advanced AI algorithms, computer vision, automation, and client-specific applications, we are leading the charge in transformative technology development.” For further information, please contact: Jerone Floor , jerone.floor@bowlerpons.com About Bowler Pons Solutions Consultants, LLC Bowler Pons is a Minority-Owned, Service-Disabled, Veteran-Owned Small Business (SDVOSB), and SBA 8(a) Certified consultancy with expertise spanning Engineering, Research & Development, Cybersecurity, Information Technology, and Program & Project Management. With a foundation built upon comprehensive security acumen, from information and network security to physical security technology design, development, integration, and support, Bowler Pons offers core services focused on delivering client-specific solutions that are aimed at fostering progress in the modern world of technological challenges. Headquartered in Annapolis, Maryland, and spread throughout the U.S. in strategic DoD and Navy concentration areas, Bowler Pons is rapidly growing in the Federal and DoD markets. More information about Bowler Pons can be found at www.bowlerpons.com .
Bowler Pons  Solutions Consultants and FloorOne Solutions Logos
By Mark Holmes 25 Apr, 2023
Bowler Pons Solutions Consultants, LLC (“Bowler Pons”), a leader in open and honest innovative security consulting and solutions exploration, development, and fielding, has announced the acquisition of Floor One Solutions (“FloorOne”), a trusted technology consultancy specializing in custom sensing and integrated solutions for very specialized customers. This strategic partnership will enable Bowler Pons to expand its offerings and accelerate the deployment of authentic, right-sized, and dependable security and safety solutions for both existing and future customers in the Defense, Federal, State/Local, and Commercial markets while providing FloorOne customers access to new and diverse technical skillsets to also build, implement, and support fielded solutions. With a strong track record of professional success and global clients, FloorOne brings a wealth of expertise in the field of light detection and ranging (LiDAR), perception software, and advanced technology integration, helping businesses and organizations implement cutting-edge solutions that improve their efficiency, safety, security, and overall success. By joining forces with Bowler Pons, FloorOne’s subject matter expertise will be leveraged to develop innovative and deployable security solutions that cater to the unique needs of a diverse clientele focused on the very best advanced sensing capabilities and knowledgeable design and implementation support. Additionally, Bowler Pons’ depth and breadth of technology professionals will provide existing FloorOne customers a new dimension and reach-back of project and engagement value across the entire system life cycle. “The acquisition of Floor One Solutions demonstrates our dedication to staying at the leading edge of technological advancements in the security and perception industry and keeping the customer’s needs at the forefront,” said Mark Holmes, Co-Owner of Bowler Pons. “We are thrilled to have the talent from Floor One Solutions join us and look forward to leveraging our collective expertise to deliver unparalleled security and safety solutions for our existing and prospective customers.” With the acquisition, Bowler Pons appoints FloorOne founder, Jerone Floor, as the Head of Innovation, leading the overall advancement, transition, and widespread application of its technology solutions and advanced technology consulting expertise. Jerone’s experience includes more than 23 years of software and product design, development, solutions architecture, product management, and tailored customer delivery and support. Jerone holds a Bachelor’s Degree in Technical Computer Science, holds a US Patent, has received an Emmy for his computer vision work at NASCAR, and most recently led the Lidar-based technical architecture, integration, planning, and development efforts for an intelligent infrastructure environment and automation project using Vehicle-to-Infrastructure (V2I) technology for the BMW manufacturing plant in Munich, Germany. His wealth of experience and diversity of applied solutions development brings a new level of perspective and insight to Bowler Pons. "Jerone’s highly-technical background in software and product design, development, technology transition, fielding, and customer support, combined with his seasoned and successful track record in innovative and strategic technology application exploration and execution are ideal for where we are as a company," highlighted Mark Holmes. “We've evolved our traditional technology and management consulting service offerings into a portfolio of subject matter expertise and targeted security solutions for real customer needs. Jerone will help maintain the continuous stream of innovation initiatives, both internally funded as well as customer-sponsored, but more importantly, he will be responsible for exploring new adaptations, markets, customers, and challenges for which our expertise and solutions apply.” “Floor One Solutions was founded with the goal of becoming the premier independent and honest LiDAR technology consultancy company, and I felt an obligation to remain this way in considering this opportunity. In conversations with Mark, it quickly became clear that Bowler Pons not only shares those values, but they are also already embedded deep in the culture of the company,” reflected Floor. “With this acquisition, FloorOne customers will not only enjoy the same level of independent advice and support as before, but will also gain access to a whole new team of subject matter experts in cybersecurity, artificial intelligence, autonomous system design, digital solutions architecture, disciplined programmatic oversight, and a team of highly-skilled engineers, capable of turning ideas and concepts into working and sustainable products.” The combined resources and skills of both companies will allow Bowler Pons and FloorOne to continue their shared mission of providing honest, right-sized, deployable, carefully-integrated, and dependable security and safety solutions while expanding collective offerings to other markets. Stay tuned for big developments by following Jerone and the Bowler Pons team through our LinkedIn, Instagram, Facebook, and website, www.bowlerpons.com . About Floor One Solutions: Floor One Solutions is a recognized industry expert in LiDAR, advanced perception hardware and software, and a premier provider of custom technology solutions, specializing in the integration of advanced security, automation, and sensing systems to optimize organizations’ efficiency, security, safety, and success. With a foundation built upon honesty and realistic technology consulting, Floor One Solutions has consistently delivered exceptional and highly-coveted results for clients across various markets and industries. www.flooronesolutions.com
Show More
Share by: