Hummingbird: Hawk-Eye Vision for Surveillance Drones

By Paromik Chakraborty, technical journalist, EFY

0
547
Advertisement

Superior optical systems are mandatory for defence devices like weapons and drones. Optoelectronics for weapons is a complex domain that has not been explored by many. India has been highly-dependent on Russia and other countries for most optoelectronic components.

Hummingbird is a series of advanced image-driven products for aerial platforms
Hummingbird is a series of advanced image-driven products for aerial platforms

Costs are quite high if a nation is dependent on others to take care of its own defence. Looking at this glaring lack of ecosystem in this field in India, Tonbo Imaging India stepped up to deliver.

Advertisement

Ankit Kumar, co-founder and chief technology officer, Tonbo Imaging India, says, “When we were building Tonbo in 2008, most companies were heavily focussed on e-commerce, software or outsourcing services. The idea was to create electro-optic systems for India as well as other emerging markets and, in the process, kickstart an ecosystem around it here. Our founding members have a good understanding of hardware, software and the sciences around any engineering field—mechanical, electrical, electronics, optics and so on—to work together and build these systems.”

One of Tonbo’s most interesting products is the Hummingbird series, which is a family of advanced gyro-stabilised multi-band imaging gimbal systems for unmanned aerial vehicles (UAVs).

How Hummingbird works

In simple terms, Hummingbird is a series of advanced image-driven products. These are cameras installed inside a ball turret package, and can be installed in drones or similar aerial platforms to lock on to a target. Hummingbird maintains line-of-sight on a target when it flies. The imaging system is gyro-stabilised, which means, irrespective of the motion of the aerial platform, it maintains focus on the target till it catches up with it. The system has a layer of advanced technologies, sensors and complex program algorithms. Using these, through real-time video image processing, it can lock on to and track the target automatically.

Tracking and geo-referencing target by Hummingbird on drones
Tracking and geo-referencing target by Hummingbird on drones

Kumar explains, “Closed-loop algorithms run on the gimbal to maintain a lock on the target. Control systems inside the gimbal contain inertial sensors that sense the motion of the platform, and produce counter-motion accordingly to keep the video stable, irrespective of the aerial motion. The system is a complete integration of camera sensors, inertial sensors, motors and image processing capabilities.” The imaging system includes infrared (IR) and thermal imagers that are useful in low-light conditions.

Regarding the tools used for developing the system, Kumar says, “We are using Qualcomm Snapdragon as the platform to create our video-image pipeline. The backend is native to hardware, utilising ARM-based coding.” The products contain about 70 per cent Made in India components. Hummingbird can be used in small or lightweight drones, which can be deployed in urban or border areas to detect intrusion or security breaches without manual intervention.

The challenges faced

Electro-optics require a good knowledge of electronics, mechanical engineering, optics and programming. To get engineers with strong mechanical and electronics design know-how was a challenge for Tonbo, given the high number of software engineering candidates at the time.

Finding people familiar with optics was more challenging. Kumar says, “There are barely any schools or colleges in India that have specialised focus on optics at a fundamental level. We were heavily dependent on freshers and had to train them to the level where they could start contributing technically.”

Hardcore trainings were carried out on-the-job, in the field. “We encouraged freshers to be available on field during interactions with clients,” Kumar adds.

Lack of a strong hardware ecosystem also factored in the development of the products. Evaluating real-time on-field conditions was also not easy.

Kumar recollects, “The initial few years were spent on building a lot of technology to generate the IP. Products started coming out in 2012. The next few years went into taking these to customers and deploying these.”

Tonbo Imaging is venturing out into new domains. Kumar mentions, “We are now supplying thermal imaging for critical installations, like nuclear plants, airports, oil fields in addition to smart cities and medical electronics (for example, for breast cancer detection). We are also talking to Indian automotive manufacturers and Tier-I suppliers to integrate thermal imaging into non-premium Indian vehicles.”

The company also plans to create platforms for devices where their electro-optics can be used. With offices in Bengaluru and Florida (USA) and one set to open in Lithuania, it is starting to mature from being a startup. However, it plans to move ahead with the same zeal, as Kumar believes, “The key advantage of being a startup is being agile and not being slowed down with processes.”


 

Advertisement

SHARE YOUR THOUGHTS & COMMENTS

Please enter your comment!
Please enter your name here