Revolutionary AI Drone Software by Volunteer Heroes Transforms Search and Rescue Operations

To go back to this article, head to My Profile and then click on View saved stories.

An Innovative AI Drone Program Locates Individuals Beyond the Reach of Search and Rescue Operations

When Charlie Kelly sent a message indicating his inability to return home that evening, his significant other was displeased. It was the 6th of September, 2023, a Wednesday, and the 56-year-old, who had a passion for hiking, had departed from the home he shared with Emer Kennedy in Tillicoultry, close to the Scottish city of Stirling, before she headed to work. He intended to scale Creise, a mountain standing at 1,100 meters tall, which offers views of Glen Etive, a secluded valley in the Highlands renowned for its appearance in the James Bond movie Skyfall.

The climate was surprisingly gentle for the time of year, leading Kelly to consider the possibility of conquering a second Munro, the term for Scotland's mountains that tower over 3,000 feet. Outside of his professional duties as a forensic psychologist with the Scottish Prisons Service, he had been methodically climbing these mountains. Kennedy recalls, “He kept a book where he would note each one he climbed.” However, with a vacation planned in just over two weeks, this climb was to be his final Munro attempt before the onset of winter.

Kennedy wasn't originally fond of hiking. Their connection began four and a half years ago, rooted in a mutual passion for the Celtic Football Club and their unique sense of humor. Kennedy was captivated by Kelly's intellect, especially his vast understanding of football, Robert the Bruce, and Doctor Who. She was charmed by his humor, despite his jokes being somewhat lackluster, and he valued her support in his interests, even those she didn't share. "One of the last things he told me before that night was, 'You allow me to be myself,'" she recalls.

When Kennedy received the message from Kelly indicating he wouldn't be able to descend the hill before dark, she felt anxious yet confident in his abilities. "Charlie was incredibly adept at handling challenging situations," she remarked. "In his professional life, he was skilled in negotiation, dealing with situations like hostage crises or inmates on rooftops, and he was usually cautious." Kelly calmed her concerns by confirming he had no immediate need for rescue. He was well-prepared with additional provisions, sufficient water, and ample warm clothing. His plan was to stay put until daylight and then make his way down.

During her workday on Thursday, Kennedy frequently glanced at her mobile during breaks. Before the break of day, Kelly had already checked in and continued to send upbeat texts whenever he could find signal. Close to 8 pm, as dusk approached, he messaged to inform her that his phone battery was dying, but assured her not to worry: He could see the lights of the Glencoe Ski Center where he had left his car. He mentioned there was ample daylight remaining for him to get there, estimating his arrival in about 30 minutes. Unfortunately, that message was the final communication from Charlie Kelly while he was still alive.

In the aftermath of Kelly's disappearance, the Glencoe Mountain Rescue team initiated an extensive search operation, which they later referred to as "Herculean" in scale. This operation included the use of scent detection dogs, all-terrain vehicles, several helicopters, and drones outfitted with both infrared and standard cameras. The effort saw collaboration among experts from the Coastguard, Police Scotland, and the Royal Air Force, alongside a cadre of about 50 highly skilled volunteers from 10 distinct Mountain Rescue (MR) teams actively participating at times. On Saturday, September 9, their efforts led to the discovery of his backpack. However, beyond that, no further evidence was uncovered.

The moment of innovation arrived after a wait of over six weeks. Dan Roach and David Binks, part of a mountain rescue team in the Lake District, located in the north of England, had kept up with the continuous search efforts through the internet. During their leisure hours, they had dedicated themselves to creating innovative software aimed at enhancing drone capabilities for locating lost individuals. After dedicating two years to the project and tackling what Binks described as “some horrendous mathematics,” they finally had a prototype they felt was ready for use.

Binks mentions, "I was aware of the ongoing search and it crossed my mind that this could be an ideal opportunity to put the system to the test. Coincidentally, Dan called me while I was returning from vacation, sharing the same thought." They reached out to Glencoe Mountain Rescue, offering their assistance. Binks reflects, "They seemed skeptical about our involvement making a difference. However, they had exhausted all other options and welcomed our attempt."

On the 24th of October, Binks, Roach, along with Dan Parsons, a comrade from Roach's mountain rescue team who had assisted in initial trials, journeyed to Glencoe. There, they joined forces with the local mountain rescue group, deployed a pair of drones, and located the remains of Charlie Kelly within the initial sixty minutes.

Volunteer teams specialized in mountain rescues frequently respond to emergencies involving lost trekkers, and drones have emerged as a critical component in search and rescue operations.

In the UK, Mountain Rescue is commonly known as the nation's unofficial fourth emergency service. However, in contrast to the police, fire department, or medical emergency services, it relies solely on volunteer staff. The nation's mountainous regions are served by a variety of groups consisting of community members from diverse backgrounds. Every group functions as an independent charity, taking charge of its own fundraising, training, and equipment procurement.

Mike Park, the chosen leader of MR England & Wales, a key organization facilitating better collaboration among teams, acknowledges the benefits of its decentralized approach. However, he also points out a downside: a tendency towards a somewhat self-centered and superior mindset. Park, who has previously led the Cockermouth MR team in the Lake District and volunteered for nearly 42 years, notes that the predominantly male membership of MR can sometimes become overly protective of their knowledge areas, hindering the adoption of new ideas. He criticizes an entrenched culture that undervalues fresh perspectives, suggesting that one must have decades of experience before their opinions are taken seriously.

In the early 2010s, when consumer-grade camera drones first hit the market, it was immediately apparent how they could revolutionize search and rescue operations by enabling teams to survey large expanses at a much lower cost compared to helicopters. However, Roach, who had previously utilized drones for his photography projects, had his reservations. An avid mountaineer, sporting long, curly locks and a mustache reminiscent of Pedro Pascal, he became a member of the Cockermouth Mountain Rescue team ten years ago and, at 34, is among its younger volunteers. “Initially, everyone was excited, thinking, ‘Great, now we can see everything.’ But then it dawned on them that to actually spot what you're looking for, you need to be quite close, and you're limited to viewing it on a tiny screen on the controller.”

Looking for a small object in a large area isn't made easier by simply having a higher point of view. Roach suggested leveraging drones' capability to follow preset routes to make the search more automated. However, convincing the established members of MR of his approach was challenging. Mike Park recalls a moment at a conference at Leeds University where Dan's appearance – his long hair and skateboard in tow – led to confusion, with someone mistaking him for a student who had arrived a week too soon.

Undeterred by the lack of responsiveness from others, Roach continued his efforts with assistance from his colleague and fellow helper, Dan Parsons. Sharing the same age bracket, Parsons, aged 33, came from a forestry background and had experience using drones for mapping tasks. Together, they experimented with readily available flight and photography software. They also discovered software capable of identifying specific color pixels, such as the red in a hiker's jacket. "Ultimately, we developed this highly advanced, somewhat makeshift setup," Roach recalled. "It functioned, but it was far from elegant. You had to juggle three separate software applications to conduct a search." The project didn't fully take off until Roach encountered David Binks, a retired software engineer who volunteers with the Duddon & Furness Mountain Rescue, located roughly 30 miles south of Cockermouth. Roach shared his experiences with automating drone searches during a gathering of Lake District drone operators and caught Binks's interest afterward. "He approached me saying, 'I never considered it from that angle. Let's discuss this further.'"

This duo is quite the mismatch. Roach, brimming with creative energy, contrasts sharply with Binks, who is much more reserved and possesses a mind geared towards engineering solutions. Binks, at the age of 57, is significantly older by over two decades. However, his valuable experience in not only programming but also in developing software that gained widespread usage within MR sets him apart. He had developed a software named MR Maps back in 2007, which revolutionized team coordination by allowing for the real-time tracking of team members through signals from their radios. This innovation was particularly impactful at a time when the use of GPS in phones or handheld devices wasn't common. After discussions that took place towards the end of 2021 and the beginning of 2022, Binks concluded that integrating Roach’s concept with MR Maps would be the most effective strategy.

With the help of advanced image-analysis technology, it's now simpler to detect humans hidden within thick bushes or rugged terrain.

Binks explains, "Given my experience with simulation software for wind farms and offshore oil platforms, I was confident about the mathematical aspects. I was aware of the feasibility. However, there were countless days when I began working at 9 am only to find myself still engrossed in the task at 3 am the next day." The software, which was developed from the ground up and coded in C++, displays what Roach refers to as a "Windows 95 aesthetic," suggesting a nod to its DIY roots. Despite its simple appearance, the software boasts a surprisingly advanced level of complexity.

Binks outlined a tripartite challenge they faced. The first aspect involves maneuvering the drone to capture ground images optimally. Ensuring the camera is directly overhead is crucial, as is capturing each segment of terrain in several shots to prevent obstruction by any angular structures like walls or rocks. "We ensure a 55 percent coverage overlap, meaning on average, an object appears in nine different photos," he stated. The drones follow a flight path that is automatically generated, allowing the pilot to select the altitude, based on the detailed 2×2 meter lidar data that forms the backbone of the UK's Ordnance Survey (OS) maps. These are the nation's official maps, which OS provides to MR at no cost. Additionally, the system advises the pilot on the optimal positioning to maintain visual contact with the drone, a legal necessity in the UK.

Binks elaborates that the software's second feature involves determining the exact grid location of a specific pixel in an image. "This is achieved by employing rotational vectors to ascertain their intersection point with the surface," he specifies. Additionally, Binks mentions, "The software's third capability is to scrutinize the images to identify noteworthy elements."

Roach and Parsons' initial rudimentary model required users to specify the colors they wished to find, yet Binks introduced a pivotal improvement by reversing this approach. "Instead, I programmed it to tally the pixels of a specific color and then emphasize groups of colors that deviate from the norm," he elaborates. Binks points out that the crimson hue of a trekker's coat would be noticeable against a verdant landscape, "however, in a scene dominated by stones, green would emerge as the standout color."

The system is crafted to function completely without an internet connection, making it ideal for use in isolated areas. As a result, images must be manually retrieved from the drone following each mission, yet the analysis can still be performed on-site. During this process, the system identifies groups of pixels with unusual colors for further examination by a person, even as the drone continues its search in new areas. "We encounter quite a few false alarms, but it's relatively quick for someone to sift through these," Binks notes. "Most of the time, it turns out to be oddly colored moss, stones, or occasionally a sheep," adds Roach. "However, every once in a while, we find a person."

Operators can map specific regions for drone surveillance and establish automated routes for exploration.

The rugged, rock-filled wilderness area surrounding the Glencoe Ski Center served as an almost ideal testing environment for the new features of MR Maps. Situated between the ski lift summits and the narrow road winding down to a cul-de-sac in Glen Etive, the landscape is predominantly composed of stones, brownish clusters of grass, and occasional wildlife like deer. "The terrain here is rather complicated," says Brian Brathurst, a deputy team leader for Glencoe MR, his accent and subtle expression revealing his Zimbabwean background. "There are numerous fields of boulders, plenty of ravine systems, and it's possible to miss seeing someone by just five to ten meters."

As the search entered its fourteenth day, hope of locating Kelly alive decreased, leading to a natural reduction in the search efforts' vigor. "Unfortunately, individuals have their own daily responsibilities," Brathurst notes. "However, in our community, we're known for not abandoning efforts easily. We devoted every moment of spare time we had to the search. Throughout those six weeks, there was always someone actively searching—individuals would wrap up their workday and then venture into previously unexplored regions. The search efforts persistently continued."

Upon their arrival, Binks, Roach, and Parsons were thoroughly prepared. Binks acknowledged, "Without Glencoe's prior efforts, our achievements would have been impossible." The team split the search zones among themselves, with the two Dans controlling one drone and Binks managing another, each setting off from separate locations. Even with their extensive software preparations, there was a palpable tension. Parsons recalled, "We had practiced locating our jackets in open fields, but we had never actually discovered something that wasn't intentionally placed by us."

David embarked on his initial search operation over "Area A" with his drone. However, roughly 10 minutes in, he noticed the drone was beginning to vanish from view. Frustrated by this early setback, he summoned the drone back, mentally noting to adjust the software later. "I decided then to switch to Area B," he thought, "but in the meantime, I'll review the images captured from Area A." As he sifted through the marked images, he was taken aback. "There were two pictures showing Mr. Kelly," Binks recalled. "It left me in disbelief."

Dan Parsons, David Binks, and Dan Roach are the innovators behind the drones equipped with MR Maps technology.

Upon arriving at the location, the rescue crew from Glencoe discovered that Kelly had plummeted several meters, resulting in deadly injuries to his head and chest. Brathurst mentioned that it's impossible to determine the exact time of his death. However, Binks noted that on the night of September 7, there were combine harvesters operating further up the valley. Given Kelly's final message, it's believed he might have headed directly towards those lights, mistaking them for the Ski Center, and met with an accident during his journey. The precise circumstances, however, will remain uncertain.

It was evident that Kelly was far from where he believed he was. Even though the search teams had thoroughly combed the area where he was ultimately found, Kelly had tumbled into a ravine, making it difficult for search parties on the ground to spot him. Additionally, the subdued hues of his attire rendered him nearly invisible from aerial perspectives. "He had on a somewhat light brown shirt and navy pants," Binks detailed. "To the naked eye, that's extremely difficult to distinguish. However, to a computer, it contrasts sharply with the environment, making it highly noticeable."

Brathurst was among the volunteers who combed the area by foot. "We must have come within about 20 or 30 meters close to him," he recalls. Despite this, they hadn't spotted anything.

The wilderness poses risks even for those who are seasoned in hiking.

Discovering Charlie Kelly in the initial location they explored was as much about fortune as it was a testament to the impressive capabilities of MR Maps. Since then, the technology has demonstrated its value in numerous search operations, primarily through its ability to rule out certain zones. “Dan often brags that our success rate is flawless,” Parsons remarks. “Even though we’ve only located one individual so far, there hasn’t been an instance where we’ve flown over a region with someone there and failed to detect them.”

Up until now, the software's primary application has been in the Lake District. However, under Mike Park's guidance, Roach, Parsons, and Binks have also been supporting teams nationwide upon request. When the well-known British television personality Dr. Michael Mosley disappeared on the Greek island of Symi, Park even discussed with Greek officials the possibility of the team traveling there to assist. "The area seemed ideally suited for our technology, given its rocky landscape which our system is capable of navigating," Binks observed. Although Mosley was located before their intervention was needed, it's clear that their software could significantly shorten the distressing wait for families like Mosley's, and alleviate the efforts of search and rescue teams on the scene.

In the United Kingdom, Mountain Rescue (MR) is under growing strain. Ian Bunting, the operations director of MR England & Wales, notes, "There's been a steady increase in the number of emergencies we're called to over the years, but there was a significant jump following the outbreak of Covid." He explains that when group sports were prohibited, many turned to outdoor pursuits like hiking for recreation, and with overseas trips not an option, there was a noticeable uptick in the number of people visiting national parks. Bunting adds, "Then there's the impact of social media," which has played a role in highlighting specific locations to the public.

In the Lake District, the team from Cockermouth, led by Dan Roach and Parsons, responded to an unprecedented number of emergencies last year. Meanwhile, in North Wales, the mountain rescue team based in Llanberis, responsible for the region's tallest mountain, Yr Wyddfa, has openly expressed concerns about the potential for "burnout" among their members. This comes after the team was called to over 300 incidents in 2023, a significant increase from the 100 incidents in 2008. Bunting, who has dedicated 30 years as a volunteer with the Edale Mountain Rescue in the Peak District, acknowledges the heavy toll these duties can take. He notes, “Some of my colleagues have managed more than 100 callouts individually.” He adds, “Considering the time spent on training, checking equipment, and other related tasks, I logged 600 hours last year alone.”

Bunting recognizes that individuals choose to volunteer, highlighting the freedom they have to decline tasks. Yet, he also points out that those who are drawn to volunteering often are the ones less likely to refuse. In this context, any device or method that minimizes the time dedicated to searching is highly valued in the Mountain Rescue (MR) community, he mentions. The software developed by Binks and Roach isn't always necessary for most rescue missions where the missing person's whereabouts are already known. However, it could significantly reduce the duration of intensive "formal searches," which, based on statistics provided to WIRED by MR England & Wales, account for about 10 to 15 percent of yearly operations, thus representing a significant advancement.

Worldwide, the search and rescue drone market is valued at approximately $4 billion, as estimated by the market research company Lucintel. However, despite the potential wide-ranging applications of their product in mountain areas across the globe, Binks and Roach have no intention of turning it into a commercial venture. In the United Kingdom, Binks has consistently offered MR Maps at no cost to those involved in search and rescue operations, including the police, with several departments beginning to test the drone enhancement. Binks expresses satisfaction with the application of the technology, stating, "It’s going to be used for search, so I’m quite happy with that."

He expresses a lack of interest in making money from the project. His drive is straightforward – he relishes the challenge of finding solutions. Ultimately, he notes, the sole investment required was the time spent by him, Roach, and Parsons. This is a contribution they, along with countless other MR volunteers throughout the UK, willingly offer to assist those in distress.

David Binks' MR Maps application initially enabled members of the rescue team to monitor signals transmitted from their radios.

In late October 2023, Emer Kennedy found two uniformed police officers at her doorstep. They tersely stated, “You know why we’re here,” she recalls. Despite her fervent wishes for a different resolution, her predominant fear over the past six weeks had been whether he would be found before the onset of winter. If not, she wondered, would he ever be discovered?

Individuals journeyed from distant locations to attend Charlie Kelly's memorial service. Colleagues from various parts of the nation and college companions from all over the globe were present. The Pogues' music accompanied his casket's procession, and donations were gathered for a philanthropic cause, with the funds being directed to the Glencoe Mountain Rescue team.

Kennedy expresses admiration for their professionalism, despite their volunteer status. She reflects on the critical role the Mountain Rescue team played with their software solution, pausing before completing her thought. Ultimately, she expresses relief at finding resolution, emphasizing the importance for his children to move forward and the opportunity for loved ones to bid farewell.

This piece is featured in the WIRED UK magazine's November/December 2024 edition.

Discover More…

Direct to your email: A curated selection of WIRED’s most fascinating and unusual tales.

Elon Musk poses a threat to national security

Interview: Meredith Whittaker Aims to Disprove Capitalism

What is the solution for a challenge such as Polestar?

Mark your calendars for The Big Interview happening in San Francisco on December 3!

Additional Content from WIRED

Assessments and Manuals

© 2024 Condé Nast. All rights reserved. WIRED may receive a share of revenue from items bought via our website, as a result of our Affiliate Agreements with retail partners. Content from this website is not to be copied, shared, transmitted, stored, or utilized in any form without explicit written consent from Condé Nast. Ad Choices

Choose a global website