Groundbreaking AI Drone Software Revolutionizes Search and Rescue Operations in Remote Terrains

To go back to this article, navigate to My Profile and then click on View saved stories.

An Innovative AI Drone Technology Locates Individuals Beyond the Reach of Search and Rescue Teams

When Charlie Kelly unexpectedly sent a message that he would not be returning home that evening, his partner, Emer Kennedy, felt a mix of disappointment and concern. The date was September 6, 2023, a Wednesday, and 56-year-old Kelly, an avid mountain enthusiast, had departed their home in Tillicoultry, close to the Scottish city of Stirling, before Kennedy left for work that day. His objective was to ascend Creise, a mountain standing at 1,100 meters, famous for its commanding view over Glen Etive, a secluded valley in the Highlands that gained recognition from its appearance in the James Bond movie Skyfall.

The climate proved to be surprisingly gentle for the time of year, leading Kelly to believe he could possibly conquer another Munro, the term given to Scottish mountains that exceed 3,000 feet in height. Outside of his duties as a forensic psychologist with the Scottish Prisons Service, he had been methodically crossing off these summits from his list. “He kept a log in this book where he'd check them off,” Kennedy recalled. “However, with a vacation planned in just two and a half weeks, this was to be his final Munro before winter arrived.”

Kennedy wasn't much of a fan of hiking. When she and her companion first crossed paths about four and a half years ago, it was their mutual affection for Celtic Football Club and their distinctively offbeat humor that sparked their connection. Kennedy was captivated by Kelly's intellect—his vast knowledge on topics ranging from football to Robert the Bruce and Doctor Who mesmerized her. She appreciated his sense of humor, even if his jokes were a bit lackluster, she recalls. More importantly, she valued how she supported him in his interests, even those she didn't share. "One of the last things he mentioned to me the night before was, 'You let me be myself,'" she reflects.

When Kennedy heard from Kelly that he wouldn't be able to descend the hill before it got dark, she felt concerned yet had faith in his judgment. "Charlie had a knack for navigating tricky situations," she remarked. "In his job, he was skilled in handling negotiations, whether that involved dealing with hostage situations or inmates getting onto the roof. He was usually cautious." Kelly calmed her worries by explaining there was no urgency to seek assistance. He was well-prepared with additional provisions, ample water, and sufficient warm attire. His plan was to stay put until daylight and then make his way down.

While at her job on Thursday, Kennedy frequently glanced at her phone during any pauses in her work. Kelly had gotten in touch early in the morning and continued to send upbeat texts whenever he was within signal range. As the evening approached and the daylight began to fade around 8 pm, he texted to inform her that his phone's battery was dwindling. However, he reassured her not to be concerned as he could spot the Glencoe Ski Center's lights, indicating where he had left his vehicle. He assured her there was still enough light for him to safely make it there, estimating his arrival in roughly 30 minutes. Unfortunately, this message would be the last time anyone heard from Charlie Kelly.

In the aftermath of Kelly's disappearance, the Glencoe Mountain Rescue team initiated an extensive search operation, which they later characterized as "Herculean". This operation included the use of search dogs, all-terrain vehicles, several helicopters, and drones equipped with both infrared and standard cameras. The effort saw collaboration from the Coastguard, Police Scotland, and the Royal Air Force, alongside contributions from nearly fifty highly skilled volunteers across 10 different Mountain Rescue (MR) teams. At times, the search saw up to 50 individuals combing the hillside simultaneously. On Saturday, September 9, Kelly's backpack was discovered, but thereafter, no further evidence was found.

The significant progress arrived after a delay of over six weeks. Dan Roach and David Binks, who were part of a Mountain Rescue team based in the Lake District in the north of England, had kept up with the search operations through digital news. During their leisure time, they dedicated themselves to creating innovative software aimed at enhancing drone capabilities for locating lost individuals. After investing two years into the project, which Binks described as involving "extremely challenging mathematics," they were confident they had developed a functional prototype.

Binks mentions, "I was aware of the ongoing search and it occurred to me that it would be an excellent opportunity to put the system to the test. Coincidentally, Dan called me while I was returning from a vacation, sharing the same thought." The duo reached out to Glencoe MR, offering their assistance. "I believe they were skeptical about our involvement making a difference," Binks remarks. However, having exhausted all other options, "They were open to letting us give it a shot."

On October 24, Binks, Roach, and their companion Dan Parsons, who is also a member of Roach's Mountain Rescue team and assisted in preliminary trials, journeyed to Glencoe. They joined forces with the local Mountain Rescue team, deployed two drones, and located the remains of Charlie Kelly within the initial sixty minutes.

Volunteer teams tasked with mountain rescue frequently embark on missions to locate lost trekkers, with drones playing a crucial role in their search and rescue strategies.

In the United Kingdom, Mountain Rescue is commonly dubbed the fourth emergency service. However, distinct from the police, fire department, or medical emergency services, it relies solely on volunteer personnel. The nation's mountainous regions are served by a variety of groups composed of community members from diverse backgrounds. These groups function as independent registered charities, each accountable for generating their own funds, organizing their training, and securing their equipment.

According to Mike Park, the elected head of MR England & Wales, a key organization aimed at fostering collaboration among teams, there are clear benefits to its decentralized approach. However, he also acknowledges a downside, pointing out that it can lead to a culture of individualism and a mentality of superiority, where teams believe they alone have the right answers. Park, who previously led the Cockermouth MR team in the Lake District and has been a volunteer for nearly 42 years, observes that the majority-male membership of MR can sometimes become overly territorial about their specific knowledge areas, causing delay in the adoption of new ideas. He criticizes an entrenched culture that undervalues fresh perspectives, suggesting, “You're expected to have two decades of experience before your input is considered valuable.”

As consumer camera drones began to hit the market in the early 2010s, their potential for aiding in search and rescue missions was immediately apparent. The idea was that these drones could survey large expanses of land at a much lower cost compared to deploying a helicopter. However, Roach, who had initially explored drones for his photography projects, had his reservations. An avid mountaineer, sporting long, wavy hair and a mustache reminiscent of Pedro Pascal, he became a part of the Cockermouth Mountain Rescue team ten years ago and, at 34, is among the younger members of the group. "Initially, everyone was excited, thinking, ‘Great, now we can easily spot things.’ But it quickly became clear that to actually spot something, you need to be quite close, and then you're limited to viewing it on a small screen on the controller,” he observed.

Searching for a small object in a vast area isn't made easier simply by having a bird's eye view. Roach suggested that rather than just looking from above, they should harness the potential of drones to follow predetermined flight paths to make the search more efficient and automated. However, convincing the traditionalists at MR of his innovative approach was a significant challenge. Mike Park recalls a telling incident at an MR conference in Leeds University. "Dan arrived, sporting long hair and a skateboard under his arm, and someone mistook him for an early-returning student, questioning if he was in the right place," Park recounted.

Undeterred by the lack of enthusiasm from others, Roach continued his efforts with the support of his friend and fellow volunteer, Dan Parsons. Sharing the same age bracket, Parsons, aged 33, brought his expertise in forestry and experience with drone surveying to the table. Together, they experimented with commercial drone piloting and photography software, in addition to discovering a tool capable of identifying specific color pixels, such as the red in a hiker's attire. Roach recalls, “Ultimately, we created a highly technical, somewhat makeshift setup. It functioned, but it was far from streamlined. You had to operate three distinct software programs to conduct a search.” It was Roach's encounter with David Binks, a retired software engineer who dedicates his time to Duddon & Furness MR, located roughly 30 miles south of Cockermouth, that truly propelled the project forward. During a gathering of drone enthusiasts in the Lake District, Roach shared his vision for automating drone searches, which caught Binks' attention. “He approached me after the meeting, saying, ‘I’ve never considered it from that angle. Let’s discuss this further.’”

This duo is quite the odd couple. Roach, brimming with a boundless, Tigger-like zeal, is the creative mind of the two, while Binks, the more reserved one, brings a methodical engineer's perspective. At the age of 57, Binks, who is over two decades Roach's senior, brings invaluable experience not just in coding, but in crafting software that has seen widespread use in the MR sector. Back in 2007, he developed a piece of software named MR Maps, which revolutionized team coordination by enabling them to monitor their whereabouts almost instantly through signals emitted from their communication devices. This innovation was particularly impactful at a time when the ubiquity of GPS in phones or portable gadgets was still on the horizon. Following their initial discussions between the end of 2021 and the beginning of 2022, Binks concluded that the most effective approach to realizing Roach's vision would be to integrate it with MR Maps.

Innovative image-processing software now allows for the simpler detection of individuals hidden within thick underbrush and rugged terrain.

Binks explains, "Given my experience with simulation software for offshore oil platforms and wind farms, I was familiar with the mathematics involved. I was confident it could be done. However, there were numerous occasions where I began my day at 9 AM and, without noticing, found myself working straight through until 3 AM." The software, crafted from Binks' efforts and developed in C++, carries a certain nostalgic feel, reminiscent of Windows 95, as Roach puts it. Despite its simple appearance, the software demonstrates a remarkable depth of complexity.

Binks outlines a tripartite hurdle they faced. "The initial step involves maneuvering the drone to capture ground images in the most efficient manner." It's essential for the camera to be positioned directly downwards to ensure every section of the terrain is covered in several shots. This approach helps to prevent any potential obstruction by the angles of walls or rocks. "We ensure a 55 percent image overlap, which means a single item would appear in about nine pictures on average," Binks notes. The drone’s route is automatically mapped out based on the pilot's preferred altitude, utilizing the 2×2 meter lidar data that forms the basis of the UK’s Ordnance Survey (OS) maps. These are the UK government's official maps, provided at no cost to MR by OS. Additionally, the software advises the pilot on the optimal positioning to maintain visual contact with the drone during its flight, a legal mandate in the UK.

Binks elaborates on another feature of the software, which involves determining the grid location for any specific pixel within an image. "This is achieved through the application of rotational vectors to pinpoint their intersection with the surface," he describes. Furthermore, Binks highlights a third component of the software, focusing on the examination of images to identify notable aspects.

Roach and Parsons' initial makeshift approach required specifying the exact colors to look for, however, Binks ingeniously proposed a reversal of this process. "What I do is measure how many pixels are of a specific color, then identify and emphasize groups of colors that don't frequently appear." Binks elaborates, pointing out that a hiker's red jacket would pop against a verdant backdrop, "but in a scene dominated by stones, green would be the standout color."

The system functions without any need for internet connectivity, making it ideal for use in isolated areas. Consequently, after every flight, images must be manually retrieved from the drone, but the analysis can proceed on-site. It highlights areas with unusually colored pixels for a person to examine, while the drone proceeds to scan the next area. “We encounter many false alarms, yet it’s quick for someone to sift through these,” mentions Binks. Roach adds, “Often, it’s just oddly colored moss, stones, or even a sheep.” “However, occasionally, we find an individual.”

Operators have the ability to designate specific zones for drone surveillance and can establish pre-programmed routes for exploration.

The rugged terrain behind the Glencoe Ski Center served as an almost ideal testing area for the new features of MR Maps. Stretching from the ski lift summits to the winding, dead-end road leading into Glen Etive, the landscape is largely made up of rocks, brownish grass tufts, and occasional deer sightings. Brian Brathurst, a deputy team leader with Glencoe MR, sheds light on the complexity of the area. Sporting an accent that hints at his Zimbabwean background and a knack for understatement, he notes, "The terrain is filled with numerous boulder fields and gully systems. It's possible to miss someone by just five or 10 meters because of how the land is laid out."

As the search entered its fourteenth day, hope of locating Kelly alive was fading, leading to a reduction in the search operations' intensity. Brathurst notes, "Regrettably, people must get on with their daily lives. However, in our community, we're not known for abandoning our efforts. Every chance we got, we were out there searching. Throughout those six weeks, there was consistently someone conducting searches—individuals wrapping up their workday and then heading out to investigate regions that hadn't been covered yet. The search efforts were unceasing."

Upon their arrival, Binks, Roach, and Parsons were thoroughly prepared. Binks acknowledged, "We couldn't have accomplished our tasks without Glencoe's preliminary efforts." The team split the promising search zones among themselves, with both Dans managing one drone and Binks operating another, each heading to separate launch sites. Even with their extensive software preparations, apprehension lingered. Parsons recalled, "Although we had practiced by locating our coats in fields, this was our first real test without knowing the exact location of the items beforehand."

David commenced the initial search operation over "Area A" with his drone. However, roughly 10 minutes into the operation, the drone began to drift out of his field of view. Frustrated by this early setback, he summoned the drone back, mentally noting the need for software adjustments. "Alright, I'll switch to Area B now, but in the meantime, I'll review the findings from Area A," he thought to himself. As he sifted through the images that were marked, he was taken aback. "There, in two of the snapshots, was Mr. Kelly," Binks recalled, clearly astonished.

Dan Parsons, David Binks, and Dan Roach, the innovators behind drones equipped with MR Maps technology.

Upon arriving at the location, the Glencoe rescue group discovered Kelly had plummeted several meters, incurring lethal injuries to his head and torso. Brathurst mentioned that it's impossible to determine the exact time of his death. However, there were combine harvesters operating up the valley on the night of September 7. Binks suggests that Kelly, misled by his final message, might have headed directly towards those lights believing they were from the Ski Center, which led to his tragic fall. Yet, the precise circumstances remain unknown.

It was evident that Kelly was far from where he believed he was. Even though the area he was eventually discovered in had been thoroughly searched before. Kelly, however, had tumbled into a ditch, which made it difficult for search teams on the ground to spot him. Additionally, the subdued hues of his attire rendered him virtually invisible from above. Binks details, “He had on a somewhat light brown shirt and navy pants,” noting how challenging it is for people to distinguish these colors from the environment. “However, to a computer, these colors contrast sharply with the landscape, making him stand out significantly.”

Brathurst was among those who had volunteered to comb through the area by foot. "We must have come within about 20 or 30 meters close to him," he recounts. Nevertheless, they hadn't noticed anything.

The wilderness poses risks even for seasoned trekkers.

Discovering Charlie Kelly in the initial search zone wasn't just a stroke of fortune; it also highlighted the remarkable capabilities of MR Maps. Since then, the application has demonstrated its value in several searches, primarily by aiding in the narrowing down of potential search areas. “Dan often claims that our success rate stands at 100 percent,” Parsons remarks. “Even though we’ve only successfully located one individual, we’ve yet to conduct a search over a location where someone was present and fail to detect them.”

Until now, the application has primarily been utilized in the Lake District. However, under the guidance of Mike Park, Roach, Parsons, and Binks have also lent their expertise to teams nationwide upon request. When well-known British television doctor Michael Mosley disappeared on the Greek island of Symi, Park even discussed the possibility of the team flying over to assist with his Greek colleagues. “The area seemed ideally suited for our technology due to its rocky landscape, which our system can navigate through,” explained Binks. Although Mosley was located before their intervention was needed, the potential of their technology to shorten the distressing period of uncertainty for families like Mosley’s—and ease the efforts of search and rescue teams—is quite apparent.

In the United Kingdom, the demand on Mountain Rescue (MR) is intensifying. "We've been experiencing a steady rise in emergency calls over the years," Ian Bunting, the operations manager for MR England & Wales, states, "however, there's been a significant increase post-Covid." According to him, once group sports were halted, many turned to outdoor pursuits like hiking, which spiked in popularity. Additionally, with overseas travel restricted, more people flocked to the nation's national parks. Bunting adds, "Then you have the impact of social media," which has played a role in highlighting specific locations.

In 2022, the rescue team from Cockermouth, led by Dan Roach and Parsons in the Lake District, responded to an unprecedented number of emergencies. Meanwhile, in North Wales, the Llanberis Mountain Rescue team, responsible for the region's tallest mountain, Yr Wyddfa, issued a warning about the potential for "burnout" among their volunteers. They reported responding to over 300 calls for help in 2023, a significant increase from the 100 incidents in 2008. A 30-year veteran of the Edale Mountain Rescue team in the Peak District, Bunting, highlighted the heavy load carried by his teammates. He noted that some members personally tackled more than 100 calls for assistance. Bunting himself contributed up to 600 hours last year, accounting for missions, training, and equipment maintenance.

Bunting recognizes the inherent willingness of volunteers, highlighting their natural inclination to assist without refusing. He appreciates that any solution that minimizes the effort required in searching is a beneficial enhancement to the Mountain Rescue (MR) arsenal. He notes that the software developed by Binks and Roach may not be necessary for most operations where the missing person's location is already known. However, its ability to significantly reduce the duration and intensity of extensive searches, which account for about 10 to 15 percent of yearly operations as reported by MR England & Wales to WIRED, is considered immensely valuable.

Worldwide, the search and rescue drone market is valued at approximately $4 billion, as estimated by the market research company, Lucintel. However, Binks and Roach have no intention of making their product commercially available, despite its vast potential applications in mountain areas globally. In the United Kingdom, Binks has consistently provided MR Maps at no cost to those engaged in search and rescue operations, including the police, with multiple departments beginning to test the drone enhancement. "It's intended for search purposes, and I'm quite satisfied with that," states Binks.

He mentions that making money from it has never caught his interest. Rather, his drive is straightforward. "I genuinely like tackling the challenges," he explains. Ultimately, he highlights that the sole significant investment was the time he, Roach, and Parsons dedicated—a resource they, along with countless other MR volunteers throughout the UK, willingly offer to assist those in distress.

David Binks' MR Maps application initially allowed members of the rescue team to monitor signals emitted by their radios.

In late October 2023, Emer Kennedy recalls the moment two police officers, dressed in their official uniforms, arrived at her doorstep. Their message was brief and ominous: “You know why we’re here,” they stated. Kennedy had been clinging to a sliver of hope for a different resolution. However, as six weeks passed, her overriding concern became whether they would locate him before the harsh winter set in. If they didn't, she wondered, would they ever?

Individuals journeyed from across the globe to attend Charlie Kelly's memorial service. Colleagues from across the nation and college companions from various countries came together. The Pogues' music accompanied his casket as it was escorted out, and donations were gathered for a charitable cause, with the funds benefiting the Glencoe Mountain Rescue team.

Kennedy praises their expertise, despite their voluntary status, saying, "They're truly remarkable professionals." She reflects on the critical role of the Mountain Rescue team's software innovation and their readiness to implement it, pausing mid-sentence to let the significance sink in. Ultimately, she expresses relief, acknowledging, "It's a comfort to finally have closure. It allows his children to move forward. We all had the chance to bid him farewell—his loved ones and friends included."

This piece is featured in the November/December 2024 edition of WIRED UK magazine.

Recommended for You…

Direct to your email: A selection of the most fascinating and peculiar tales from the vault of WIRED.

Elon Musk poses a threat to national security

Interview: Meredith Whittaker Aims to Disprove Capitalism

What's the solution for a challenge like Polestar?

Invitation: Be part of The Major Interview happening on December 3rd in San Francisco.

Additional Content from WIRED

Evaluations and Manuals

© 2024 Condé Nast. All rights reserved. Purchases made through our website may result in a commission for WIRED, courtesy of our affiliate relationships with various retailers. Replicating, sharing, broadcasting, storing, or using the content from this website in any form is strictly prohibited without explicit prior written consent from Condé Nast. Ad Choices

Choose a global website