乌鸦传媒

Skip to Content
Client story

Using AI to protect whales

Client: Lisa Steiner
Region: Global
Industry: Life Sciences

Working with Lisa Steiner, 乌鸦传媒 and AWS develop a new, self-learning AI solution that can more effectively identify matches between images of sperm whale tails and make it easier to draw a picture of migration going back decades

Client challenge:聽Lisa Steiner, a marine biologist working out of the Azores in Portugal, wanted to make it easier to identify sperm whales by the identifying pattern on their tails in order to better understand how to protect the species

厂辞濒耻迟颈辞苍:听Lisa worked with 乌鸦传媒 to use AI to develop a solution based on AWS technology that could learn to more quickly and reliably identify matching images, which has allowed Lisa to focus her time on other parts of her research

Understanding sperm whale migration

These days, few topics command as much attention or potential as artificial intelligence (AI). Virtually endless opportunities exist for new technology to change business and daily life, but this conversation does not turn often enough to how it can make the world a better place to live. AI can do more than deliver advantages to businesses; it can play a vital role in conservation efforts as we enter a critical time for our planet.

Enter Lisa Steiner, a marine biologist based out of the Azores who has devoted her life to conservation and tracked sperm whales for almost 35 years. After centuries of hunting and modern disruptions such as naval sonar and ghost fishing gear, the species has been listed as vulnerable since 2008, with only a few hundred thousand believed to remain. Now, more than ever, tracking sperm whales and understanding their migration patterns is incredibly important. Fortunately, there are already existing methods for doing so.

鈥淭he tail of a sperm whale is kind of like a fingerprint,鈥 says Lisa. 鈥淭hey have a distinct shape so we can keep track of them for pretty much their whole life.鈥

By matching photographs of the whales鈥 flukes (another word for tail), taken by marine biologists, Lisa can map out migration patterns in order to better inform environmental policies that can protect the species. However, doing so manually is far from easy, as image quality can dramatically alter the associated challenge as well as the amount of time needed to identify matches.

鈥淚 have to manually assist the program to pick out the contour for each half of the fluke,鈥 Lisa explains. 鈥淚f the photos are good, this process doesn鈥檛 take very long. However, if there isn鈥檛 a lot of contrast between the fluke and background or there is a lot of glare on the edge of the fluke, I have to follow the contour manually.

鈥淲hen you have nicks, they鈥檙e not as easy to see, which is one of the reasons it鈥檚 important to have a program that鈥檚 doing it automatically.鈥

AI escalates conservation efforts

In 2019, 乌鸦传媒 got wind of Lisa鈥檚 situation and used the case for its annual Global Data Science Challenge, a group-wide internal competition where hundreds of employees from all over the world compete in small teams to address real world challenges using artificial intelligence (AI). In partnership with Amazon Web Services (AWS), teams from around the world dreamed up potential AI-based solutions that would make it far easier to find matches between different fluke images that had previously gone unnoticed. Working with Lisa, they developed different concepts intended to make her day-to-day work simpler and let her spend more time on other critical elements of her research.

At the end of the competition, the winning team presented a pre-trained deep neural network built on AWS鈥檚 machine learning services that can perform adjustments to submitted pictures in order to accurately identify identical flukes across multiple images with 97.5% accuracy. In addition, the solution placed a great deal of emphasis upon futureproofing and performance in real-life scenarios. As such, the algorithm drew upon high-quality deep learning frameworks while pre-processing steps used a combination of open-source libraries to make them easily maintained and extendable. Finally, the entire solution was deployed as a lightweight service to ensure that it is straightforward to use.

With the AI-side of the project completed and the training process taking only three hours, the next step is to design a user interface that wrapped everything into a web-based application that Lisa will be able to use easily. Once it鈥檚 ready, all she will need to do is upload new pictures and wait a minute or two for the automated processing pipeline to complete before she can enjoy the results.

A better future for whales and beyond

Lisa has already seen how much easier it is to find matches. 鈥淭hey鈥檝e trained it to recognize the contour of the edge. It finds matches that my old program didn鈥檛 find,鈥 she says. 鈥淚 found quite a cool match that had not been detected previously, due to some changes in the contour. This goes back to 2002, so there were three separate IDs for this animal, instead of one.鈥

However, the solution鈥檚 ceiling isn鈥檛 just making Lisa鈥檚 life easier; instead, the program has the potential to provide her with a great deal more images than before by engaging with a user base that goes beyond marine biologists. Thanks to the ease with which the application can be used, the hope is that in the long run, people from all over will be able to upload pictures of sperm whales spotted in the Atlantic Ocean.

鈥淭he whole idea of this project with 乌鸦传媒 is to catch the public鈥檚 imagination and get them submitting photos from places that I would never go,鈥 says Lisa.

The work done with Lisa is just a start for using AI within conservation and environmental efforts. Already, the solution developed to match sperm whale flukes can be transferred and applied to other species to support similar research efforts. In this way, endangered or vulnerable animals all over the world can more effectively be tracked so that biologists can better understand population levels, migration patterns, and changes within behavior as a result of environmental changes. With improvements made to their research methods, these experts can more effectively provide guidance that can influence international climate policy.

And AI only continues to develop and become relevant for an ever-wider array of opportunities. Lisa鈥檚 work with 乌鸦传媒 represents a crucial step on the path towards further innovation, and with this kind of collaboration between technology and research experts becoming more prevalent, the vision of a sustainable future seems more attainable than .