Screenshots from the iNaturalist app, which uses "deep learning" to automatically identify what bugor fish, bird, or mammalyou might be looking at.

On a recent trip to the local botanical gardens, I noticed a tall, striking purple flower Id never noticed before. I tried to Google it, but I didnt know quite what to ask. Purple flower brought me pictures of narcissus and freesia, orchids and primrose, gladiolus and morning glory. None of them were the flower Id seen.

But thanks to artificial intelligence, curious amateur naturalists like me now have better ways to identify the nature around us. Several new sites and apps use AI technology to put names to photographs.

iNaturalist.orgis one of these sites. Founded in 2008, has until now been solely a crowdsourcing site. Users post a picture of a plant or animal and a community of scientists and naturalists will identify it. Its mission is to connect experts and amateur "citizen scientists," getting people excited about plants and wildlife while using the data gathered to potentially help professional scientists monitor changes in biodiversity or even discover new species.

The crowdsourced model generally works well, says Scott Loarie, iNaturalists co-director. But there are some limitations. First, it can be much harder to get an identification of your photograph depending on where you live. In California, where Loarie is based, he can get an identification within an hour. Thats because a large number of the experts that frequent iNaturalist are based on the West Coast. But someone in, say, rural Thailandmay have to wait much longer to receive an ID: The average amount of time it takes to get an identification is 18 days. Another issue:As the site has become more popular, the balance of observers (people posting pictures) to identifiers (people telling you what the pictures are) has become skewed, with far more observers than identifiers. This threatens to overwhelm the volunteer experts.

This month, iNaturalist plans to launch an app that uses AI to identify plants and animals down to the species level. The app takes advantage of so-called deep learning, using artificial neural networks that allow computers to learn as humans do, so their capabilities can advance over time.

Were hopeful this will engage a whole new group of citizen scientists, Loarie says.

The app is trained by being fed labeled images from iNaturalists massive database of research grade observationsobservations that havebeen verified by the sites community of experts. Once the model has been trained on enough labeled images, it begins to be able to identify unlabeled images. Currently iNaturalist is able to add a new species to the model every 1.7 hours. The more images uploaded by users and identified by experts, the better.

The more stuff we get, the more trained up the model will be, Loarie says.

The iNaturalist team wants to the model to always be accurate, even if that means not being as precise as possible. Right now the model tries to give a confident response about the animal's genus, then a more cautious response about the species, offering the top 10 possibilities. It currently is correct about the genus 86 percent of the time, and gives the species in its top 10 results 77 percent of the time. These numbers should improve as the model continues to be trained.

Playing around with a demo version, I entered a picture of a puffin perched on a rock. We're pretty sure this is in thegenusPuffins, it said, giving the correct speciesAtlantic puffinas the top suggested result. Then I entered a picture of an African clawed frog. We're pretty sure this is in thegenusWestern spadefoot toads, it told me, offering African clawed frog as among its top 10 results.

The AI was not confident enough to make a recommendation about a picture of my son, but suggested he might be a northern leopard frog, a garden snail or a gopher snake, among other, non-human creatures. As all of these are spotted, I realized the computer vision was seeing the polka-dot background of my sons highchair and misidentifying it as part of the specimen. So I cropped the picture until only his face was visible and pressed classify. We're pretty sure this is in thesuborderLizards, the AI responded. Either my baby looks like a lizard orthe real answer, I presumethis shows that the model only recognizes what its been fed. And no one is feeding it pictures of humans, for obvious reasons.

iNaturalist hopes the app will take pressure off its community of experts, and allow for a larger community of observers to participate, such as groups of schoolchildren. It could also allow for camera trapping sending in streams of images from a camera trap, which takes a picture when its triggered by motion. iNaturalist has discouraged camera trapping, as it floods the site with huge amounts of images that may or may not actually need expert identification that (some images will be empty, while others would catch common animals like squirrels that the camera's owner could easily identify himself or herself). But with the AI that wouldnt be a problem. iNaturalist also hopes the new technology will engage a new community of users, including people who might have an interest in nature but wouldnt be willing to wait several days for an identification under the crowdsourced model.

Quick species identificationcould also be useful in other situations, such as law enforcement.

Lets say TSA workers open a suitcase and someones got geckos, says Loarie. They need to know whether to arrest someone or not.

In this case, the AI could tell the TSA agents what type of gecko they were looking at, which could aid in an investigation.

iNaturalist is not the only site taking advantage of computer vision to engage citizen scientists. The CornellsMerlin Bird IDapp uses AI to identify more than 750 North American birds. You just have to answer a few simple questions first, including the size and color of the bird you saw.Pl@ntNetdoes the same for plants, after you tell it what part of the plant its looking at (flower, fruit, etc.).

This is all part of a larger wave of interest in using AI to identify images. There are AIprograms that canidentify objects from drawings(even bad ones).AIs can look at paintingsand identify artists and genres. Many experts think computer vision will play ahuge role in healthcare, making it easier to identify, for example, skin cancers. Car manufacturersuse computer vision to teach carsto identify and avoid hitting pedestrians. A plot point of arecent episode of the comedy Silicon Valleydealt with a computer vision app for identifying food. But since its creator only trained it on hot dogssince training a neural network requires countless hours of human laborit could only distinguish between hot dogs and not hot dogs.

This question of humor labor is important. Massive databases of correctly labeled images are crucial to training AIs, and can be hard to come by. iNaturalist, as a longtime crowdsourced site, already has exactly this kind of database, which is why its model has been advancing so quickly, Loarie says. Other sites and apps have to find their data elsewhere, often from academic images.

Its still early days, but I guarantee in the next year youre going to see a proliferation of these kinds of apps, Loarie says.

Excerpt from:

AI Plant and Animal Identification Helps Us All Be Citizen Scientists - Smithsonian