BigPlantSens - Untersuchung der Synergien von Big Data und Deep Learning für die Fernerkundung von Pflanzenarten
Forstwissenschaften
Geodäsie, Photogrammetrie, Fernerkundung, Geoinformatik, Kartographie
Physische Geographie
Zusammenfassung der Projektergebnisse
Accurate information on the geographic distribution of plant species is crucial for applications in research, nature conservation, forestry, agriculture, and ecosystem service assessments. Recent advancements in Uncrewed Aerial Vehicles (UAVs) have greatly enhanced our capabilities to provide information in high spatial and temporal detail on plant species distributions. In concert with deep learning-based pattern recognition, various plant species can be identified accurately from UAV aerial imagery. However, a key challenge is the requirement for large sets of reference observations, that is plant images and species information, for effective training of deep learning models. A solution to this problem might be plant photographs derived from species identification apps. Initiatives such as iNaturalist or Pl@ntNet provide millions of citizen science photographs of thousands of plant species. These crowd-sourced datasets provide an unprecedented portfolio of the appearance of plant species. In the BigPlantSens project, we hence use this citizen science data to train pattern recognition models for identifying plant species in UAV imagery. Key challenges of the citizen science data are that they only provide information that a species is present in a plant image but not where in the image. We hence developed several approaches to use the so-called ‘weak’ information of citizen science plant photographs for semantic segmentation of plant species in UAV imagery (pixel-wise classifications). We showed that this way a range of plant species can be accurately identified from models that were trained on citizen science data alone. A critical factor in this regard is the spatial resolution of the UAV imagery, as this limits how much characteristic features of a plant species are visible. We identified that a strength of citizen science data is that it is highly variable, facilitating the training of models that are transferable across illumination conditions or scene components. We found that certain characteristics of training images, such as the image distance or viewing angle can negatively affect the mapping accuracy. Consequently, we developed approaches to filter image datasets based on these characteristics before training. In BigPlantSens, we successfully explored the synergies between big data on plant photographs, drone imagery, and pattern recognition for fully automated vegetation mapping. Such fully automated vegetation mapping could pave the way for refined approaches in biodiversity monitoring and ecosystem management.
Projektbezogene Publikationen (Auswahl)
-
Free University Berlin, Geography Colloquium: Automatisierte Kartierung von Vegetation mit hochauflösenden Fernerkundungsdaten und Deep Learning
Kattenborn, T.
-
Technical University Berlin, Geoinformation Seminar: From small to large scale: Combining Unmanned Aerial Vehicles and Convolutional Neural Networks for Satellite-based Vegetation Mapping
Kattenborn, T.
-
University Münster, a colloquium of the Institute of Landscape Ecology: Deep Learning in Remote Sensing of Vegetation
Kattenborn, T.
-
DBU-Digital Forum (The German Federal Environmental Foundation): Vegetation Remote Sensing with Convolutional Neural Networks: What‘s behind the ‚hype‘? What are the related challenges?
Kattenborn, T.
-
8th International ScaDS.AI Summer School 2022, Leipzig: Vegetation characterization across scales from citizen science photographs, to drone and satellite remote sensing acquisitions
Kattenborn, T.
-
AngleCam : Predicting the temporal variation of leaf angle distributions from image series with deep learning. Methods in Ecology and Evolution, 13(11), 2531-2545.
Kattenborn, Teja; Richter, Ronny; Guimarães‐Steinicke, Claudia; Feilhauer, Hannes & Wirth, Christian
-
ELLIS Doctoral Symposium 2022, Alicante, Spain, poster presentation: Deep Learning and Citizen Science Synergies for Mapping Plant Species in Drone Imagery
Soltani, S.
-
Environment and Sustainability Special Interest Group, Alan Turing Institute, London: Remote sensing of vegetation with Convolutional Neural Networks across local and global scales
Kattenborn, T.
-
ESA Living Planet Symposium, Bonn, poster presentation: Transfer learning from citizen science photos enables plant species identification in UAV imagery
Soltani, S.
-
Spatially autocorrelated training and validation samples inflate performance assessment of convolutional neural networks. ISPRS Open Journal of Photogrammetry and Remote Sensing, 5, 100018.
Kattenborn, Teja; Schiefer, Felix; Frey, Julian; Feilhauer, Hannes; Mahecha, Miguel D. & Dormann, Carsten F.
-
Transfer learning from citizen science photographs enables plant species identification in UAV imagery. ISPRS Open Journal of Photogrammetry and Remote Sensing, 5, 100016.
Soltani, Salim; Feilhauer, Hannes; Duker, Robbert & Kattenborn, Teja
-
Department of Earth System Science, Stanford University, California, USA: From simple labels to semantic image segmentation: leveraging citizen science plant photographs for tree species mapping in drone imagery
Soltani, S.
-
Department of Plant Biology, Carnegie Institution for Science, Stanford University, California, USA: From Ground Photos to Aerial Insights: Automating Citizen Science Labeling for Tree Species Segmentation in UAV Images
Soltani, S.
-
GfÖ Annual Meeting 2023, Leipzig: From simple labels to semantic image segmentation: leveraging citizen science plant photographs for tree species mapping in drone imagery
Soltani, S.
-
OpenForest: A data catalogue for machine learning in forest monitoring.
Ouaknine, A., Kattenborn, T., Laliberté, E. & Rolnick, D.
-
Pattern to process, research to practice: remote sensing of plant invasions. Biological Invasions, 25(12), 3651-3676.
Müllerová, Jana; Brundu, Giuseppe; Große-Stoltenberg, André; Kattenborn, Teja & Richardson, David M.
-
Potsdam Institute for Climate Impact Research (PIK), seminar of the Department on Earth System Analysis: Mapping global distributions of functional plant traits using citizen science - just an exotic or a really promising approach?
Kattenborn, T.
-
Senckenberg Biodiversity and Climate Research Centre, colloquium of the Biogeography and Ecosystem Ecology Group: Mapping global distributions of functional plant traits using citizen science
Kattenborn, T.
-
Technical University of Munich, seminar of the department of Land Surface-Atmosphere Interactions : Revealing Earth´s plant functional trait continuum using a crowd-sourced data
Kattenborn, T.
-
Transfer learning from citizen science photos enables plantspecies identification in UAV imagery. Copernicus GmbH.
Soltani, Salim; Feilhauer, Hannes; Duker, Robbert & Kattenborn, Teja
-
DivShift: Exploring Domain-Specific Distribution Shift in Volunteer-Collected Biodiversity Datasets
Sierra, E., Gillespie, L. E., Soltani, S., Exposito-Alonso, M. & Kattenborn, T.
-
From simple labels to semantic image segmentation: leveraging citizen science plant photographs for tree species mapping in drone imagery. Biogeosciences, 21(11), 2909-2935.
Soltani, Salim; Ferlian, Olga; Eisenhauer, Nico; Feilhauer, Hannes & Kattenborn, Teja
-
Macrophenological dynamics from citizen science plant occurrence data. Methods in Ecology and Evolution, 15(8), 1422-1437.
Mora, Karin; Rzanny, Michael; Wäldchen, Jana; Feilhauer, Hannes; Kattenborn, Teja; Kraemer, Guido; Mäder, Patrick; Svidzinska, Daria; Wolf, Sophie & Mahecha, Miguel D.
-
Temporal dynamics in vertical leaf angles can confound vegetation indices widely used in Earth observations. Communications Earth & Environment, 5(1).
Kattenborn, Teja; Wieneke, Sebastian; Montero, David; Mahecha, Miguel D.; Richter, Ronny; Guimarães-Steinicke, Claudia; Wirth, Christian; Ferlian, Olga; Feilhauer, Hannes; Sachsenmaier, Lena; Eisenhauer, Nico & Dechant, Benjamin
