All Projects → texty → amber-methodology

texty / amber-methodology

Licence: other
How to use machine learning to find interesting places on satellite maps

Programming Languages

Jupyter Notebook
11667 projects
HTML
75241 projects

Projects that are alternatives of or similar to amber-methodology

pylandtemp
Algorithms for computing global land surface temperature and emissivity from NASA's Landsat satellite images with Python.
Stars: ✭ 110 (+139.13%)
Mutual labels:  satellite-images
Crop-Classification
crop classification using deep learning on satellite images
Stars: ✭ 55 (+19.57%)
Mutual labels:  satellite-images
Python-for-Remote-Sensing
python codes for remote sensing applications will be uploaded here. I will try to teach everything I learn during my projects in here.
Stars: ✭ 20 (-56.52%)
Mutual labels:  satellite-images
CoastSat.slope
Beach-face slope estimation from satellite-derived shorelines, extension of the CoastSat toolbox.
Stars: ✭ 42 (-8.7%)
Mutual labels:  satellite-images
eemont
A python package that extends Google Earth Engine.
Stars: ✭ 290 (+530.43%)
Mutual labels:  satellite-images
aitlas
AiTLAS implements state-of-the-art AI methods for exploratory and predictive analysis of satellite images.
Stars: ✭ 134 (+191.3%)
Mutual labels:  satellite-images
Image-Classification
Pre-trained VGG-Net Model for image classification using tensorflow
Stars: ✭ 29 (-36.96%)
Mutual labels:  satellite-images
Felicette
Satellite imagery for dummies.
Stars: ✭ 1,710 (+3617.39%)
Mutual labels:  satellite-images
rsat
Dealing with Multiplatform Satellite Images from Landsat, MODIS, and Sentinel
Stars: ✭ 32 (-30.43%)
Mutual labels:  satellite-images
SenseEarth2020-ChangeDetection
1st place solution to the Satellite Remote Sensing Image Change Detection Challenge hosted by SenseTime
Stars: ✭ 156 (+239.13%)
Mutual labels:  satellite-images

Search for illegal amber mining on satellite images, HOWTO

How we created dataset and trained a model

Read here for even more detailed description of a project

This is a description of methodology for project Leprosy of the Land made by Texty during March, 2018. Main idea was to use machine learning to find all places of illegal amber mining in Nothern-West regions of Ukraine, on satellite images.

Motivation

In 2010 world prices for amber started to surge. Due to this in 2012 demand was so high that north-western part of Ukraine became place of "amber rush" and "new Wild West". Thousands of prospectors starts to search for gems with shovels and later with water pumps. Hundreds of hectars in forests / agricultural land became a desert, a lifeless moon landscape. 2014-2016 were most intence years of illegal mining, but it's still going right now.

We decided to estimate, for the first time, the scale of environmental impact from this phenomenon.

Project stages

  1. Research how patches of land with illegal mining could look on satellite images (look at images for some known locations with amber mining, use known videos and photos, make interviews with field experts)

  2. Find which map providers have relatively recent satellite images with good resolution. Find examples of places with mining on such images (Mostly it's Bing Maps by Microsoft. It has excellent API, for example it provides useful metadata such as a date for each tile. Due to small characteristic size of digged holes, we needed resolution no less then 1m per pixel).

  3. Find and compile initial set of coordinates for images with traces of mining (we found first places with mining with a huge help from participants of Open Data Day Kyiv )

  4. Split each such tile to superpixels/segments (part of image with approximately homogeneous visual appearance)

  5. Use neural net to extract features for each superpixel (we used pretrained, vanilla ResNet50 from Keras library)

  6. Create labelled set of superpixels for binary classificator (split images on two sets - with traces of amber mining, and without such traces)

  7. Create machine model to classify superpixels (XGBoost was choosed due to best performance, after several tries)

  8. Apply steps 4,5 and classifier from step 7 to each superpixel/segment for all images from region of interest. If more then 2 superpixels classified as positive, mark current image as area of mining (We processed approximately 450,000 images from region with total area about 70,000 km^2, total computation time was ~100 hours on one computer with two GeForce GTX 960 onboard)

  9. Create interactive map with places found by our method ( Most active period of mining was during 2014-2016 years. Most tiles from maps dated by 2015. We found more then 1,000 hectares of damaged land)

Result: we present most informative, as for this moment, interactive map of impact on environment due to illegal amber mining in Ukraine (this article is in English)

Python notebooks

Sources of inspiration

At first we were thinking about such (amber related) project back in 2016, during work on deforestation in Karpathian mountains. But in that time we didn't have relatively recent satellite images with resolution big enough.

I'd like to say couple of kind words for Terrapattern, amazing project which proved that similar analysis of satellite images is possible.

Other remarks

For the article, we used a novel way to make a transition between main visual elements --- fragments of satellite images --- and interactive map with the same images. You should see it by yourself :)

Publicity

Contact autor of this repository:

Anatoliy Bondarenko

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].