Google Earth Engine - Plataforma única de análise de grandes dados geográficos


O Earth Engine é uma plataforma baseada em nuvem para análise de dados geoespaciais em escala planetária. Ele permite que você use o vasto poder computacional do Google para explorar uma ampla gama de questões: perda de floresta, seca, desastres naturais, epidemias, segurança alimentar, gerenciamento de água, mudanças climáticas e proteção ambiental. Para evitar confusão nos nomes, determinamos imediatamente que o Google Earth (também conhecido como Google Earth) e o Google Earth EngineSão dois produtos diferentes. O primeiro, sem exigir conhecimentos especiais de informática dos usuários, foi projetado para visualizar imagens de satélite e permite viajar e explorar o mundo, interagindo com um globo virtual. A segunda, à qual este artigo é dedicado, é antes de tudo uma ferramenta para análise de dados. O uso do Earth Engine requer conhecimento da área de aplicação e a capacidade de escrever o código do programa. Link para o site oficial do projeto.


Earth Engine — , , , , . Earth Engine .


, Earth Engine , . 2012 . , Earth Engine. , , , .




  1. 2.1.
    2.2.
    2.3.
    2.4.
    2.5.
    2.6.
    2.7.

  2. 3.1. Earth Engine Apps
    3.2. QGIS
  3. Earth Engine

  4. 6.1.
    6.2.
  5. Earth Engine

1.


2009 Google , - . .


2010 , Google, , Earth Engine. , Landsat, Google.


Earth Engine 2013 , . , , .


2016 Google Earth Timelapse — , , , . Earth Engine. , «Google Earth Engine» 2016 .



«Google Earth Engine» c 1 2009 16 2020 . 2010 , Earth Engine ; 2013 — ; 2016 — Google Earth Timeseries. . : Google Trends


Earth Engine — , . , , , . 2017 Remote Sensing of EnvironmentGoogle Earth Engine: Planetary-scale geospatial analysis for everyone, .



, Google Earth Engine, Scopus, - .


2019 Earth Engine 29 600 , . Geo for Good Summit 2019, Google Earth Engine Google Earth Outreach, . , , . Google, Google Earth Earth Engine.


, Earth Engine 10 , , . , , .


2.


N. Gorelick, M. Hancher, M. Dixon, S. Ilyushchenko, D. Thau, and R. Moore, “Google Earth Engine: Planetary-scale geospatial analysis for everyone,” Remote Sensing of Environment, vol. 202, pp. 18–27, 2017 .


, Earth Engine — , . (API). JavaScript API, (Code Editor) « ». Python API Google Colab. Google.


Earth Engine :


  • - ,
  • -
  • (, )

. , , , . , . Earth Engine API Python, -IDE, JavaScript.



Earth Engine — - JavaScript.



Google Colab Python API.


, API JavaScript, , , — . . Python API Earth Engine - . , Earth Engine . Python API , , Folium. JavaScript API, , «» , Python API, Earth Engine.


Earth Engine Google, Earth Engine. , , . , .


, , , Earth Engine . , , , , « ».


, , Earth Engine . , , Google Drive.


2.1.


Earth Engine (Earth Engine Data Catalog) . , Landsat ( ), Sentinel-1, Sentinel-2, Sentinel-3, Sentinel-5P , , , , - . , .


6000 . ( — «») REST- .



Earth Engine.


2.2.


Earth Engine , - Google:



Earth Engine Google Fusion Tables, 2019 .


. Earth Engine (Code Editor) REST API. « » (), , . , FlumeJava . , , , , . Borg , . , .



̈ Earth Engine. N. Gorelick et al. / Remote Sensing of Environment 202 (2017) 18–27; 2019 . Fusion Tables .


Earth Engine, , API. ( 2020 ), 1500 , , . : map() iterate(), . reduce(), , , . Earth Engine API Reference.


2.3.


Earth Engine , , «» (Image). , . - , . «/», , ​​ , , . , , , , « » (ImageCollection). , , . , Landsat-8, 2019 2020 , 10%.


, Earth Engine, . . 256×256 . « » (data cube), : , . , , , .



Earth Engine . , . .


, , , . , , . , , (, ), , , . , . -.


2.4.


, , , (per-band basis) (band-to-band basis), , , , , . , (table lookup), - , . , 20 , (), . (kernel), , , , , , , . , , , , , , (spectral unmixing), (region growing) (cost mapping).



, Earth Engine 1239 Landsat-8. . , 23 2019 .


, . (), / . , , Earth Engine , , , .


Earth Engine, , Python JavaScript, . - (ee.Image), (ee.ImageCollection) , (ee.Number), (ee.String), (ee.Geometry) (ee.List). - , , .


Earth Engine. «» , , . , , 3+7, 10. : , , , , . , , , « ».


Earth Engine , . , Earth Engine , () , . : (), .


, Earth Engine . - JavaScript:


//       
collection = ee.ImageCollection("LANDSAT8")
winter = collection.filter(ee.Filter.calendarRange(11, 1, "month"))
summer = collection.filter(ee.Filter.calendarRange(6, 8, "month"))
diff = summer.median().subtract(winter.median())

:


  1. winter: Landsat-8, ,
  2. summer: Landsat-8, ,

, median(), .



, . N. Gorelick et al. / Remote Sensing of Environment 202 (2017) 18–27.


«» , , , , .


Earth Engine : , , . , , , . , , , . « », . , , . , , . , .


Earth Engine . , ó , (batch-processing request) Earth Engine, , Tiff-, , . Google Drive .


2.5.


Earth Engine . .


2.5.1.


, , : . , , . . . . , « » . , , , .



. ( ) 2:1.


Earth Engine , . , , . 256×256 , .


pixel-at-time (--), . , Java JIT-, . , , , .


2.5.2.


, : , , . , , , . , , , .


Earth Engine , Scatter/Gather (/). , , , . , , , . , . , , , , .


MapReduce, , , , , , , . ( 1024×1024 ), . - , , , , , , - .


2.5.3.


(time series analysis). , , . — ( ). . , . . «» (stream) . , , , .


, (, ), . , . , , . , Landsat-5, -7 -8, 5 , 2000 , 500.


2.5.4.


Earth Engine , . , ( ) , , . , , , .


, , — . , , , . , , .


, , , , . . , , . , . , , , , . , , , .


2.6.


Earth Engine JIT- Java , . , JIT-, :


  1. Java JIT-
  2. C++
  3. , , C++,

, :


  1. SingleNode: , . .
  2. NormalizedDifference: , . : , , .
  3. DeepProduct: , 64 , 65 .
  4. DeepCosineSum: , DeepProduct, cos(a+b).
  5. SumOfProducts: , . 40 , 780 779 . , , , — .

256×256 , , -: Intel Sandy Bridge 2,6 . , , , 4 5 Java JIT- C++ 50%, C++.



Java JIT C++. N. Gorelick et al. / Remote Sensing ofEnvironment 202 (2017) 18–27.


2.6.1.


- Google . , , . Earth Engine ​​ CPU . , , , .


Earth Engine . Landsat , . Landsat-8 1T, 1 2014 31 2016 , :


  • (Contiguous United States): 26 961 1,21
  • : 77 528 3,14 .

, -. .



. N. Gorelick et al. / Remote Sensing of Environment 202 (2017) 18–27.


2.7.


Earth Engine ,
. , , , . , , , . , : , . , .


2.7.1.


Earth Engine , . , , . , , Earth Engine, . , Earth Engine , API Earth Engine, .


API- Earth Engine . , , 800 Earth Engine: ( ), . , , , , .


Earth Engine , , , . Earth Engine . 2017 :


  • : 270
  • : 40
  • , : 25

, . , , . , : 2000 . , , : 100 . , . , , (training set).


(jobs) , , - , , .


2.7.2.


, , , Earth Engine. , , , , , ( ). Earth Engine , , ( ).


Earth Engine , — , : , , , . , , , Earth Engine, .


Earth Engine, . Earth Engine . , Earth Engine, Google, , , Earth Engine.


2.7.3. -


Earth Engine «-». Earth Engine , , , (, Python) . - . , Earth Engine . , , , . - , - Earth Engine, . . , , , .


, ; TensorFlow .


2.7.4.


Earth Engine — , , , . , . , Google Compute Engine BigQuery.


3.


3.1. Earth Engine Apps


2018 Google API Earth Engine Apps Earth Engine. , Earth Engine JavaScrip API , , .


, Earth Engine Apps, URL-, . Earth Engine . Earth Engine Apps, .


Earth Engine , , . , . Earth Engine , , . , Earth Engine .



Earth Engine Apps , , API .


3.2. QGIS


Earth Engine QGIS — , . QGIS Earth Engine, «» Earth Engine QGIS Earth Engine Python API. , Google. , . QGIS.



Earth Engine QGIS QGIS Earth Engine, Earth Engine Python API.


4. Earth Engine


Earth Engine , , :



Earth Engine :




- CompareNO2, Earth Engine, . .



Earth Engine :



5.



6.


6.1.



6.2.


6.2.1.


Feedback→Send Code Editor feedback. , . , .



API ( ), IssueTracker — c .


6.2.2. API


  1. — , - .
  2. , «» : . , . .
  3. , , .

, , Earth Engine API , , .


6.2.3.


, Earth Engine . :


  1. .
  2. , «», , .
  3. , .

, .


6.2.4. API


  1. .
  2. , «» .
  3. , , , .

, .


7. Earth Engine


Earth Engine, . , .


, Sentinel Hub Sentinel Playground, Sentinel-2 web-, « » .


2017 . Copernicus, . DIAS (Data and Information Access Service — ):


  1. ONDA DIAS
  2. CREODIAS
  3. Mundi
  4. Sobloo
  5. Wekeo

, , . Earth Engine, . Copernicus , . , Earth Engine.


8.


, , , . . , — Google Earth Engine. , . .


, , . .


: , Google Earth Engine, , .


.


All Articles