|
|
A Spark-based Distributed Implementation of Interpolating MODIS LST over Qinghai-Tibetan Plateau |
Zhang Bo1,2 ,Wu Lizong3,Wang Weizhen1,Sun Xuehui4 |
(1.中国科学院西北生态环境资源研究院,中国科学院黑河遥感试验研究站,甘肃省遥感重点实验室,甘肃 兰州 730000;
2.中国科学院大学,北京 100049;
3.中国极地研究中心,上海 200136;
4.南京师范大学地理科学学院,江苏 南京 210023) |
|
|
Abstract The MODIS LST products are often obscured by clouds and other atmospheric disturbances,resulting in severe data loss.Traditional interpolation methods cannot be effectively applied when there is large area of missing data.Many methods are developed to solve this problem.A better approach is to estimate the LST of missing pixels by using a known set of pixels with a similar LST variation feature as the missing pixel.But it usually has to be done with supercomputers.In order to make the above method free from supercomputers computer,a distributed implementation of the method is proposed by combing it and the Spark that is a distributed computing engine.The interpolation efficiency of two model is compared under different hardware resources and data.The results show that the scheme is effective and feasible,the performance of the proposed method is lower than the Yu method when with a small amount of data and the cluster nodes,but with the increase of hardware resources,the performance of the proposed method is better than that of the Yu method.In addition,the performance of the scheme can be further improved by using the newest Spark or compiling the code of the Yu method into a .so library and then using the Spark call it.
|
Published: 29 January 2019
|
[1] |
. [J]. Remote Sensing Technology and Application, 1987, 2(4): 27
-30
. |
[2] |
. [J]. Remote Sensing Technology and Application, 1988, 3(3): 12
-17
. |
[3] |
. [J]. Remote Sensing Technology and Application, 1989, 4(1): 18
-20
. |
[4] |
. [J]. Remote Sensing Technology and Application, 1989, 4(2): 12
-19
. |
[5] |
. [J]. Remote Sensing Technology and Application, 1989, 4(3): 9
-14
. |
[6] |
J.E.Lukens; 冯筠. [J]. Remote Sensing Technology and Application, 1990, 5(3): 68
-72
. |
[7] |
Su-Hua-Che. [J]. Remote Sensing Technology and Application, 1990, 5(4): 70
. |
[8] |
LIU Yong-Wei. [J]. Remote Sensing Technology and Application, 1990, 5(4): 73
. |
[9] |
. [J]. Remote Sensing Technology and Application, 1991, 6(2): 60
-63
. |
[10] |
. [J]. Remote Sensing Technology and Application, 1992, 7(1): 62
-65
. |
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
|
Shared |
|
|
|
|
|
Discussed |
|
|
|
|