Please wait a minute...
img

Wechat

Remote Sensing Technology and Application  2018, Vol. 33 Issue (6): 1178-1185    DOI: 10.11873/j.issn.1004-0323.2018.6.1178
    
A Spark-based Distributed Implementation of Interpolating MODIS LST over Qinghai-Tibetan Plateau
Zhang Bo1,2 ,Wu Lizong3,Wang Weizhen1,Sun Xuehui4
(1.中国科学院西北生态环境资源研究院,中国科学院黑河遥感试验研究站,甘肃省遥感重点实验室,甘肃 兰州 730000;
2.中国科学院大学,北京 100049;
3.中国极地研究中心,上海 200136;
4.南京师范大学地理科学学院,江苏 南京 210023)
Download:  PDF (2962KB) 
Export:  BibTeX | EndNote (RIS)      
Abstract  The MODIS LST products are often obscured by clouds and other atmospheric disturbances,resulting in severe data loss.Traditional interpolation methods cannot be effectively applied when there is large area of missing data.Many methods are developed to solve this problem.A better approach is to estimate the LST of missing pixels by using a known set of pixels with a similar LST variation feature as the missing pixel.But it usually has to be done with supercomputers.In order to make the above method free from supercomputers computer,a distributed implementation of the method is proposed by combing it and the Spark that is a distributed computing engine.The interpolation efficiency of two model is compared under different hardware resources and data.The results show that the scheme is effective and feasible,the performance of the proposed method is lower than the Yu method when with a small amount of data and the cluster nodes,but with the increase of hardware resources,the performance of the proposed method is better than that of the Yu method.In addition,the performance of the scheme can be further improved by using the newest Spark or compiling the code of the Yu method into a .so library and then using the Spark call it.

Key words:  Spark      Distributed Computing      Land Surface Temperature      Interpolation Method      Qinghai-Tibet     
Published:  29 January 2019
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors

Cite this article: 

Zhang Bo, Wu Lizong, Wang Weizhen, Sun Xuehui. A Spark-based Distributed Implementation of Interpolating MODIS LST over Qinghai-Tibetan Plateau. Remote Sensing Technology and Application, 2018, 33(6): 1178-1185.

URL: 

http://www.rsta.ac.cn/EN/10.11873/j.issn.1004-0323.2018.6.1178     OR     http://www.rsta.ac.cn/EN/Y2018/V33/I6/1178

[1] . [J]. Remote Sensing Technology and Application, 1987, 2(4): 27 -30 .
[2] . [J]. Remote Sensing Technology and Application, 1988, 3(3): 12 -17 .
[3] . [J]. Remote Sensing Technology and Application, 1989, 4(1): 18 -20 .
[4] . [J]. Remote Sensing Technology and Application, 1989, 4(2): 12 -19 .
[5] . [J]. Remote Sensing Technology and Application, 1989, 4(3): 9 -14 .
[6] J.E.Lukens; 冯筠. [J]. Remote Sensing Technology and Application, 1990, 5(3): 68 -72 .
[7] Su-Hua-Che. [J]. Remote Sensing Technology and Application, 1990, 5(4): 70 .
[8] LIU Yong-Wei. [J]. Remote Sensing Technology and Application, 1990, 5(4): 73 .
[9] . [J]. Remote Sensing Technology and Application, 1991, 6(2): 60 -63 .
[10] . [J]. Remote Sensing Technology and Application, 1992, 7(1): 62 -65 .