Hybrid Warehouse Model and Solutions for Climate Data Analysis

• 作者: Hasan Hashim
• 来源期刊: 电脑和通信(英文)
• 学科: 工学
• 关键词: Data Warehouse HADOOP NCDC Data Set WEATHER
• 年，卷（期）: 2020,（10）
• 页码范围: 75-98
• 页数: 24页
• 分类号: TP3

摘要

Recently, due to the rapid growth increment of data sensors, a massive volume of data is generated from different sources. The way of administering such data in a sense storing, managing, analyzing, and extracting insightful information from the massive volume of data is a challenging task. Big data analytics is becoming a vital research area in domains such as climate data analysis which demands fast access to data. Nowadays, an open-source platform namely MapReduce which is a distributed computing framework is widely used in many domains of big data analysis. In our work, we have developed a conceptual framework of data modeling essentially useful for the implementation of a hybrid data warehouse model to store the features of National Climatic Data Center (NCDC) climate data. The hybrid data warehouse model for climate big data enables for the identification of weather patterns that would be applicable in agricultural and other similar climate change-related studies that will play a major role in recommending actions to be taken by domain experts and make contingency plans over extreme cases of weather variability.