2013 · 10 citations · 3 references
ComputingComputer ScienceData ManagementDatabasesStorage SystemsData Storage SystemsDatabase ManagementQuery OptimizationQuery ProcessingRelational AlgebraRelational DatabasesQuery Performance Optimization
Huge amount of data is stored by different kinds of applications for further analysis. Relational databases were used for decades as data storages, but in some cases they are not suitable for Big Data processing. To solve the problem, non-relational databases were developed. As a help for transferring data from relational databases to non-relational databases, adequate tools were developed. In this paper, a tool named Sqoop is presented. The issue of query optimization should be addressed by all applications that deal with large amounts of data, regardless of their field of application and scope. The impact of cluster characteristics on HiveQL query optimization is analyzed in this paper.
3
Hive - a petabyte scale data warehouse using Hadoop
Ashish Thusoo, Joydeep Sen Sarma, Namit Jain et al. · 2010 · 925 citations
Query optimization using column statistics in hive
Anja Gruenheid, Edward Omiecinski, Leo Mark · 2011 · 27 citations
Yingzhong Xu, Songlin Hu · 2013 · 18 citations