ComputingComputer ScienceData ManagementDatabasesParallel ComputingData ParallelismDatabase ManagementDistributed Data ProcessingQuery OptimizationQuery ProcessingStructured Query LanguageExecution Time AnalysisMapreduceMapreduce AlgorithmsParallel Query ProcessingQuery Performance OptimizationQuery RewriteQuery Rewrite RulesQuery Rewriting
Although HiveQL offers similar features with SQL, it is still difficult to map complex SQL queries into HiveQL and manual translation often leads to poor performance. A tool named QMapper is developed to address this problem by utilizing query rewriting rules and cost-based MapReduce flow evaluation on the basis of column statistics. Evaluation demonstrates that while assuring the correctness, QMapper improves the performance up to 42% in terms of execution time.
3
YSmart: Yet Another SQL-to-MapReduce Translator
Query optimization using column statistics in hive
Anja Gruenheid, Edward Omiecinski, Leo Mark · 2011 · 27 citations