EMeD-Part: An efficient methodology for horizontal partitioning in data warehouses

Lyazid Toumi, Abdelouahab Moussaoui, Ahmet Ugur

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations

Abstract

Nowadays, data warehouses store Peta-bytes of data. Queries defined on data warehouses are generally complex. Several techniques are used for optimizing queries in data warehouses such as indexes, partitioning and materialized views. Selecting the best configuration of indexes, or partitions or materialized views are all NP-hard. Here, we focus on the horizontal partitioning problem in data warehouses. Several approaches were proposed for solving horizontal partitioning problem in data warehouses including genetic algorithms using a small set of query workload in general. We present a new methodology based on data mining and particle swarm optimization for solving the horizontal partitioning problem in data warehouses using relatively large query workload. First, we compute attraction between predicates followed by a hierarchical clustering of predicates. In the second step, we use discrete particle swarm optimization for selecting the best partitioning schema. Several experiments are performed to demonstrate the effectiveness of the proposed approach and the results are compared to the best well known method so far, the genetic algorithm based approach. The proposed approach is found to be faster and more effective than the genetic algorithm based approach for solving the data warehouse horizontal partitioning.

Original languageEnglish
Title of host publicationProceedings of the International Conference on Intelligent Information Processing, Security and Advanced Communication, IPAC 2015
EditorsDjallel Eddine Boubiche, Faouzi Hidoussi, Homero Toral Cruz
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450334587
DOIs
StatePublished - Nov 23 2015
EventInternational Conference on Intelligent Information Processing, Security and Advanced Communication, IPAC 2015 - Batna, Algeria
Duration: Nov 23 2015Nov 25 2015

Publication series

NameACM International Conference Proceeding Series
Volume23-25-November-2015

Conference

ConferenceInternational Conference on Intelligent Information Processing, Security and Advanced Communication, IPAC 2015
Country/TerritoryAlgeria
CityBatna
Period11/23/1511/25/15

Keywords

  • Data mining
  • Data warehouses physical design
  • Horizontal partitioning
  • Particle swarm optimization

Fingerprint

Dive into the research topics of 'EMeD-Part: An efficient methodology for horizontal partitioning in data warehouses'. Together they form a unique fingerprint.

Cite this