Authors:
Matthias Boehm
;
Dirk Habich
and
Wolfgang Lehner
Affiliation:
Dresden University of Technology, Germany
Keyword(s):
Integration processes, Multi-process optimization, Message queues, Throughput improvement.
Related
Ontology
Subjects/Areas/Topics:
Coupling and Integrating Heterogeneous Data Sources
;
Databases and Information Systems Integration
;
e-Business
;
Enterprise Information Systems
;
Middleware Integration
;
Middleware Platforms
;
Technology Platforms
Abstract:
Message-oriented integration platforms execute integration processes—in the sense of workflow-based process specifications of integration tasks—in order to exchange data between heterogeneous systems and applications. The overall optimization objective is throughput maximization, i.e., maximizing the number of processed messages per time period. Here, moderate latency time of single messages is acceptable. The efficiency of the central integration platform is crucial for enterprise data management because both the data consistency between operational systems and the up-to-dateness of analytical query results depend on it. With the aim of integration process throughput maximization, we propose the concept of multi-process optimization (MPO). In this approach, messages are collected during a waiting period and executed in batches to optimize sequences of process instances of a single process plan. We introduce a horizontal—and thus, valuebased—partitioning approach for message batch cr
eation and show how to compute the optimal waiting time with regard to throughput maximization. This approach significantly reduces the total processing time of a message sequence and hence, it maximizes the throughput while accepting moderate latency time.
(More)