Virtualizing stream processing

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

External Research Organisations

  • ETH Zurich
  • IBM Austin Research Laboratory
View graph of relations

Details

Original languageEnglish
Title of host publicationMiddleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings
Pages269-288
Number of pages20
Volume7049 LNCS
ISBN (electronic)9783642258213
Publication statusPublished - 2011
Externally publishedYes
Event12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011 - , Portugal
Duration: 12 Dec 201116 Dec 2011

Abstract

Stream processing systems have evolved into established solutions as standalone engines but they still lack flexibility in terms of large-scale deployment, integration, extensibility, and interoperability. In the last years, a substantial ecosystem of new applications has emerged that can potentially benefit from stream processing but introduces different requirements on how stream processing solutions can be integrated, deployed, extended, and federated. To address these needs, we present an exoengine architecture and the associated ExoP platform. Together, they provide the means for encapsulating components of stream processing systems as well as automating the data exchange between components and their distributed deployment. The proposed solution can be used, e.g., to connect heterogeneous streaming engines, replace operators at runtime, and migrate operators across machines with a negligible overhead.

Keywords

    federation, stream processing, virtualization

Cite this

Virtualizing stream processing. / Duller, Michel; Rellermeyer, Jan; Alonso, Gustavo et al.
Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings. Vol. 7049 LNCS 2011. p. 269-288.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Duller, M, Rellermeyer, J, Alonso, G & Tatbul, N 2011, Virtualizing stream processing. in Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings. vol. 7049 LNCS, pp. 269-288, 12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011, Portugal, 12 Dec 2011. https://doi.org/10.1007/978-3-642-25821-3_14
Duller, M., Rellermeyer, J., Alonso, G., & Tatbul, N. (2011). Virtualizing stream processing. In Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings (Vol. 7049 LNCS, pp. 269-288) https://doi.org/10.1007/978-3-642-25821-3_14
Duller M, Rellermeyer J, Alonso G, Tatbul N. Virtualizing stream processing. In Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings. Vol. 7049 LNCS. 2011. p. 269-288 doi: 10.1007/978-3-642-25821-3_14
Duller, Michel ; Rellermeyer, Jan ; Alonso, Gustavo et al. / Virtualizing stream processing. Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings. Vol. 7049 LNCS 2011. pp. 269-288
Download
@inproceedings{89f70dc3a90849fda6f6e1893c1750b3,
title = "Virtualizing stream processing",
abstract = "Stream processing systems have evolved into established solutions as standalone engines but they still lack flexibility in terms of large-scale deployment, integration, extensibility, and interoperability. In the last years, a substantial ecosystem of new applications has emerged that can potentially benefit from stream processing but introduces different requirements on how stream processing solutions can be integrated, deployed, extended, and federated. To address these needs, we present an exoengine architecture and the associated ExoP platform. Together, they provide the means for encapsulating components of stream processing systems as well as automating the data exchange between components and their distributed deployment. The proposed solution can be used, e.g., to connect heterogeneous streaming engines, replace operators at runtime, and migrate operators across machines with a negligible overhead.",
keywords = "federation, stream processing, virtualization",
author = "Michel Duller and Jan Rellermeyer and Gustavo Alonso and Nesime Tatbul",
year = "2011",
doi = "10.1007/978-3-642-25821-3_14",
language = "English",
isbn = "9783642258206",
volume = "7049 LNCS",
pages = "269--288",
booktitle = "Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings",
note = "12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011 ; Conference date: 12-12-2011 Through 16-12-2011",

}

Download

TY - GEN

T1 - Virtualizing stream processing

AU - Duller, Michel

AU - Rellermeyer, Jan

AU - Alonso, Gustavo

AU - Tatbul, Nesime

PY - 2011

Y1 - 2011

N2 - Stream processing systems have evolved into established solutions as standalone engines but they still lack flexibility in terms of large-scale deployment, integration, extensibility, and interoperability. In the last years, a substantial ecosystem of new applications has emerged that can potentially benefit from stream processing but introduces different requirements on how stream processing solutions can be integrated, deployed, extended, and federated. To address these needs, we present an exoengine architecture and the associated ExoP platform. Together, they provide the means for encapsulating components of stream processing systems as well as automating the data exchange between components and their distributed deployment. The proposed solution can be used, e.g., to connect heterogeneous streaming engines, replace operators at runtime, and migrate operators across machines with a negligible overhead.

AB - Stream processing systems have evolved into established solutions as standalone engines but they still lack flexibility in terms of large-scale deployment, integration, extensibility, and interoperability. In the last years, a substantial ecosystem of new applications has emerged that can potentially benefit from stream processing but introduces different requirements on how stream processing solutions can be integrated, deployed, extended, and federated. To address these needs, we present an exoengine architecture and the associated ExoP platform. Together, they provide the means for encapsulating components of stream processing systems as well as automating the data exchange between components and their distributed deployment. The proposed solution can be used, e.g., to connect heterogeneous streaming engines, replace operators at runtime, and migrate operators across machines with a negligible overhead.

KW - federation

KW - stream processing

KW - virtualization

U2 - 10.1007/978-3-642-25821-3_14

DO - 10.1007/978-3-642-25821-3_14

M3 - Conference contribution

SN - 9783642258206

VL - 7049 LNCS

SP - 269

EP - 288

BT - Middleware 2011 - ACM/IFIP/USENIX 12th International Middleware Conference, Proceedings

T2 - 12th ACM/IFIP/USENIX International Middleware Conference, Middleware 2011

Y2 - 12 December 2011 through 16 December 2011

ER -

By the same author(s)