Implementation of a transport system with stateful consumers

dc.contributor.authorSÖDERBERG, MATHIAS
dc.contributor.authorHALLBERG, GUSTAF
dc.contributor.departmentChalmers tekniska högskola / Institutionen för tillämpad informationsteknologi (Chalmers)sv
dc.contributor.departmentChalmers University of Technology / Department of Applied Information Technology (Chalmers)en
dc.date.accessioned2019-07-03T13:17:08Z
dc.date.available2019-07-03T13:17:08Z
dc.date.issued2013
dc.description.abstractWhen handling large amounts of data, parallel processing is key. Distributed computation makes Big Data work, but it presents new challenges for scaling and reliability. These challenges are made even more interesting when computations are stateful, and done in near real-time as in stream processing. To make a stateful distributed system scalable and resilient to failures, a framework for message passing and state persistence is needed. As of today no such system is available but the components are all there to build one. This thesis gives an outline of how such a framework could be constructed using Apache ZooKeeper and Apache Kafka, describing algorithms and components which could be used for such a system. Also provided are some experimental performance benchmarks of Kafka running in Amazon's EC2 cloud, to use as a measuring stick for its viability as a transport system for messages.
dc.identifier.urihttps://hdl.handle.net/20.500.12380/183775
dc.language.isoeng
dc.setspec.uppsokHumanitiesTheology
dc.subjectInteraktionsteknik
dc.subjectInteraction Technologies
dc.titleImplementation of a transport system with stateful consumers
dc.type.degreeExamensarbete för masterexamensv
dc.type.degreeMaster Thesisen
dc.type.uppsokH
Ladda ner
Original bundle
Visar 1 - 1 av 1
Hämtar...
Bild (thumbnail)
Namn:
183775.pdf
Storlek:
381.07 KB
Format:
Adobe Portable Document Format
Beskrivning:
Fulltext