About Session
A case study by Marketo's Campaign team on how they built their next generation Marketing Campaign Processing Engine following Reactive System design principles. The system leverages various Akka modules and features - including but not limited to Akka Cluster, Cluster Sharding and Persistence - to build a near real-time, multi-tenant and stateful distributed system that is resilient and scalable.
The case study will cover the following topics: A unique multi-cluster architecture that can be deployed as a combination of dispatcher clusters and executor clusters for horizontal scalability on both cluster and tenant level. Dynamically controlling throughput, parallelism and fairness per tenant with exact once execution semantics.
Without being highly CPU intensive, the cluster can process more than 500 Million campaigns per day with as little as 11 VMs. Comparing to its homegrown legacy engine that ran on physical cores, this new Campaign Engine achieves 20 times throughput per tenant.
SHARE THIS TALK
SPEAKERS
Daniel Pugliese
Marketo, Senior Software Engineer
I've worked on the high level components and the low level libraries that are used by the distributed campaign processor at Marketo and enjoy taking on the challenges of a highly parallel system
Apurva Pawar
Marketo, Senior Software Engineer
I'm someone who likes thinking at scale, be it applications in Distributed Systems, Search Engines, Big Data, Analytics, Cloud, Virtualization, the Internet of Things, etc. I like challenges and solving problems in the above mentioned areas.
Currently @ Marketo working on a distributed realtime application as part of it's Orion initiative.
Dennis Bronnikov
Marketo, Staff Engineer
Coming soon
Pei-Chiang Ma
Marketo, Technical Fellow
Pei-Chiang Ma has worked at Marketo's platform team for the past 7+ years. Pei is the architect of Marketo's Campaign Execution platform; a next-generation reactive platform to power up both real-time trigger processing as well as a large volume of batch campaign execution. With his 20+ years of Silicon Valley experience, he has guided Marketo platform team to develop a highly scalable and reliable multi-tenant execution system using various Akka technologies.
View Schedule