Conference Program

JUNE 17-18, 2020 | MESSAGING & STREAMING EVERYWHERE

Event propagation across microservices using Pulsar and CDC.

11:00 AM - 11:40 AM PDT, June 17, 2020 | Track 2

Modern distributed database systems often process terabyte-to-petabyte scale data with demanding analytics workloads while undergoing constant transactional updates. This leads to architectures involving multiple purpose-built systems that need to interact. For example, a write-oriented system to capture time-series data for Internet of Things (IoT) applications needs to share updates to a search-oriented system for analytics and queries. The velocity of change of data requires a similarly scaled messaging bus to keep these disparate systems in sync.
This talk will examine an architecture comprising a column-oriented NoSQL database (Scylla) using Change Data Capture to identify updates that need to be shared with a search engine (Elasticsearch), using Apache Pulsar as the scalable and performant mechanism for synchronization.
Users will learn how to configure Apache Pulsar to consume Change Data Capture (CDC) updates coming from a Cassandra Query Language (CQL) based NoSQL database and provide them to an Elasticsearch downstream consumer which uses Elastic Common Schema. The advantages of using Pulsar for a scalable, high-throughput, low-latency intermediary over other existing methods (Apache Kafka, Lightbeam Akka and message queuing services) will be highlighted.

Ecosystem

Maheedhar Gunturu

Maheedhar Gunturu is a Solutions Architect at ScyllaDB. Prior to ScyllaDB, Maheedhar held senior roles both in engineering and sales organizations. He has over a decade of experience designing & developing server-side applications in the cloud and working on big data and ETL frameworks in companies such as Samsung, MapR, Apple, VoltDB, Zscaler and Qualcomm. He holds a master's in Electrical and computer engineering from the University of Texas at San Antonio.

Eyal Gutkind

Eyal Gutkind is VP of Solutions for Scylla. Prior to Scylla Eyal held product management roles at Mirantis and DataStax. Prior to DataStax Eyal spent 12 years with Mellanox Technologies in various engineering management and product marketing roles.Eyal holds a BSc. degree in Electrical and Computer Engineering from Ben Gurion University, Israel and MBA from Fuqua School of Business at Duke University, North Carolina.