The engineering teams within Splunk have been using several technologies Kinesis, SQS, RabbitMQ and Apache Kafka for enterprise wide messaging for the past few years but have recently made the decision to pivot toward Apache Pulsar, migrating both existing use cases and embedding it into new cloud-native service offerings such as the Splunk Data Stream Processor (DSP).
Karthik Ramasamy is a Sr. Director of Engineering at Splunk. Before Splunk, he was co-founder and CEO of Streamlio where he focused on building the next generation real time processing engine based on Apache Pulsar. He previously served as the engineering manager and technical lead for real-time analytics at Twitter where he co-created Twitter Heron. He has two decades of experience working in parallel databases, big data infrastructure, and networking. Karthik is the author of several publications, patents, and 'Network Routing: Algorithms, Protocols and Architectures'. He has a Ph.D. in computer science from the University of Wisconsin, Madison with a focus on big data and databases.