Martin Fowler described the “event sourcing” pattern more than 15 years ago. The idea is that software systems scale better when all changes to the system state are captured in a log and any service that needs a particular materialization of the state can compute it on the fly from the log. For example, if you have a series of updates to documents in your content management system (CMS), you can initialize the search indexes for the content using the history of these updates, rather than the latest state of the documents. This decouples the indexing system from the production…
Pub/Sub Lite is a new service from the Cloud Pub/Sub team which aims to provide an alternative, cost-focused Pub/Sub system. In particular, it provides a managed service for users who would consider running their own single-zone Apache Kafka cluster for price reasons. This post presents a comparison between Pub/Sub Lite, Pub/Sub and a self-managed Kafka configuration, as well as a walkthrough of how to try out your current Kafka workloads on Pub/Sub Lite.
Pub/Sub Lite shares more high-level concepts with Kafka than Cloud Pub/Sub does, being a partitioned log with progress tracked through advancing offsets. …
