Shadow z/Events

The Shadow z/Events architecture is designed for high-performance, real-time data integration on z/OS. The core components include the Event Capture Engine, which monitors the specified databases (IMS, DB2, ADABAS, CA IDMS, and VSAM) for changes; the Event Processing Engine, which transforms and filters the captured events based on predefined rules; and the Publication Engine, which distributes the processed events to various destinations via HTTP/HTTPS or WebSphere MQ. These components communicate using internal messaging, ensuring efficient data flow.

The Event Capture Engine utilizes database-specific APIs to detect changes, minimizing the impact on database performance. The Event Processing Engine supports complex event processing, allowing for data enrichment and transformation. The Publication Engine supports various output formats, including JSON and XML.

The system uses VSAM or other database storage mechanisms for event persistence, ensuring data durability. Configuration is primarily managed through JCL and configuration files, providing detailed control over event capture, processing, and publication. The REST APIs provide a standardized interface for integration with external systems.

Security is implemented through authentication mechanisms and comprehensive logging. Compared to IBM InfoSphere CDC, Shadow z/Events offers specific advantages in its support for VSAM and other z/OS-specific databases. This architecture ensures scalability and reliability, making it suitable for handling large volumes of database change events.