[Verse 1]
When regions fall and brokers break down
Controllers lose their quorum crown
Network partitions split the ground
Active-active keeps us sound
We test the paths when systems fail
Document each recovery trail
[Chorus]
RTO RPO measure the time
Recovery Target Objective in line
Recovery Point Objective defined
Test the failover every time
No messages lost in the switch
Data integrity without a glitch
Document results for compliance needs
Failover testing succeeds
[Verse 2]
Region failure hits us hard
But active-active stands on guard
Multiple zones keep data flowing
Backup systems always knowing
When the primary can't respond
Failover creates a backup bond
[Chorus]
RTO RPO measure the time
Recovery Target Objective in line
Recovery Point Objective defined
Test the failover every time
No messages lost in the switch
Data integrity without a glitch
Document results for compliance needs
Failover testing succeeds
[Verse 3]
Broker failure breaks the chain
But redundancy handles the strain
Controller quorum needs majority vote
When it's lost the system won't float
Network partitions split the mesh
But planning keeps the data fresh
[Bridge]
Instrument the recovery flow
Measure metrics that you need to know
How long until the system's back
Verify there's nothing that you lack
No duplicates unless expected
Every message gets protected
[Chorus]
RTO RPO measure the time
Recovery Target Objective in line
Recovery Point Objective defined
Test the failover every time
No messages lost in the switch
Data integrity without a glitch
Document results for compliance needs
Failover testing succeeds
[Verse 4]
Post-failover verification starts
Check the data in all parts
Count the messages received
Make sure none were misconceived
Document findings for the audit trail
Contingency planning will not fail
[Outro]
When disaster strikes your infrastructure
Resilience testing is your cure
Evidence documented clear and bright
Incident response done right
Failover ready, systems strong
Defense delivery all along