You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardexpand all lines: stored-procedures/sp_cdc_DynamoDB_to_Redshift/ReadMe.md
+18
Original file line number
Diff line number
Diff line change
@@ -130,3 +130,21 @@ Sample IAM role will look like this.
130
130
]
131
131
}
132
132
```
133
+
134
+
135
+
136
+
#### Observations from CDC (change data capture) performance testing between DynamoDB and Redshift.
137
+
1. Not all records showed up in the KDS stream / Materialized View right away - Sometime it took two iterations.It is important to design KDS for throughput and latency.
138
+
2. Single record update is not that different from group of records.
139
+
3. Providing a minute for KDS to catch up and then run this process is recommended and
140
+
4. Update/Delete/New record changes are running in the same time window and has no considerable difference between type of CDC image in terms of processing times.
141
+
5. Initial execution is slower than next runs. This should normalize if this process is running every 15 mins on schedule.
142
+
6. Better suited for Near - Real time use cases with 15 min window.
0 commit comments