Understand overnight processing
Zap Data Hub treats the current and previous financial years as Recent:
These years update automatically during the nightly incremental process
Adjustments from your data sources (e.g., Xero, MYOB, QuickBooks) are captured
The Recent pipelines populate the Recent table, which includes only these two years
This ensures fast, efficient updates for currently active reporting periods.
What counts as historical data
Any client adjustments that fall into older prior years (e.g., 2023/2024 and earlier) are stored in the Historical table.
Characteristics of historical data:
Historical pipelines are set to Load Once
Data does not update during incremental overnight processing
Zap Data Hub does not automatically refresh older years unless manually triggered
This design reduces processing time and ensures efficient nightly updates.
Update historical data
1. Perform a Full Refresh
A Full Refresh is required to update historical data.
This forces Zap Data Hub to reload all pipelines, including Historical.
2. Run a Full Refresh for a single company (optional)
If only one client requires historical updates, you can run a per‑company Full Refresh instead of refreshing the entire model.
For instructions, see: How to process a single company in Zap Data Hub