How overnight processing works
Zap Data Hub treats the current and previous financial years as Recent. During the nightly incremental process:
Recent years update automatically.
Adjustments from your data sources, such as Xero, MYOB and QuickBooks, are captured.
The Recent pipelines populate the Recent table, which includes only these two years.
This ensures fast, efficient updates for currently active reporting periods.
What counts as historical data
Any client adjustments that fall into older prior years, for example, 2023/2024 and earlier, are stored in the Historical table. Historical data has the following characteristics:
Historical pipelines are set to load once.
Data does not update during incremental overnight processing.
Zap Data Hub does not automatically refresh older years unless manually triggered.
This design reduces processing time and ensures efficient nightly updates.
Update historical data
A Full refresh is required to update historical data. This forces Zap Data Hub to reload all pipelines, including Historical.
đ¤Tip: If only one client requires historical updates, you can run a per-company Full refresh instead of refreshing the entire model. See How to process a single company in Zap Data Hub for instructions.