Reducing Data Usage and Optimising your OdataLink Feeds: Difference between revisions
mNo edit summary |
m moved from wiki URL to mediawiki reference links |
||
| Line 39: | Line 39: | ||
This applies a date filter at the source and reduces every download. | This applies a date filter at the source and reduces every download. | ||
[ | [[Default Date Range|How to set a default date range →]] | ||
=== 4. Enable Polling for Changes === | === 4. Enable Polling for Changes === | ||
| Line 45: | Line 45: | ||
Polling allows OdataLink to detect and pull only the records that have changed in your accounting file, rather than re-downloading the full dataset on every refresh. | Polling allows OdataLink to detect and pull only the records that have changed in your accounting file, rather than re-downloading the full dataset on every refresh. | ||
[ | [[Configure OdataLink to poll for changes|How to configure polling →]] | ||
<br /> | <br /> | ||
| Line 63: | Line 63: | ||
# Verify folding by right-clicking a step in Power Query → **View Native Query**. If the option is greyed out, the filter is no longer folding and is being applied client-side. | # Verify folding by right-clicking a step in Power Query → **View Native Query**. If the option is greyed out, the filter is no longer folding and is being applied client-side. | ||
[ | [[Model Date Filters and Report Date Filters| Model Date Filters vs Report Date Filters →]] | ||
=== 6. Use Incremental Refresh for time-series data === | === 6. Use Incremental Refresh for time-series data === | ||
| Line 105: | Line 105: | ||
<span style="color:navy"><blockquote>This pattern works in **SSIS** (OData Source component, parameterised URL), **Azure Data Factory** / **Fabric Data Pipelines** (Copy Activity with dynamic OData query), and any custom .NET / Python loader.</blockquote></span> | <span style="color:navy"><blockquote>This pattern works in **SSIS** (OData Source component, parameterised URL), **Azure Data Factory** / **Fabric Data Pipelines** (Copy Activity with dynamic OData query), and any custom .NET / Python loader.</blockquote></span> | ||
[ | [[OData Feed URLs| OdataLink OData URL structure and query parameters →]] | ||
=== 9. Select only the columns you need with `$select` === | === 9. Select only the columns you need with `$select` === | ||