Collect

Refresh Overview

Refresh processes can run on a schedule or can be manually initiated (targets can only be manually refreshed). Only active sources and tables are downloaded.

Sources are the original databases that the table data is read from. They can be manually refreshed or set to refresh on a schedule.

This section contains the following topics:

The Refresh icon is disabled for DBMoto® package types because the refresh process is run by DBMoto® instead of Collect. The DBMoto® option is only available if DBMoto® for Collect is installed.

Refresh Targets

Targets are destination SQL Server databases where the source data is refreshed. The target must be manually refreshed or have all the sources scheduled to refresh the data.

To manually refresh a target:

  1. Click Targets in Navigation pane.
  2. Select the Target.
  3. Click Refresh on Page toolbar; a confirmation message displays.
  4. Click Ok.

Manually Refresh Source

To manually refresh a source:

  1. Verify the source and the applicable tables are active.
  2. Click Targets in Navigation pane.
  3. Click Sources for Target.
  4. Select the Source.
  5. Click Build And Refresh on Page toolbar.

    NOTE: If the source is Syniti Connect, the table data is refreshed, but no packages are built.

  6. Click Ok.

NOTE:If packages for the tables already exist, they are only refreshed (i.e., data is pulled from the Source database). If packages for the tables do not exist, the packages are built and the tables are refreshed.

NOTE: When a Target Source of Syniti Connect is refreshed, a Boomi Process is executed.

Schedule Source Refresh

To refresh a source on a schedule:

  1. Verify the source and the applicable tables are active.
  2. Click Targets in Navigation pane.
  3. Click Sources for Target.
  4. Click Vertical View for Source.
  5. Click Advanced Settings tab.
  6. Click Edit.

    View the field descriptions for the Target Sources page's Vertical View

  7. Update Schedule ID list box if default value is not applicable.

    NOTE: The Schedule ID field determines when the refresh process is run. Schedules are created and maintained in Common. Refer to Create Schedules for detailed information.

  8. Click Save

Assign a Queue to a Refresh

By default, all refreshes use the queue ID set at the parameter level, on the Parameters - Collect page in Common. During the execution of large Collect refreshes (for example, multiple Stewardship Tier cores running powerful Application Servers processing waves in parallel), using a single queue can cause processing backlogs and inefficient Stewardship Tier usage. To address these issues, assign a queue for table refreshes at the target, target source or table level in Collect.

Refer to Add a Service Queue for more information.

If queue IDs are assigned at different levels, the Stewardship Tier applies them in this priority order:

1. Target source table

2. Target source

3. Target

4. Default (set on the Parameters - Collect page)

To assign a queue to refreshes at the table level, navigate to the Vertical View of the Tables page, and set the Queue ID on the Advanced Settings tab.

To assign a queue to refreshes at the target source level, navigate to the Vertical View of the Target Sources page, and set the Queue ID on the Advanced Settings tab.

To assign a queue to refreshes at the target level, navigate to the Vertical View of the Targets page, and set the Queue ID on the General tab.

Refresh Tables

If a table has schedule set to a value other than NULL, that schedule is used in calculating the next run date time. Tables can be manually refreshed or set to refresh on a schedule.

NOTE: To receive a workflow email that a table download has failed in Collect, a user must be assigned to a security role that has the Collect WebApp group WorkFlowFailureAll or WorkFlowFaiureByTargetAccess assigned. Refer to Set Security in System Administration for more information.

Manually Refresh Table

To manually refresh a table:

  1. Verify the table is active.
  2. Click Tables in Navigation pane to view a list of all tables for all sources.
  3. Select the Table.
  4. Click Build And Refresh on Page Toolbar to build package and download table from source; a confirmation message displays.
  5. Click Ok.

NOTE: If the package for the table already exists, it is only refreshed (i.e., data is pulled from the Source database). If the package for the table does not exist, the package is built and the table is refreshed. 

Schedule Table Refresh

To refresh a table on a schedule:

  1. Verify the table is active.
  2. Click Tables in Navigation pane to view a list of all tables for all sources.
  3. Click Vertical View for the Table.
  4. Click Advanced Settings tab.
  5. Click Edit.

    View the field descriptions for the Tables page's Vertical View

  1. Update Schedule ID list box if default value is not applicable.

    NOTE: The Schedule ID field determines when the tables are scheduled to be refreshed. The source schedule option applies to all tables where the Schedule field at the table level is set to NULL. Any schedule at the table level overrides the schedule set for the source.. Schedules are created and maintained in Common. Refer to Create Schedules for detailed information.

  1. Click Save