Delete duplicate records
  • Updated on 30 Jun 2020
  • 1 minute to read
  • Contributors
  • Print
  • Share
  • Dark
    Light

Delete duplicate records

  • Print
  • Share
  • Dark
    Light

The unique fields feature allows you to automatically remove duplicate records from your data set.

  1. In the Web Console, open the agent or collection.
  2. Select Data > Fields from the toolbar.
  3. Select the fields.
Helpful tip

Choose fields that contain unique data, such as an SKU, address, or ISBN. The data gathered between agent jobs will be compared based on the field(s) you've selected. Avoid fields that are subject to change, such as price or quantity.

  1. Click Set unique fields.
  2. Click Continue to delete duplicate records matching the unique field(s).
Keep in mind
  • If you remove the unique fields, duplicates will reappear the next time you run the agent.
  • You can't add unique fields that are at the agent group-level on the agent level. You need to do that in the agent group.
Was this article helpful?