---
title: "How to delete duplicated data records - Mozenda scraper tool"
slug: "how-to-set-unique-fields-in-the-web-console"
description: "The unique fields feature allows you to automatically remove duplicates records from your data set. Delete duplicated data records with Mozenda scraper tool"
tags: ["cancel", "remove", "copies", "double", "repetition", "repetitive", "data", "report", "info"]
updated: 2024-05-14T13:55:31Z
published: 2024-05-14T13:55:31Z
canonical: "help.mozenda.com/how-to-set-unique-fields-in-the-web-console"
---

> ## Documentation Index
> Fetch the complete documentation index at: https://help.mozenda.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Delete duplicate records

The unique fields feature allows you to automatically remove duplicate records from your data set.

In the Web Console:

1. Select **Agents** > **Agents** or **Collections**.
2. Select the name of the agent or collections.
3. Select  **Fields**.
4. Select the fields to be unique.

          Helpful tip

          

Choose fields that contain unique data, such as an SKU, address, or ISBN. The data gathered between agent jobs will be compared based on the field(s) you've selected. Avoid fields that are subject to change, such as price or quantity.

1. Select **Set unique fields**.
2. Select **UPDATE FIELDS** to delete duplicate records matching the unique field(s).

          Keep in mind

          

- If you remove the unique fields, duplicates will display the next time you run the agent.
- You can't add unique fields that are at the agent group-level on the agent level. You need to do that in the agent group.

![gif2.gif](https://cdn.document360.io/03076343-9561-4857-8a4e-9f3bfed20ced/Images/Documentation/gif2.gif)