Change harvesting error behavior

Mozenda agents can produce errors when a website updates. When this happens, you might need to make small changes to your agent to react to these changes and read new information. To change how your agents react to website updates, you can adjust Harvesting settings.

Ignore errors and continue

You can set up an agent to ignore the error and continue to gather data or set it up to stop at an error. By default, Mozenda will ignore errors and try to keep going.
To change this:
In the Web Console:

1. Select Agents > All Agents.
2. Select an agent.
3. Select
4. Select Harvesting.
   

5. Select Error Handling .
6. Select Attempt to ignore the error and continue.
7. Select Let the system decide what to do.
8. Select SAVE.

Stop on error

If 100% accuracy in your dataset is essential or if you are looking for one output per input, adjust your settings to the following:
In the Web Console:

1. Select Agents > All Agents.
2. Select an agent.
3. Select .
4. Select Harvesting.
5. Select the Error Handling tab.
6. Select Stop the job so the agent can be fixed in both the When an agent errors occur and When a website error occur menu.
7. Select SAVE.

The agent will stop when an error occurs so you can fix it. This ensures that your data set is complete and accurate.

Let the system decide

In most cases you can use the Let the system decide what to do option under When a website error occurs. Mozenda has categorized what website errors to ignore and what website errors to fix so you can achieve the best results.

It is important to notice that these errors are usually caused by changes in website format or development. Websites change all of the time, and it often can be the case that once these changes happen, your agent will run into errors.

If 100% accuracy in your data set is essential or if you are looking for one output per input, adjust your settings to the following:

In the Web Console:

1. Select Agents > All Agents.
2. Select an agent.
3. Select .
4. Select Harvesting.
5. Select the Error Handling tab.
6. Select Stop the job so the agent can be fixed in both the When an agent errors occur and When a website error occur menu.
7. Select SAVE.

Harvest data from a desktop-sized browser window

Some sites change information locations or show different information when they are re-sized for different screen widths or resolutions (like a typical desktop size that is usually more than 1280 pixels wide vs. mobile size that might be as narrow as 450 pixels).

Modern coding practices suggest you can get to the same information on either your phone or desktop, but that's not always true. To be safe, harvest from a desktop-sized resolution to make sure you're getting the most detailed information.

In the Web Console:

1. Select Agents > All Agents.
2. Select an agent.
3. Select .
4. Select Harvesting.
5. Select the Advanced tab.
6. Select Maximize the browser windows during processing.
7. Select SAVE.