Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Replication says finished, but actually has error

Description

While looking at Tasks -> Replication Tasks I see the jobs showing as Finished. However if you click on them to look at their status you see they are actually erroring with errors like:

[2021/08/06 09:30:08] INFO [replication_task__task_8.process] [zettarepl.transport.base_ssh. @ .replication_process.task_8] Warning: 'cannot receive org.truenas:man....ys.org/home: permission denied'

[2021/08/06 10:00:50] WARNING [replication_task__task_7] [zettarepl.replication.run] For task 'task_7' at attempt 1 recoverable replication error RecoverableReplicationError('cannot receive incremental stream: destination vol_1/backups/ /iocage/jails/sea-plex-01/root contains partially-complete state from "zfs receive -s".\nwarning: cannot send \'vol_1/iocage/jails/ /root@ auto_20210806_0000_Daily_sea-file-01\': signal received')
[2021/08/06 10:00:50] INFO [replication_task__task_7] [zettarepl.replication.run] After recoverable error sleeping for 1 seconds
[2021/08/06 10:00:52] INFO [replication_task__task_7] [zettarepl.replication.run] No snapshots to send for replication task 'task_7' on dataset 'vol_1/iocage'

[2021/08/06 12:22:01] INFO [replication_task__task_6.process] [zettarepl.transport.base_ssh. @ .replication_process.task_6] Warning: 'Warning: vol_1/backups/remote_....1.btsys.org: permission denied'

In all these cases, it appears the job ended in a failure, but no error was thrown.

Problem/Justification

None

Impact

None

Activity

Bug Clerk 
August 22, 2021 at 9:28 PM

Josh Wisely 
August 9, 2021 at 9:36 PM

That's a bit nuanced. Properties/metadata can be just as important as the actual data, for example permissions. It seems odd that failure to replicate such things isn't considered a failure.

 

At least bubbling up a warning status would be an improvement. Something to clue people in that they should look more closely at the state of things.

Vladimir Vinogradenko 
August 9, 2021 at 9:27 PM

it did not end with a failure, snapshots were transferred successfully. ZFS does not consider property setting failure an error and we have to follow this. However, our UI does not display replication warnings for some reason, so I am passing this ticket to our UI team.

Josh Wisely 
August 6, 2021 at 7:44 PM

Note this ticket is specifically about the UI not understanding that errors have occurred. I have seperate tickets for the actual errors themselves, and for the truncation of the error text.

Complete

Details

Assignee

Reporter

Labels

Time remaining

0m

Components

Fix versions

Affects versions

Priority

Katalon Platform

Created August 6, 2021 at 7:33 PM
Updated July 6, 2022 at 8:57 PM
Resolved August 30, 2021 at 11:56 AM