Replication says finished, but actually has error

Description

While looking at Tasks -> Replication Tasks I see the jobs showing as Finished. However if you click on them to look at their status you see they are actually erroring with errors like:

[2021/08/06 09:30:08] INFO [replication_task__task_8.process] [zettarepl.transport.base_ssh. @ .replication_process.task_8] Warning: 'cannot receive org.truenas:man....ys.org/home: permission denied'

[2021/08/06 10:00:50] WARNING [replication_task__task_7] [zettarepl.replication.run] For task 'task_7' at attempt 1 recoverable replication error RecoverableReplicationError('cannot receive incremental stream: destination vol_1/backups/ /iocage/jails/sea-plex-01/root contains partially-complete state from "zfs receive -s".\nwarning: cannot send \'vol_1/iocage/jails/ /root@ auto_20210806_0000_Daily_sea-file-01\': signal received')
[2021/08/06 10:00:50] INFO [replication_task__task_7] [zettarepl.replication.run] After recoverable error sleeping for 1 seconds
[2021/08/06 10:00:52] INFO [replication_task__task_7] [zettarepl.replication.run] No snapshots to send for replication task 'task_7' on dataset 'vol_1/iocage'

[2021/08/06 12:22:01] INFO [replication_task__task_6.process] [zettarepl.transport.base_ssh. @ .replication_process.task_6] Warning: 'Warning: vol_1/backups/remote_....1.btsys.org: permission denied'

In all these cases, it appears the job ended in a failure, but no error was thrown.

Problem/Justification

None

Impact

None

Activity

Show:

Bug Clerk

August 22, 2021 at 9:28 PM

21.10 PR: https://github.com/truenas/webui/pull/5807

Josh Wisely

August 9, 2021 at 9:36 PM

That's a bit nuanced. Properties/metadata can be just as important as the actual data, for example permissions. It seems odd that failure to replicate such things isn't considered a failure.

At least bubbling up a warning status would be an improvement. Something to clue people in that they should look more closely at the state of things.

Vladimir Vinogradenko

August 9, 2021 at 9:27 PM

@Josh Wisely it did not end with a failure, snapshots were transferred successfully. ZFS does not consider property setting failure an error and we have to follow this. However, our UI does not display replication warnings for some reason, so I am passing this ticket to our UI team.

Josh Wisely

August 6, 2021 at 7:44 PM

Note this ticket is specifically about the UI not understanding that errors have occurred. I have seperate tickets for the actual errors themselves, and for the truncation of the error text.

Resize issue view side panel

Complete

Details

Assignee

Damian Szidiropulosz

Reporter

Josh Wisely

Labels

Time remaining

Priority

Low

Katalon Platform

Created August 6, 2021 at 7:33 PM

Updated July 6, 2022 at 8:57 PM

Resolved August 30, 2021 at 11:56 AM

Replication says finished, but actually has error

Description

Problem/Justification

Impact

Activity

Details

Assignee

Reporter

Labels

Time remaining

Components

Fix versions

Affects versions

Priority

Katalon Platform