Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Kubernetes unusable after adding 2nd network bridge to Scale

Description

I added a second bridge to my network config, with no external interfaces, with the intent of direct VM to NAS communication.

Upon hitting "Test", things went downhill. Apps do not show in Truenas UI, and they are not accessible via port. I did not commit the change, and 2nd bridge is gone as expected.

systemctl status kube-router shows active, but there are messages stating:

... network_services_controller.go:151] Failed to replace route to service VIP 192.168.xx.xx (NAS IP on br0) configured on kube-dummy-if. Error: exit status 2 ....

k3s kubectl get nodes

Unable to connect to the server: dial tcp 127.0.0.1:6443: i/o timeout

I cannot save debug logs from UI as it hangs on "Dump Kubernetes Information"

What can I do to bring this back to life?

Problem/Justification

None

Impact

None

Activity

Show:

Bug Clerk February 4, 2022 at 6:37 PM

Muhammad February 4, 2022 at 5:14 PM

, can you confirm that after each reboot you have the problem of being unable to list or consume apps? If that's correct,may we set up a teamviewer session today?The network issue is separate i think..

Mike February 2, 2022 at 8:20 PM

Hi.  Reboots did not seem to help, however going through console and removing and re-adding devices to the main bridge0 seemed to 'shake' it loose. 

I have since rebuilt the entire truenas as I needed to make some hardware adjustments anyways.  I still see however that any network changes in UI do not take effect until I reboot the server.  If I change anything in UI, I lose contact with the br0 IP, until I reboot from console option 6.  

Muhammad February 2, 2022 at 8:54 AM

can you please confirm if you are able to reproduce the issue after a reboot of the system?I'll meanwhile go through the provided debug output and see if i can find something meaningful..

Bonnie Follweiler January 31, 2022 at 5:13 PM

Thank you .

This ticket is now in our queue to review.

An engineering representative will update with any further questions or details in the near future.

Complete

Details

Assignee

Reporter

Labels

Impact

High

Time remaining

0m

Fix versions

Affects versions

Priority

Katalon Platform

Created January 27, 2022 at 8:33 PM
Updated July 1, 2022 at 5:54 PM
Resolved February 4, 2022 at 7:59 PM