subm_random_fail-20200514

2020-05-14T14:17:59.9226704Z ##[section]Starting: Request a runner to run this job
2020-05-14T14:18:00.5804915Z Can't find any online and idle self-hosted runner in current repository that matches the required labels: 'ubuntu-latest'
2020-05-14T14:18:00.5804947Z Can't find any online and idle self-hosted runner in current repository's account/organization that matches the required labels: 'ubuntu-latest'
2020-05-14T14:18:00.5804962Z Found online and idle hosted runner in current repository's account/organization that matches the required labels: 'ubuntu-latest'
2020-05-14T14:18:00.7763685Z ##[section]Finishing: Request a runner to run this job
2020-05-14T14:18:08.0061731Z Current runner version: '2.169.1'
2020-05-14T14:18:08.0087438Z ##[group]Operating System
2020-05-14T14:18:08.0088003Z Ubuntu
2020-05-14T14:18:08.0088186Z 18.04.4
2020-05-14T14:18:08.0088349Z LTS
2020-05-14T14:18:08.0088466Z ##[endgroup]
2020-05-14T14:18:08.0088640Z ##[group]Virtual Environment
2020-05-14T14:18:08.0088858Z Environment: ubuntu-18.04
2020-05-14T14:18:08.0089072Z Version: 20200430.1
2020-05-14T14:18:08.0089271Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu18/20200430.1/images/linux/Ubuntu1804-README.md
2020-05-14T14:18:08.0089492Z ##[endgroup]
2020-05-14T14:18:08.0090532Z Prepare workflow directory
2020-05-14T14:18:08.0286578Z Prepare all required actions
2020-05-14T14:18:08.0296986Z Download action repository 'actions/checkout@master'
2020-05-14T14:18:09.9600435Z ##[group]Run actions/checkout@master
2020-05-14T14:18:09.9600775Z with:
2020-05-14T14:18:09.9601292Z   repository: submariner-io/submariner
2020-05-14T14:18:09.9601747Z   token: ***
2020-05-14T14:18:09.9601955Z   ssh-strict: true
2020-05-14T14:18:09.9602117Z   persist-credentials: true
2020-05-14T14:18:09.9602447Z   clean: true
2020-05-14T14:18:09.9602558Z   fetch-depth: 1
2020-05-14T14:18:09.9602715Z   lfs: false
2020-05-14T14:18:09.9602955Z   submodules: false
2020-05-14T14:18:09.9603149Z ##[endgroup]
2020-05-14T14:18:10.8970807Z Syncing repository: submariner-io/submariner
2020-05-14T14:18:10.8971177Z ##[group]Getting Git version info
2020-05-14T14:18:10.8971700Z Working directory is '/home/runner/work/submariner/submariner'
2020-05-14T14:18:10.8971938Z [command]/usr/bin/git version
2020-05-14T14:18:10.8972173Z git version 2.26.2
2020-05-14T14:18:10.8972942Z ##[endgroup]
2020-05-14T14:18:10.8973258Z Deleting the contents of '/home/runner/work/submariner/submariner'
2020-05-14T14:18:10.8973976Z ##[group]Initializing the repository
2020-05-14T14:18:10.8974177Z [command]/usr/bin/git init /home/runner/work/submariner/submariner
2020-05-14T14:18:10.8974313Z Initialized empty Git repository in /home/runner/work/submariner/submariner/.git/
2020-05-14T14:18:10.8974808Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner
2020-05-14T14:18:10.8975041Z ##[endgroup]
2020-05-14T14:18:10.8975217Z ##[group]Disabling automatic garbage collection
2020-05-14T14:18:10.8975592Z [command]/usr/bin/git config --local gc.auto 0
2020-05-14T14:18:10.8975733Z ##[endgroup]
2020-05-14T14:18:10.8977637Z ##[group]Setting up auth
2020-05-14T14:18:10.8978222Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2020-05-14T14:18:10.8978731Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2020-05-14T14:18:10.8979225Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2020-05-14T14:18:10.8979827Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2020-05-14T14:18:10.8980476Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2020-05-14T14:18:10.8980716Z ##[endgroup]
2020-05-14T14:18:10.8980946Z ##[group]Fetching the repository
2020-05-14T14:18:10.8981572Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +6970a392cc361a43e7e0ce235f949784a00d9f93:refs/remotes/pull/565/merge
2020-05-14T14:18:10.8981854Z remote: Enumerating objects: 206, done.
2020-05-14T14:18:10.8982035Z remote: Counting objects:   0% (1/206)
2020-05-14T14:18:10.8982213Z remote: Counting objects:   1% (3/206)
2020-05-14T14:18:10.8982414Z remote: Counting objects:   2% (5/206)
2020-05-14T14:18:10.8982540Z remote: Counting objects:   3% (7/206)
2020-05-14T14:18:10.8982712Z remote: Counting objects:   4% (9/206)
2020-05-14T14:18:10.8983078Z remote: Counting objects:   5% (11/206)
2020-05-14T14:18:10.8983251Z remote: Counting objects:   6% (13/206)
2020-05-14T14:18:10.8983457Z remote: Counting objects:   7% (15/206)
2020-05-14T14:18:10.8983597Z remote: Counting objects:   8% (17/206)
2020-05-14T14:18:10.8983772Z remote: Counting objects:   9% (19/206)
2020-05-14T14:18:10.8983946Z remote: Counting objects:  10% (21/206)
2020-05-14T14:18:10.8984132Z remote: Counting objects:  11% (23/206)
2020-05-14T14:18:10.8984304Z remote: Counting objects:  12% (25/206)
2020-05-14T14:18:10.8984425Z remote: Counting objects:  13% (27/206)
2020-05-14T14:18:10.8984598Z remote: Counting objects:  14% (29/206)
2020-05-14T14:18:10.8984867Z remote: Counting objects:  15% (31/206)
2020-05-14T14:18:10.8985057Z remote: Counting objects:  16% (33/206)
2020-05-14T14:18:10.8985182Z remote: Counting objects:  17% (36/206)
2020-05-14T14:18:10.8985485Z remote: Counting objects:  18% (38/206)
2020-05-14T14:18:10.8985673Z remote: Counting objects:  19% (40/206)
2020-05-14T14:18:10.8986085Z remote: Counting objects:  20% (42/206)
2020-05-14T14:18:10.8986387Z remote: Counting objects:  21% (44/206)
2020-05-14T14:18:10.8986572Z remote: Counting objects:  22% (46/206)
2020-05-14T14:18:10.8986948Z remote: Counting objects:  23% (48/206)
2020-05-14T14:18:10.9170160Z remote: Counting objects:  24% (50/206)
2020-05-14T14:18:10.9170489Z remote: Counting objects:  25% (52/206)
2020-05-14T14:18:10.9170611Z remote: Counting objects:  26% (54/206)
2020-05-14T14:18:10.9170739Z remote: Counting objects:  27% (56/206)
2020-05-14T14:18:10.9170901Z remote: Counting objects:  28% (58/206)
2020-05-14T14:18:10.9171030Z remote: Counting objects:  29% (60/206)
2020-05-14T14:18:10.9171147Z remote: Counting objects:  30% (62/206)
2020-05-14T14:18:10.9171277Z remote: Counting objects:  31% (64/206)
2020-05-14T14:18:10.9171411Z remote: Counting objects:  32% (66/206)
2020-05-14T14:18:10.9171534Z remote: Counting objects:  33% (68/206)
2020-05-14T14:18:10.9171662Z remote: Counting objects:  34% (71/206)
2020-05-14T14:18:10.9171780Z remote: Counting objects:  35% (73/206)
2020-05-14T14:18:10.9171909Z remote: Counting objects:  36% (75/206)
2020-05-14T14:18:10.9172038Z remote: Counting objects:  37% (77/206)
2020-05-14T14:18:10.9172165Z remote: Counting objects:  38% (79/206)
2020-05-14T14:18:10.9172282Z remote: Counting objects:  39% (81/206)
2020-05-14T14:18:10.9172409Z remote: Counting objects:  40% (83/206)
2020-05-14T14:18:10.9172536Z remote: Counting objects:  41% (85/206)
2020-05-14T14:18:10.9172671Z remote: Counting objects:  42% (87/206)
2020-05-14T14:18:10.9173491Z remote: Counting objects:  43% (89/206)
2020-05-14T14:18:10.9173660Z remote: Counting objects:  44% (91/206)
2020-05-14T14:18:10.9173803Z remote: Counting objects:  45% (93/206)
2020-05-14T14:18:10.9173934Z remote: Counting objects:  46% (95/206)
2020-05-14T14:18:10.9174051Z remote: Counting objects:  47% (97/206)
2020-05-14T14:18:10.9174191Z remote: Counting objects:  48% (99/206)
2020-05-14T14:18:10.9174322Z remote: Counting objects:  49% (101/206)
2020-05-14T14:18:10.9174452Z remote: Counting objects:  50% (103/206)
2020-05-14T14:18:10.9174581Z remote: Counting objects:  51% (106/206)
2020-05-14T14:18:10.9174700Z remote: Counting objects:  52% (108/206)
2020-05-14T14:18:10.9175016Z remote: Counting objects:  53% (110/206)
2020-05-14T14:18:10.9175157Z remote: Counting objects:  54% (112/206)
2020-05-14T14:18:10.9175295Z remote: Counting objects:  55% (114/206)
2020-05-14T14:18:10.9175414Z remote: Counting objects:  56% (116/206)
2020-05-14T14:18:10.9175545Z remote: Counting objects:  57% (118/206)
2020-05-14T14:18:10.9175906Z remote: Counting objects:  58% (120/206)
2020-05-14T14:18:10.9176034Z remote: Counting objects:  59% (122/206)
2020-05-14T14:18:10.9176150Z remote: Counting objects:  60% (124/206)
2020-05-14T14:18:10.9176277Z remote: Counting objects:  61% (126/206)
2020-05-14T14:18:10.9176405Z remote: Counting objects:  62% (128/206)
2020-05-14T14:18:10.9176706Z remote: Counting objects:  63% (130/206)
2020-05-14T14:18:10.9176840Z remote: Counting objects:  64% (132/206)
2020-05-14T14:18:10.9176961Z remote: Counting objects:  65% (134/206)
2020-05-14T14:18:10.9177094Z remote: Counting objects:  66% (136/206)
2020-05-14T14:18:10.9177228Z remote: Counting objects:  67% (139/206)
2020-05-14T14:18:10.9177447Z remote: Counting objects:  68% (141/206)
2020-05-14T14:18:10.9177583Z remote: Counting objects:  69% (143/206)
2020-05-14T14:18:10.9177718Z remote: Counting objects:  70% (145/206)
2020-05-14T14:18:10.9177852Z remote: Counting objects:  71% (147/206)
2020-05-14T14:18:10.9178015Z remote: Counting objects:  72% (149/206)
2020-05-14T14:18:10.9178147Z remote: Counting objects:  73% (151/206)
2020-05-14T14:18:10.9178267Z remote: Counting objects:  74% (153/206)
2020-05-14T14:18:10.9178402Z remote: Counting objects:  75% (155/206)
2020-05-14T14:18:10.9178539Z remote: Counting objects:  76% (157/206)
2020-05-14T14:18:10.9178670Z remote: Counting objects:  77% (159/206)
2020-05-14T14:18:10.9178803Z remote: Counting objects:  78% (161/206)
2020-05-14T14:18:10.9178924Z remote: Counting objects:  79% (163/206)
2020-05-14T14:18:10.9179058Z remote: Counting objects:  80% (165/206)
2020-05-14T14:18:10.9179198Z remote: Counting objects:  81% (167/206)
2020-05-14T14:18:10.9179330Z remote: Counting objects:  82% (169/206)
2020-05-14T14:18:10.9179450Z remote: Counting objects:  83% (171/206)
2020-05-14T14:18:10.9179582Z remote: Counting objects:  84% (174/206)
2020-05-14T14:18:10.9179721Z remote: Counting objects:  85% (176/206)
2020-05-14T14:18:10.9180171Z remote: Counting objects:  86% (178/206)
2020-05-14T14:18:10.9180285Z remote: Counting objects:  87% (180/206)
2020-05-14T14:18:10.9180412Z remote: Counting objects:  88% (182/206)
2020-05-14T14:18:10.9180537Z remote: Counting objects:  89% (184/206)
2020-05-14T14:18:10.9180668Z remote: Counting objects:  90% (186/206)
2020-05-14T14:18:10.9180796Z remote: Counting objects:  91% (188/206)
2020-05-14T14:18:10.9180911Z remote: Counting objects:  92% (190/206)
2020-05-14T14:18:10.9181035Z remote: Counting objects:  93% (192/206)
2020-05-14T14:18:10.9181164Z remote: Counting objects:  94% (194/206)
2020-05-14T14:18:10.9181291Z remote: Counting objects:  95% (196/206)
2020-05-14T14:18:10.9181405Z remote: Counting objects:  96% (198/206)
2020-05-14T14:18:10.9181529Z remote: Counting objects:  97% (200/206)
2020-05-14T14:18:10.9181656Z remote: Counting objects:  98% (202/206)
2020-05-14T14:18:10.9181775Z remote: Counting objects:  99% (204/206)
2020-05-14T14:18:10.9181888Z remote: Counting objects: 100% (206/206)
2020-05-14T14:18:10.9182011Z remote: Counting objects: 100% (206/206), done.
2020-05-14T14:18:10.9182142Z remote: Compressing objects:   0% (1/164)
2020-05-14T14:18:10.9182271Z remote: Compressing objects:   1% (2/164)
2020-05-14T14:18:10.9182384Z remote: Compressing objects:   2% (4/164)
2020-05-14T14:18:10.9182509Z remote: Compressing objects:   3% (5/164)
2020-05-14T14:18:10.9182639Z remote: Compressing objects:   4% (7/164)
2020-05-14T14:18:10.9182772Z remote: Compressing objects:   5% (9/164)
2020-05-14T14:18:10.9182901Z remote: Compressing objects:   6% (10/164)
2020-05-14T14:18:10.9183017Z remote: Compressing objects:   7% (12/164)
2020-05-14T14:18:10.9183147Z remote: Compressing objects:   8% (14/164)
2020-05-14T14:18:10.9183357Z remote: Compressing objects:   9% (15/164)
2020-05-14T14:18:10.9183486Z remote: Compressing objects:  10% (17/164)
2020-05-14T14:18:10.9183599Z remote: Compressing objects:  11% (19/164)
2020-05-14T14:18:10.9183721Z remote: Compressing objects:  12% (20/164)
2020-05-14T14:18:10.9183841Z remote: Compressing objects:  13% (22/164)
2020-05-14T14:18:10.9183961Z remote: Compressing objects:  14% (23/164)
2020-05-14T14:18:10.9184085Z remote: Compressing objects:  15% (25/164)
2020-05-14T14:18:10.9184199Z remote: Compressing objects:  16% (27/164)
2020-05-14T14:18:10.9184323Z remote: Compressing objects:  17% (28/164)
2020-05-14T14:18:10.9184504Z remote: Compressing objects:  18% (30/164)
2020-05-14T14:18:10.9184641Z remote: Compressing objects:  19% (32/164)
2020-05-14T14:18:10.9184755Z remote: Compressing objects:  20% (33/164)
2020-05-14T14:18:10.9184893Z remote: Compressing objects:  21% (35/164)
2020-05-14T14:18:10.9185014Z remote: Compressing objects:  22% (37/164)
2020-05-14T14:18:10.9185142Z remote: Compressing objects:  23% (38/164)
2020-05-14T14:18:10.9185257Z remote: Compressing objects:  24% (40/164)
2020-05-14T14:18:10.9185388Z remote: Compressing objects:  25% (41/164)
2020-05-14T14:18:10.9185521Z remote: Compressing objects:  26% (43/164)
2020-05-14T14:18:10.9185654Z remote: Compressing objects:  27% (45/164)
2020-05-14T14:18:10.9185785Z remote: Compressing objects:  28% (46/164)
2020-05-14T14:18:10.9185899Z remote: Compressing objects:  29% (48/164)
2020-05-14T14:18:10.9186029Z remote: Compressing objects:  30% (50/164)
2020-05-14T14:18:10.9186341Z remote: Compressing objects:  31% (51/164)
2020-05-14T14:18:10.9186477Z remote: Compressing objects:  32% (53/164)
2020-05-14T14:18:10.9186594Z remote: Compressing objects:  33% (55/164)
2020-05-14T14:18:10.9186910Z remote: Compressing objects:  34% (56/164)
2020-05-14T14:18:10.9187049Z remote: Compressing objects:  35% (58/164)
2020-05-14T14:18:10.9187186Z remote: Compressing objects:  36% (60/164)
2020-05-14T14:18:10.9187306Z remote: Compressing objects:  37% (61/164)
2020-05-14T14:18:10.9187445Z remote: Compressing objects:  38% (63/164)
2020-05-14T14:18:10.9187582Z remote: Compressing objects:  39% (64/164)
2020-05-14T14:18:10.9187721Z remote: Compressing objects:  40% (66/164)
2020-05-14T14:18:10.9187860Z remote: Compressing objects:  41% (68/164)
2020-05-14T14:18:10.9187981Z remote: Compressing objects:  42% (69/164)
2020-05-14T14:18:10.9188121Z remote: Compressing objects:  43% (71/164)
2020-05-14T14:18:10.9188265Z remote: Compressing objects:  44% (73/164)
2020-05-14T14:18:10.9188403Z remote: Compressing objects:  45% (74/164)
2020-05-14T14:18:10.9188525Z remote: Compressing objects:  46% (76/164)
2020-05-14T14:18:10.9188671Z remote: Compressing objects:  47% (78/164)
2020-05-14T14:18:10.9188811Z remote: Compressing objects:  48% (79/164)
2020-05-14T14:18:10.9188951Z remote: Compressing objects:  49% (81/164)
2020-05-14T14:18:10.9189253Z remote: Compressing objects:  50% (82/164)
2020-05-14T14:18:10.9189394Z remote: Compressing objects:  51% (84/164)
2020-05-14T14:18:10.9189700Z remote: Compressing objects:  52% (86/164)
2020-05-14T14:18:10.9189839Z remote: Compressing objects:  53% (87/164)
2020-05-14T14:18:10.9190133Z remote: Compressing objects:  54% (89/164)
2020-05-14T14:18:10.9190251Z remote: Compressing objects:  55% (91/164)
2020-05-14T14:18:10.9190395Z remote: Compressing objects:  56% (92/164)
2020-05-14T14:18:10.9190529Z remote: Compressing objects:  57% (94/164)
2020-05-14T14:18:10.9190665Z remote: Compressing objects:  58% (96/164)
2020-05-14T14:18:10.9190790Z remote: Compressing objects:  59% (97/164)
2020-05-14T14:18:10.9191010Z remote: Compressing objects:  60% (99/164)
2020-05-14T14:18:10.9191152Z remote: Compressing objects:  61% (101/164)
2020-05-14T14:18:10.9191294Z remote: Compressing objects:  62% (102/164)
2020-05-14T14:18:10.9191411Z remote: Compressing objects:  63% (104/164)
2020-05-14T14:18:10.9191549Z remote: Compressing objects:  64% (105/164)
2020-05-14T14:18:10.9191686Z remote: Compressing objects:  65% (107/164)
2020-05-14T14:18:10.9191821Z remote: Compressing objects:  66% (109/164)
2020-05-14T14:18:10.9191957Z remote: Compressing objects:  67% (110/164)
2020-05-14T14:18:10.9192076Z remote: Compressing objects:  68% (112/164)
2020-05-14T14:18:10.9192276Z remote: Compressing objects:  69% (114/164)
2020-05-14T14:18:10.9192422Z remote: Compressing objects:  70% (115/164)
2020-05-14T14:18:10.9192558Z remote: Compressing objects:  71% (117/164)
2020-05-14T14:18:10.9192676Z remote: Compressing objects:  72% (119/164)
2020-05-14T14:18:10.9192821Z remote: Compressing objects:  73% (120/164)
2020-05-14T14:18:10.9192955Z remote: Compressing objects:  74% (122/164)
2020-05-14T14:18:10.9193091Z remote: Compressing objects:  75% (123/164)
2020-05-14T14:18:10.9193210Z remote: Compressing objects:  76% (125/164)
2020-05-14T14:18:10.9193346Z remote: Compressing objects:  77% (127/164)
2020-05-14T14:18:10.9193483Z remote: Compressing objects:  78% (128/164)
2020-05-14T14:18:10.9193773Z remote: Compressing objects:  79% (130/164)
2020-05-14T14:18:10.9193905Z remote: Compressing objects:  80% (132/164)
2020-05-14T14:18:10.9194019Z remote: Compressing objects:  81% (133/164)
2020-05-14T14:18:10.9194154Z remote: Compressing objects:  82% (135/164)
2020-05-14T14:18:10.9194286Z remote: Compressing objects:  83% (137/164)
2020-05-14T14:18:10.9194420Z remote: Compressing objects:  84% (138/164)
2020-05-14T14:18:10.9194542Z remote: Compressing objects:  85% (140/164)
2020-05-14T14:18:10.9194672Z remote: Compressing objects:  86% (142/164)
2020-05-14T14:18:10.9194802Z remote: Compressing objects:  87% (143/164)
2020-05-14T14:18:10.9194934Z remote: Compressing objects:  88% (145/164)
2020-05-14T14:18:10.9195065Z remote: Compressing objects:  89% (146/164)
2020-05-14T14:18:10.9195181Z remote: Compressing objects:  90% (148/164)
2020-05-14T14:18:10.9195311Z remote: Compressing objects:  91% (150/164)
2020-05-14T14:18:10.9195442Z remote: Compressing objects:  92% (151/164)
2020-05-14T14:18:10.9195574Z remote: Compressing objects:  93% (153/164)
2020-05-14T14:18:10.9195695Z remote: Compressing objects:  94% (155/164)
2020-05-14T14:18:10.9195829Z remote: Compressing objects:  95% (156/164)
2020-05-14T14:18:10.9195959Z remote: Compressing objects:  96% (158/164)
2020-05-14T14:18:10.9196266Z remote: Compressing objects:  97% (160/164)
2020-05-14T14:18:10.9196963Z remote: Compressing objects:  98% (161/164)
2020-05-14T14:18:10.9197291Z remote: Compressing objects:  99% (163/164)
2020-05-14T14:18:10.9197443Z remote: Compressing objects: 100% (164/164)
2020-05-14T14:18:10.9197583Z remote: Compressing objects: 100% (164/164), done.
2020-05-14T14:18:10.9197740Z Receiving objects:   0% (1/206)
2020-05-14T14:18:10.9197888Z Receiving objects:   1% (3/206)
2020-05-14T14:18:10.9198037Z Receiving objects:   2% (5/206)
2020-05-14T14:18:10.9198165Z Receiving objects:   3% (7/206)
2020-05-14T14:18:10.9198314Z Receiving objects:   4% (9/206)
2020-05-14T14:18:10.9198461Z Receiving objects:   5% (11/206)
2020-05-14T14:18:10.9198608Z Receiving objects:   6% (13/206)
2020-05-14T14:18:10.9198746Z Receiving objects:   7% (15/206)
2020-05-14T14:18:10.9198896Z Receiving objects:   8% (17/206)
2020-05-14T14:18:10.9199042Z Receiving objects:   9% (19/206)
2020-05-14T14:18:10.9199184Z Receiving objects:  10% (21/206)
2020-05-14T14:18:10.9199495Z Receiving objects:  11% (23/206)
2020-05-14T14:18:10.9199644Z Receiving objects:  12% (25/206)
2020-05-14T14:18:10.9199786Z Receiving objects:  13% (27/206)
2020-05-14T14:18:10.9199922Z Receiving objects:  14% (29/206)
2020-05-14T14:18:10.9200050Z Receiving objects:  15% (31/206)
2020-05-14T14:18:10.9200193Z Receiving objects:  16% (33/206)
2020-05-14T14:18:10.9200660Z Receiving objects:  17% (36/206)
2020-05-14T14:18:10.9200791Z Receiving objects:  18% (38/206)
2020-05-14T14:18:10.9200902Z Receiving objects:  19% (40/206)
2020-05-14T14:18:10.9201034Z Receiving objects:  20% (42/206)
2020-05-14T14:18:10.9201164Z Receiving objects:  21% (44/206)
2020-05-14T14:18:10.9201292Z Receiving objects:  22% (46/206)
2020-05-14T14:18:10.9201477Z Receiving objects:  23% (48/206)
2020-05-14T14:18:10.9201624Z Receiving objects:  24% (50/206)
2020-05-14T14:18:10.9201753Z Receiving objects:  25% (52/206)
2020-05-14T14:18:10.9201882Z Receiving objects:  26% (54/206)
2020-05-14T14:18:10.9202006Z Receiving objects:  27% (56/206)
2020-05-14T14:18:10.9202139Z Receiving objects:  28% (58/206)
2020-05-14T14:18:10.9202270Z Receiving objects:  29% (60/206)
2020-05-14T14:18:10.9202399Z Receiving objects:  30% (62/206)
2020-05-14T14:18:10.9202511Z Receiving objects:  31% (64/206)
2020-05-14T14:18:10.9202641Z Receiving objects:  32% (66/206)
2020-05-14T14:18:10.9202773Z Receiving objects:  33% (68/206)
2020-05-14T14:18:10.9202901Z Receiving objects:  34% (71/206)
2020-05-14T14:18:10.9203013Z Receiving objects:  35% (73/206)
2020-05-14T14:18:10.9203143Z Receiving objects:  36% (75/206)
2020-05-14T14:18:10.9203274Z Receiving objects:  37% (77/206)
2020-05-14T14:18:10.9203405Z Receiving objects:  38% (79/206)
2020-05-14T14:18:10.9203537Z Receiving objects:  39% (81/206)
2020-05-14T14:18:10.9203656Z Receiving objects:  40% (83/206)
2020-05-14T14:18:10.9203787Z Receiving objects:  41% (85/206)
2020-05-14T14:18:10.9203917Z Receiving objects:  42% (87/206)
2020-05-14T14:18:10.9204047Z Receiving objects:  43% (89/206)
2020-05-14T14:18:10.9204166Z Receiving objects:  44% (91/206)
2020-05-14T14:18:10.9204340Z Receiving objects:  45% (93/206)
2020-05-14T14:18:10.9204470Z Receiving objects:  46% (95/206)
2020-05-14T14:18:10.9204601Z Receiving objects:  47% (97/206)
2020-05-14T14:18:10.9204712Z Receiving objects:  48% (99/206)
2020-05-14T14:18:10.9204844Z Receiving objects:  49% (101/206)
2020-05-14T14:18:10.9204978Z Receiving objects:  50% (103/206)
2020-05-14T14:18:10.9205109Z Receiving objects:  51% (106/206)
2020-05-14T14:18:10.9205221Z Receiving objects:  52% (108/206)
2020-05-14T14:18:10.9205356Z Receiving objects:  53% (110/206)
2020-05-14T14:18:10.9205486Z Receiving objects:  54% (112/206)
2020-05-14T14:18:10.9205792Z Receiving objects:  55% (114/206)
2020-05-14T14:18:10.9205915Z Receiving objects:  56% (116/206)
2020-05-14T14:18:10.9206051Z Receiving objects:  57% (118/206)
2020-05-14T14:18:10.9206355Z Receiving objects:  58% (120/206)
2020-05-14T14:18:10.9206494Z Receiving objects:  59% (122/206)
2020-05-14T14:18:10.9206820Z Receiving objects:  60% (124/206)
2020-05-14T14:18:10.9207131Z Receiving objects:  61% (126/206)
2020-05-14T14:18:10.9207269Z Receiving objects:  62% (128/206)
2020-05-14T14:18:10.9207407Z Receiving objects:  63% (130/206)
2020-05-14T14:18:10.9207527Z Receiving objects:  64% (132/206)
2020-05-14T14:18:10.9208241Z remote: Total 206 (delta 24), reused 108 (delta 15), pack-reused 0
2020-05-14T14:18:10.9208400Z Receiving objects:  65% (134/206)
2020-05-14T14:18:10.9208539Z Receiving objects:  66% (136/206)
2020-05-14T14:18:10.9208660Z Receiving objects:  67% (139/206)
2020-05-14T14:18:10.9208799Z Receiving objects:  68% (141/206)
2020-05-14T14:18:10.9208942Z Receiving objects:  69% (143/206)
2020-05-14T14:18:10.9209080Z Receiving objects:  70% (145/206)
2020-05-14T14:18:10.9209226Z Receiving objects:  71% (147/206)
2020-05-14T14:18:10.9209347Z Receiving objects:  72% (149/206)
2020-05-14T14:18:10.9209488Z Receiving objects:  73% (151/206)
2020-05-14T14:18:10.9209624Z Receiving objects:  74% (153/206)
2020-05-14T14:18:10.9210206Z Receiving objects:  75% (155/206)
2020-05-14T14:18:10.9210320Z Receiving objects:  76% (157/206)
2020-05-14T14:18:10.9210451Z Receiving objects:  77% (159/206)
2020-05-14T14:18:10.9210581Z Receiving objects:  78% (161/206)
2020-05-14T14:18:10.9210713Z Receiving objects:  79% (163/206)
2020-05-14T14:18:10.9210826Z Receiving objects:  80% (165/206)
2020-05-14T14:18:10.9210958Z Receiving objects:  81% (167/206)
2020-05-14T14:18:10.9211089Z Receiving objects:  82% (169/206)
2020-05-14T14:18:10.9211220Z Receiving objects:  83% (171/206)
2020-05-14T14:18:10.9211333Z Receiving objects:  84% (174/206)
2020-05-14T14:18:10.9211514Z Receiving objects:  85% (176/206)
2020-05-14T14:18:10.9211644Z Receiving objects:  86% (178/206)
2020-05-14T14:18:10.9211862Z Receiving objects:  87% (180/206)
2020-05-14T14:18:10.9211990Z Receiving objects:  88% (182/206)
2020-05-14T14:18:10.9212121Z Receiving objects:  89% (184/206)
2020-05-14T14:18:10.9212254Z Receiving objects:  90% (186/206)
2020-05-14T14:18:10.9212396Z Receiving objects:  91% (188/206)
2020-05-14T14:18:10.9212507Z Receiving objects:  92% (190/206)
2020-05-14T14:18:10.9212639Z Receiving objects:  93% (192/206)
2020-05-14T14:18:10.9212769Z Receiving objects:  94% (194/206)
2020-05-14T14:18:10.9212898Z Receiving objects:  95% (196/206)
2020-05-14T14:18:10.9213010Z Receiving objects:  96% (198/206)
2020-05-14T14:18:10.9213321Z Receiving objects:  97% (200/206)
2020-05-14T14:18:10.9213455Z Receiving objects:  98% (202/206)
2020-05-14T14:18:10.9213589Z Receiving objects:  99% (204/206)
2020-05-14T14:18:10.9213919Z Receiving objects: 100% (206/206)
2020-05-14T14:18:10.9214065Z Receiving objects: 100% (206/206), 405.29 KiB | 19.30 MiB/s, done.
2020-05-14T14:18:10.9214213Z Resolving deltas:   0% (0/24)
2020-05-14T14:18:10.9214355Z Resolving deltas:   4% (1/24)
2020-05-14T14:18:10.9214654Z Resolving deltas:   8% (2/24)
2020-05-14T14:18:10.9214773Z Resolving deltas:  12% (3/24)
2020-05-14T14:18:10.9214907Z Resolving deltas:  16% (4/24)
2020-05-14T14:18:10.9215047Z Resolving deltas:  20% (5/24)
2020-05-14T14:18:10.9215181Z Resolving deltas:  41% (10/24)
2020-05-14T14:18:10.9215299Z Resolving deltas:  45% (11/24)
2020-05-14T14:18:10.9215425Z Resolving deltas:  50% (12/24)
2020-05-14T14:18:10.9215553Z Resolving deltas:  54% (13/24)
2020-05-14T14:18:10.9215691Z Resolving deltas:  58% (14/24)
2020-05-14T14:18:10.9215808Z Resolving deltas:  62% (15/24)
2020-05-14T14:18:10.9215944Z Resolving deltas:  66% (16/24)
2020-05-14T14:18:10.9216073Z Resolving deltas:  70% (17/24)
2020-05-14T14:18:10.9216197Z Resolving deltas:  75% (18/24)
2020-05-14T14:18:10.9216516Z Resolving deltas:  79% (19/24)
2020-05-14T14:18:10.9216808Z Resolving deltas:  83% (20/24)
2020-05-14T14:18:10.9216938Z Resolving deltas:  91% (22/24)
2020-05-14T14:18:10.9217071Z Resolving deltas:  95% (23/24)
2020-05-14T14:18:10.9217188Z Resolving deltas: 100% (24/24)
2020-05-14T14:18:10.9217323Z Resolving deltas: 100% (24/24), done.
2020-05-14T14:18:10.9217688Z From https://github.com/submariner-io/submariner
2020-05-14T14:18:10.9218047Z  * [new ref]         6970a392cc361a43e7e0ce235f949784a00d9f93 -> pull/565/merge
2020-05-14T14:18:10.9218252Z ##[endgroup]
2020-05-14T14:18:10.9218397Z ##[group]Determining the checkout info
2020-05-14T14:18:10.9218531Z ##[endgroup]
2020-05-14T14:18:10.9218657Z ##[group]Checking out the ref
2020-05-14T14:18:10.9218972Z [command]/usr/bin/git checkout --progress --force refs/remotes/pull/565/merge
2020-05-14T14:18:10.9233198Z Note: switching to 'refs/remotes/pull/565/merge'.
2020-05-14T14:18:10.9239619Z
2020-05-14T14:18:10.9240809Z You are in 'detached HEAD' state. You can look around, make experimental
2020-05-14T14:18:10.9241505Z changes and commit them, and you can discard any commits you make in this
2020-05-14T14:18:10.9241765Z state without impacting any branches by switching back to a branch.
2020-05-14T14:18:10.9241868Z
2020-05-14T14:18:10.9241990Z If you want to create a new branch to retain commits you create, you may
2020-05-14T14:18:10.9242393Z do so (now or later) by using -c with the switch command. Example:
2020-05-14T14:18:10.9242661Z
2020-05-14T14:18:10.9242948Z   git switch -c <new-branch-name>
2020-05-14T14:18:10.9243035Z
2020-05-14T14:18:10.9243160Z Or undo this operation with:
2020-05-14T14:18:10.9243231Z
2020-05-14T14:18:10.9243467Z   git switch -
2020-05-14T14:18:10.9243536Z
2020-05-14T14:18:10.9243900Z Turn off this advice by setting config variable advice.detachedHead to false
2020-05-14T14:18:10.9244437Z
2020-05-14T14:18:10.9244658Z HEAD is now at 6970a39 Merge 252596697df3e3ce56b88c5c5b5a4ae077421924 into afad34791455cae1e29585259356fe6e6c4570c2
2020-05-14T14:18:10.9244982Z ##[endgroup]
2020-05-14T14:18:10.9245502Z [command]/usr/bin/git log -1
2020-05-14T14:18:10.9245939Z commit 6970a392cc361a43e7e0ce235f949784a00d9f93
2020-05-14T14:18:10.9246261Z Author: Mike Kolesnik <mkolesni@redhat.com>
2020-05-14T14:18:10.9246521Z Date:   Thu May 14 14:17:52 2020 +0000
2020-05-14T14:18:10.9246915Z
2020-05-14T14:18:10.9247192Z     Merge 252596697df3e3ce56b88c5c5b5a4ae077421924 into afad34791455cae1e29585259356fe6e6c4570c2
2020-05-14T14:18:10.9306821Z ##[group]Run sudo swapoff -a
2020-05-14T14:18:10.9307028Z sudo swapoff -a
2020-05-14T14:18:10.9307414Z sudo rm -f /swapfile
2020-05-14T14:18:10.9307543Z docker system prune --volumes --all --force
2020-05-14T14:18:10.9307662Z df -h
2020-05-14T14:18:10.9307785Z free -h
2020-05-14T14:18:10.9345773Z shell: /bin/bash -e {0}
2020-05-14T14:18:10.9345905Z ##[endgroup]
2020-05-14T14:18:18.8604870Z Deleted Images:
2020-05-14T14:18:18.8648686Z untagged: node:10-alpine
2020-05-14T14:18:18.8649456Z untagged: node@sha256:b2db1b026f1b01a6a91f39d8204b89c5c13d2b40a017dd4d9253ab066c9cf2cb
2020-05-14T14:18:18.8649678Z deleted: sha256:a07f309c9753b98d47fdfbafe90f4e7c99eada8abebd73903a17bdb679e9b559
2020-05-14T14:18:18.8649787Z deleted: sha256:37c540bce96012c445495009964321b7c4d7486f1144c257b0933c8a0d5b8f83
2020-05-14T14:18:18.8649913Z deleted: sha256:acc113341d5ea3c65b09ea62af4add6f48e40a26fd6e8a564ca0d110655c73ee
2020-05-14T14:18:18.8650219Z deleted: sha256:adff35550b3fd64ad32c78e0d00548b7460224e5258a6f2304c0e42f11ac37e1
2020-05-14T14:18:18.8650530Z untagged: node:12-alpine
2020-05-14T14:18:18.8650650Z untagged: node@sha256:84f5c9090cc741421b2376b2393e7d5fa2f89d36167c12eb57aef16dd64ecf6c
2020-05-14T14:18:18.8650776Z deleted: sha256:7a48db49edbf8e9d6db61af52c4dc52d7530f81a9f81c2ec403d5b022ff12301
2020-05-14T14:18:18.8650898Z deleted: sha256:a0e4b65e3b00683c9b07e82d41d3f2bc83565ce8ad53363b569a1edb7a0b5501
2020-05-14T14:18:18.8651000Z deleted: sha256:e15ed58a756342dcf33fd115cd4d016b84bdea616d61fabd001f1b63c329a3f7
2020-05-14T14:18:18.8651119Z deleted: sha256:c94b4ab79726775408a749b9d6d612a576cb1c1c500cf6323d1aa881023c0516
2020-05-14T14:18:18.8651405Z untagged: mcr.microsoft.com/azure-pipelines/node8-typescript:latest
2020-05-14T14:18:18.8652272Z untagged: mcr.microsoft.com/azure-pipelines/node8-typescript@sha256:e52e60b9f71183969830a3664279b5d8c799b4b0ec2c25a0686f7c02f6a9669a
2020-05-14T14:18:18.8652434Z deleted: sha256:9a948d36077800d7d44e2da4ef0f518527cc96ed7f47c0d6cfc601af813349b6
2020-05-14T14:18:18.8652716Z deleted: sha256:d51399890e1b1bfcd7705e8e88ae806068d998c42b2bdfbfa0c5cb80ff5a6f40
2020-05-14T14:18:18.8652851Z deleted: sha256:c05a437580a2737281c58b62c09bc812ce0d25c4b11df4442929c5e8d8712b46
2020-05-14T14:18:18.8652968Z deleted: sha256:2a279c6a7be916fcb1f43d88e45ffc5ce86d52999ad13ee7eaabf1ae11780d18
2020-05-14T14:18:18.8653198Z deleted: sha256:de489ba3738b9d6609f38749e0f379757f1eae04845343254238fc527d5f6a53
2020-05-14T14:18:18.8653348Z deleted: sha256:b1d50304c0bcbb00a7a23e28da1db07f410db99b15548b121d6e57f42e608ac1
2020-05-14T14:18:18.8653486Z deleted: sha256:4f6f7d91ac0983a83e22674df9a8635eb39321dd4c02de56eb7586ed1a77a3c9
2020-05-14T14:18:18.8653633Z deleted: sha256:aacf214e620869aecc7baab4d1f9f9cc20f31eb659ae3ef42a69136b0a80d0ed
2020-05-14T14:18:18.8653730Z deleted: sha256:a48179628a235233b77e9e18b432c11504749390b866d906d8673140ebc44d5b
2020-05-14T14:18:18.8653843Z deleted: sha256:acc25c35ec739a41ed529f4571cb6f2dfc6f5f4fa547e158f8ac3e67b7a04ebe
2020-05-14T14:18:18.8654241Z deleted: sha256:afcc51706ba3d4b6495244781c41275169c5830a8306afe6c5a41da32cd54b8c
2020-05-14T14:18:18.8654520Z deleted: sha256:5955638b4368b13802ed7dcc69bce2352f5aff2d6cea1850d5e7257d7c1acfbc
2020-05-14T14:18:18.8654671Z deleted: sha256:8b15606a9e3e430cb7ba739fde2fbb3734a19f8a59a825ffa877f9be49059817
2020-05-14T14:18:18.8654761Z untagged: node:12
2020-05-14T14:18:18.8654982Z untagged: node@sha256:5fe210262a6dc0c1f5555976356cf076c7a8c7645b0c781bc8a913881bbe7942
2020-05-14T14:18:18.8655138Z deleted: sha256:9dd56f7e705f184157f9e3ca0a36296803593f18978d3890b446a3abce088f1a
2020-05-14T14:18:18.8655277Z deleted: sha256:e4172635d1e4d0b2f8ed609e8caaa9eac55c0213e19d144d8fbed46a9daf535a
2020-05-14T14:18:18.8655414Z deleted: sha256:1eb1b8c8f005fd924c675459cf411929c811533742875e49f0ce3fed2d9e04e8
2020-05-14T14:18:18.8655557Z deleted: sha256:e0bf1e0d06c532ad9d9cf7c1c33776a213c091deeb2979e6e5aa4f09c5aba5a5
2020-05-14T14:18:18.8655657Z untagged: alpine:3.9
2020-05-14T14:18:18.8656002Z untagged: alpine@sha256:414e0518bb9228d35e4cd5165567fb91d26c6a214e9c95899e1e056fcd349011
2020-05-14T14:18:18.8656287Z deleted: sha256:78a2ce922f8665f5a227dc5cd9fda87221acba8a7a952b9665f99bc771a29963
2020-05-14T14:18:18.8656439Z deleted: sha256:89ae5c4ee501a09c879f5b58474003539ab3bb978a553af2a4a6a7de248b5740
2020-05-14T14:18:18.8656569Z untagged: alpine:3.8
2020-05-14T14:18:18.8656685Z untagged: alpine@sha256:2bb501e6173d9d006e56de5bce2720eb06396803300fe1687b58a7ff32bf4c14
2020-05-14T14:18:18.8656831Z deleted: sha256:c8bccc0af9571ec0d006a43acb5a8d08c4ce42b6cc7194dd6eb167976f501ef1
2020-05-14T14:18:18.8656946Z deleted: sha256:7444ea29e45e927abea1f923bf24cac20deaddea603c4bb1c7f2f5819773d453
2020-05-14T14:18:18.8657165Z untagged: node:10
2020-05-14T14:18:18.8657306Z untagged: node@sha256:e0c512c52c3ca8797fc60ada3698004f5cba13af4a8a5968041edac1b5d98577
2020-05-14T14:18:18.8657444Z deleted: sha256:a02c9f46f94a6e2d03da7973d9f820f4158a3243711d74309a7482b61f3e755f
2020-05-14T14:18:18.8657916Z deleted: sha256:13a3f08c9b83cc81995e46c1784b346f0a912379da05274d7639ba2b964b27db
2020-05-14T14:18:18.8658073Z deleted: sha256:bc56ff87c94a8745cf2d8a1f1df71449d14d74ea9a65c71591e9e4dd295beb57
2020-05-14T14:18:18.8658191Z deleted: sha256:464fa0bdf5d534f042e969b431f7067a23e61963cf853ef78df45a71835d50ff
2020-05-14T14:18:18.8658601Z deleted: sha256:04ff36c4f9c62f77d42e2f1bd3f996ef997e5a067d414988cb97a77136b978b8
2020-05-14T14:18:18.8659590Z untagged: buildpack-deps:stretch
2020-05-14T14:18:18.8660319Z untagged: buildpack-deps@sha256:38353fdc334fa612f3dedb3d1e8172c3e63de706ca80260856e5708d0fd1146a
2020-05-14T14:18:18.8660615Z deleted: sha256:b45c882f0d36f1719fe08f79f10398ed1ee767cce7c715c592eb93c3d5709137
2020-05-14T14:18:18.8660784Z deleted: sha256:58087153ded7ed5b95601cc4628dc0211372b93632eb86ee7c1397ca86afadc6
2020-05-14T14:18:18.8660912Z deleted: sha256:08427ca5155ca0a53a4111beeb37a0dd25ebca3eeb5861ae8c1db3e635777b45
2020-05-14T14:18:18.8661167Z deleted: sha256:c794ba8ed668c64d52b4e9540a3e2171a1576ae781c494138cea954a457a9771
2020-05-14T14:18:18.8664330Z deleted: sha256:2975e9ede31ee709d15b6155737f1fd2fb1032397679591b41e709aba1fca47d
2020-05-14T14:18:18.8664589Z untagged: alpine:3.7
2020-05-14T14:18:18.8664749Z untagged: alpine@sha256:8421d9a84432575381bfabd248f1eb56f3aa21d9d7cd2511583c68c9b7511d10
2020-05-14T14:18:18.8665238Z deleted: sha256:6d1ef012b5674ad8a127ecfa9b5e6f5178d171b90ee462846974177fd9bdd39f
2020-05-14T14:18:18.8665425Z deleted: sha256:3fc64803ca2de7279269048fe2b8b3c73d4536448c87c32375b2639ac168a48b
2020-05-14T14:18:18.8665544Z untagged: ubuntu:14.04
2020-05-14T14:18:18.8665783Z untagged: ubuntu@sha256:ffc76f71dd8be8c9e222d420dc96901a07b61616689a44c7b3ef6a10b7213de4
2020-05-14T14:18:18.8665895Z deleted: sha256:6e4f1fe62ff14a4c8119781d47a3739fa97c190e1df38e868794ad7a7cf50a48
2020-05-14T14:18:18.8666126Z deleted: sha256:bf1b2d677f21703e5be92de8b094fbf5cceeea666885053b40b8a5b2f20638b3
2020-05-14T14:18:18.8666283Z deleted: sha256:9b22c82c6d5a884491639891b0eb053e6e58d6da35ad2d73655d7dd2707d6d73
2020-05-14T14:18:18.8666901Z deleted: sha256:f2fa9f4cf8fd0a521d40e34492b522cee3f35004047e617c75fadeb8bfd1e6b7
2020-05-14T14:18:18.8667050Z untagged: jekyll/builder:latest
2020-05-14T14:18:18.8667189Z untagged: jekyll/builder@sha256:c97cebe5f614888d61bebf234c1c93399aa74463ffdb175fd9b975a4b0fa8f13
2020-05-14T14:18:18.8667409Z deleted: sha256:7ba583524939f2e3b2c66706557f3d92a94edd8954b29bf137ca5ab8f26f4c48
2020-05-14T14:18:18.8667562Z deleted: sha256:cc37778661a1d9fe09c6394a64e6cf922446e4eb4ae7386153b9f213eaae67ef
2020-05-14T14:18:18.8667709Z deleted: sha256:1047c9639906459ea0200dde8f592953f643be035ab753540fb9664aca94cc0b
2020-05-14T14:18:18.8667824Z deleted: sha256:38f1924a6e94278513d4d46eae378e4287ce1230655b952e97264680291e5014
2020-05-14T14:18:18.8668051Z deleted: sha256:98d017156d57c3f22e3bb5d198d263c142bdee1c9875e6f30ab9934feb1b8566
2020-05-14T14:18:18.8668185Z deleted: sha256:813337a2cb88f4b74ba50079365b0854c8bdf7c5b28e99b35e423482e1c200e7
2020-05-14T14:18:18.8668465Z deleted: sha256:3e207b409db364b595ba862cdc12be96dcdad8e36c59a03b7b3b61c946a5741a
2020-05-14T14:18:18.8669266Z untagged: debian:9
2020-05-14T14:18:18.8669639Z untagged: debian@sha256:666ffd4fbcdff07edcbd65f0ec1dc86ed294f5e3be93eb26280575f77427df46
2020-05-14T14:18:18.8669769Z deleted: sha256:bd753a4a335e2c8e95ca70f8842ee25ecf72249a62ecfe1e1bb7da01cb16d29f
2020-05-14T14:18:18.8670093Z deleted: sha256:86ab2c6c5d587c5805ad401b4c8beb4c3e61a8b832d7882d98da5070381bd86b
2020-05-14T14:18:18.8670210Z untagged: alpine:3.10
2020-05-14T14:18:18.8670328Z untagged: alpine@sha256:f0e9534a598e501320957059cb2a23774b4d4072e37c7b2cf7e95b241f019e35
2020-05-14T14:18:18.8670457Z deleted: sha256:be4e4bea2c2e15b403bb321562e78ea84b501fb41497472e91ecb41504e8a27c
2020-05-14T14:18:18.8670742Z deleted: sha256:1b3ee35aacca9866b01dd96e870136266bde18006ac2f0d6eb706c798d1fa3c3
2020-05-14T14:18:18.8670837Z untagged: debian:8
2020-05-14T14:18:18.8670948Z untagged: debian@sha256:734728c8e411698485ae644fc988dad06f757565e292b5b85edc084befa37bbb
2020-05-14T14:18:18.8671095Z deleted: sha256:c6e91fa218561ae2d9dac856205e8c1752e5ada7417ba741ffb05dab495597db
2020-05-14T14:18:18.8671369Z deleted: sha256:ae7e6d8732b2846b360b8a7ab7bdcd98b3b44c20a5a390821379b59abb86a2f8
2020-05-14T14:18:18.8671435Z
2020-05-14T14:18:18.8671570Z Total reclaimed space: 2.761GB
2020-05-14T14:18:18.8684414Z Filesystem      Size  Used Avail Use% Mounted on
2020-05-14T14:18:18.8684549Z udev            3.4G     0  3.4G   0% /dev
2020-05-14T14:18:18.8684637Z tmpfs           693M  960K  692M   1% /run
2020-05-14T14:18:18.8684737Z /dev/sdb1        84G   60G   25G  72% /
2020-05-14T14:18:18.8684844Z tmpfs           3.4G  8.0K  3.4G   1% /dev/shm
2020-05-14T14:18:18.8684949Z tmpfs           5.0M     0  5.0M   0% /run/lock
2020-05-14T14:18:18.8685037Z tmpfs           3.4G     0  3.4G   0% /sys/fs/cgroup
2020-05-14T14:18:18.8685146Z /dev/loop0       40M   40M     0 100% /snap/hub/43
2020-05-14T14:18:18.8685253Z /dev/loop1       94M   94M     0 100% /snap/core/9066
2020-05-14T14:18:18.8685359Z /dev/sdb15      105M  3.6M  101M   4% /boot/efi
2020-05-14T14:18:18.8685470Z /dev/sda1        14G   41M   13G   1% /mnt
2020-05-14T14:18:18.9185827Z               total        used        free      shared  buff/cache   available
2020-05-14T14:18:18.9186394Z Mem:           6.8G        533M        5.0G         26M        1.2G        5.9G
2020-05-14T14:18:18.9186669Z Swap:            0B          0B          0B
2020-05-14T14:18:18.9235785Z ##[group]Run [[ -z "" ]] || DEPLOY_ARGS+=" --deploytool_submariner_args '--cable-driver '"
2020-05-14T14:18:18.9235997Z [[ -z "" ]] || DEPLOY_ARGS+=" --deploytool_submariner_args '--cable-driver '"
2020-05-14T14:18:18.9236107Z make e2e
2020-05-14T14:18:18.9272565Z shell: /bin/bash -e {0}
2020-05-14T14:18:18.9272675Z env:
2020-05-14T14:18:18.9272769Z   CLUSTERS_ARGS: --globalnet
2020-05-14T14:18:18.9272863Z   DEPLOY_ARGS: --globalnet --deploytool operator
2020-05-14T14:18:18.9272945Z ##[endgroup]
2020-05-14T14:18:18.9369621Z Downloading dapper
2020-05-14T14:18:19.1743501Z .dapper.tmp version v0.5.0
2020-05-14T14:18:19.1769907Z ./.dapper -m bind make e2e
2020-05-14T14:18:19.3367029Z Sending build context to Docker daemon  6.853MB
2020-05-14T14:18:19.3367923Z
2020-05-14T14:18:19.3407542Z Step 1/6 : FROM quay.io/submariner/shipyard-dapper-base
2020-05-14T14:18:19.5080673Z latest: Pulling from submariner/shipyard-dapper-base
2020-05-14T14:18:19.5094788Z fe04b97b6519: Pulling fs layer
2020-05-14T14:18:19.5094920Z 4cffdde56ef9: Pulling fs layer
2020-05-14T14:18:19.5095022Z c8c3b3910ef9: Pulling fs layer
2020-05-14T14:18:19.5095100Z d1c8edd81a59: Pulling fs layer
2020-05-14T14:18:19.5095197Z 18179912354f: Pulling fs layer
2020-05-14T14:18:19.5095293Z ff6de73968ee: Pulling fs layer
2020-05-14T14:18:19.5103374Z 18179912354f: Waiting
2020-05-14T14:18:19.5106052Z ff6de73968ee: Waiting
2020-05-14T14:18:19.5110876Z d1c8edd81a59: Waiting
2020-05-14T14:18:19.6134873Z c8c3b3910ef9: Verifying Checksum
2020-05-14T14:18:19.6140870Z c8c3b3910ef9: Download complete
2020-05-14T14:18:19.6767670Z d1c8edd81a59: Download complete
2020-05-14T14:18:19.7587525Z 18179912354f: Verifying Checksum
2020-05-14T14:18:19.8395789Z 18179912354f: Download complete
2020-05-14T14:18:19.8396305Z ff6de73968ee: Verifying Checksum
2020-05-14T14:18:19.8397068Z ff6de73968ee: Download complete
2020-05-14T14:18:22.2471947Z fe04b97b6519: Verifying Checksum
2020-05-14T14:18:22.2472714Z fe04b97b6519: Download complete
2020-05-14T14:18:25.3316259Z fe04b97b6519: Pull complete
2020-05-14T14:18:33.8648450Z 4cffdde56ef9: Verifying Checksum
2020-05-14T14:18:33.8650603Z 4cffdde56ef9: Download complete
2020-05-14T14:18:43.1164437Z 4cffdde56ef9: Pull complete
2020-05-14T14:18:43.1545841Z c8c3b3910ef9: Pull complete
2020-05-14T14:18:43.2035556Z d1c8edd81a59: Pull complete
2020-05-14T14:18:43.2393437Z 18179912354f: Pull complete
2020-05-14T14:18:43.2829943Z ff6de73968ee: Pull complete
2020-05-14T14:18:43.2867009Z Digest: sha256:a47ddbdc6caa377bc96dcd5ce73e30cb1e7bf23fc87efbcd87c0a9614dbac6a9
2020-05-14T14:18:43.2897520Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:latest
2020-05-14T14:18:43.2905385Z  ---> dca8fb2c3920
2020-05-14T14:18:43.2907919Z Step 2/6 : ENV DAPPER_ENV="REPO TAG QUAY_USERNAME QUAY_PASSWORD TRAVIS_COMMIT CLUSTERS_ARGS DEPLOY_ARGS"     DAPPER_SOURCE=/go/src/github.com/submariner-io/submariner DAPPER_DOCKER_SOCKET=true
2020-05-14T14:18:51.7698059Z  ---> Running in 1fd5b49cdf03
2020-05-14T14:18:52.4903198Z Removing intermediate container 1fd5b49cdf03
2020-05-14T14:18:52.4911609Z  ---> 63c111abead4
2020-05-14T14:18:52.4912247Z Step 3/6 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2020-05-14T14:18:52.5269620Z  ---> Running in a93ef176ba9e
2020-05-14T14:18:53.2249922Z Removing intermediate container a93ef176ba9e
2020-05-14T14:18:53.2250664Z  ---> 752538f50c80
2020-05-14T14:18:53.2250789Z Step 4/6 : WORKDIR ${DAPPER_SOURCE}
2020-05-14T14:18:53.2477192Z  ---> Running in 789b5134402d
2020-05-14T14:18:54.0452124Z Removing intermediate container 789b5134402d
2020-05-14T14:18:54.0452956Z  ---> 7c4c5ee2082e
2020-05-14T14:18:54.0453362Z Step 5/6 : ENTRYPOINT ["./scripts/entry"]
2020-05-14T14:18:54.0690358Z  ---> Running in dab9244c8b46
2020-05-14T14:18:55.0444433Z Removing intermediate container dab9244c8b46
2020-05-14T14:18:55.0445159Z  ---> a7627ac4ff19
2020-05-14T14:18:55.0445261Z Step 6/6 : CMD ["ci"]
2020-05-14T14:18:55.0668579Z  ---> Running in c7c3e2939731
2020-05-14T14:18:56.0420642Z Removing intermediate container c7c3e2939731
2020-05-14T14:18:56.0421830Z  ---> 3b9740910acd
2020-05-14T14:18:56.0513336Z Successfully built 3b9740910acd
2020-05-14T14:18:56.0587705Z Successfully tagged submariner:HEAD
2020-05-14T14:18:56.5605955Z [submariner]$ trap chown -R 1001:116 . exit
2020-05-14T14:18:56.5685920Z /opt/shipyard/scripts/e2e.sh --focus .\* cluster2 cluster3 cluster1
2020-05-14T14:18:56.5690007Z [submariner]$ mkdir -p bin dist output
2020-05-14T14:18:56.5690644Z [submariner]$ make e2e
2020-05-14T14:18:56.5691191Z Makefile:27: warning: overriding recipe for target 'vendor/modules.txt'
2020-05-14T14:18:56.5692243Z /opt/shipyard/Makefile.inc:30: warning: ignoring old recipe for target 'vendor/modules.txt'
2020-05-14T14:18:56.6182479Z [submariner]$ source /opt/shipyard/scripts/lib/utils
2020-05-14T14:18:56.6195107Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:18:56.6207757Z [submariner]$ script_name=utils
2020-05-14T14:18:56.6217418Z [submariner]$ exec_name=e2e.sh
2020-05-14T14:18:56.6233547Z [submariner]$ source /opt/shipyard/scripts/lib/cluster_settings
2020-05-14T14:18:56.6245655Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:18:56.6257978Z [submariner]$ script_name=cluster_settings
2020-05-14T14:18:56.6270125Z [submariner]$ exec_name=e2e.sh
2020-05-14T14:18:56.6290424Z [submariner]$ broker=cluster1
2020-05-14T14:18:56.6299338Z [submariner]$ declare -gA cluster_nodes
2020-05-14T14:18:56.6308765Z [submariner]$ cluster_nodes[cluster1]=control-plane worker
2020-05-14T14:18:56.6319692Z [submariner]$ cluster_nodes[cluster2]=control-plane worker
2020-05-14T14:18:56.6330176Z [submariner]$ cluster_nodes[cluster3]=control-plane worker worker
2020-05-14T14:18:56.6339970Z [submariner]$ declare -gA cluster_subm
2020-05-14T14:18:56.6350760Z [submariner]$ cluster_subm[cluster1]=true
2020-05-14T14:18:56.6360214Z [submariner]$ cluster_subm[cluster2]=true
2020-05-14T14:18:56.6396383Z [submariner]$ cluster_subm[cluster3]=true
2020-05-14T14:18:56.6398712Z [submariner]$ declare -gA cluster_cni
2020-05-14T14:18:56.6399783Z [submariner]$ cluster_cni[cluster2]=weave
2020-05-14T14:18:56.6411889Z [submariner]$ cluster_cni[cluster3]=weave
2020-05-14T14:18:56.6421300Z [submariner]$ declare_kubeconfig
2020-05-14T14:18:56.6434844Z [submariner]$ declare_kubeconfig
2020-05-14T14:18:56.6445548Z [submariner]$ source /opt/shipyard/scripts/lib/kubecfg
2020-05-14T14:18:56.6454338Z [submariner]$ export KUBECONFIG
2020-05-14T14:18:56.6484527Z [submariner]$ KUBECONFIG=
2020-05-14T14:18:56.6498319Z [submariner]$ find /go/src/github.com/submariner-io/submariner/output/kubeconfigs -type f -printf %p:
2020-05-14T14:18:56.6513243Z find: '/go/src/github.com/submariner-io/submariner/output/kubeconfigs': No such file or directory
2020-05-14T14:18:56.6525412Z [submariner]$ :
2020-05-14T14:18:56.6538555Z [submariner]$ deploy_env_once
2020-05-14T14:18:56.6548913Z [submariner]$ deploy_env_once
2020-05-14T14:18:56.6558869Z 
2020-05-14T14:18:57.2677592Z [submariner]$ make deploy
2020-05-14T14:18:57.2709610Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner'
2020-05-14T14:18:57.2740515Z Makefile:27: warning: overriding recipe for target 'vendor/modules.txt'
2020-05-14T14:18:57.2740814Z /opt/shipyard/Makefile.inc:30: warning: ignoring old recipe for target 'vendor/modules.txt'
2020-05-14T14:18:57.2744637Z go mod download
2020-05-14T14:18:57.5095464Z go: finding cloud.google.com/go v0.34.0
2020-05-14T14:18:57.5138933Z go: finding github.com/bronze1man/goStrongswanVici v0.0.0-20190921045355-4c81bd8d0bd5
2020-05-14T14:18:57.5184350Z go: finding github.com/coreos/go-iptables v0.4.5
2020-05-14T14:18:57.5216348Z go: finding github.com/davecgh/go-spew v1.1.1
2020-05-14T14:18:57.5244461Z go: finding github.com/docker/spdystream v0.0.0-20181023171402-6480d4af844c
2020-05-14T14:18:57.5280620Z go: finding github.com/evanphx/json-patch v4.5.0+incompatible
2020-05-14T14:18:57.5327807Z go: finding github.com/fsnotify/fsnotify v1.4.7
2020-05-14T14:18:57.5361215Z go: finding github.com/gogo/protobuf v0.0.0-20171007142547-342cbe0a0415
2020-05-14T14:18:57.5397002Z go: finding github.com/golang/groupcache v0.0.0-20200121045136-8c9f03a8e57e
2020-05-14T14:18:57.5441811Z go: finding github.com/golang/protobuf v1.2.0
2020-05-14T14:18:57.5480272Z go: finding github.com/google/btree v1.0.0
2020-05-14T14:18:57.5513083Z go: finding github.com/google/go-cmp v0.4.0
2020-05-14T14:18:57.5552192Z go: finding github.com/google/gofuzz v1.1.0
2020-05-14T14:18:57.5583801Z go: finding github.com/google/uuid v1.0.0
2020-05-14T14:18:57.5623885Z go: finding github.com/googleapis/gnostic v0.0.0-20170729233727-0c5108395e2d
2020-05-14T14:18:57.5660071Z go: finding github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79
2020-05-14T14:18:57.5700088Z go: finding github.com/hashicorp/golang-lru v0.5.4
2020-05-14T14:18:57.5748113Z go: finding github.com/imdario/mergo v0.3.8
2020-05-14T14:18:57.5784151Z go: finding github.com/jpillora/backoff v1.0.0
2020-05-14T14:18:57.5820285Z go: finding github.com/jsimonetti/rtnetlink v0.0.0-20200117123717-f846d4f6c1f4
2020-05-14T14:18:57.5853935Z go: finding github.com/json-iterator/go v1.1.9
2020-05-14T14:18:57.5890803Z go: finding github.com/kelseyhightower/envconfig v1.4.0
2020-05-14T14:18:57.5925467Z go: finding github.com/mdlayher/genetlink v1.0.0
2020-05-14T14:18:57.5974824Z go: finding github.com/mdlayher/netlink v1.1.0
2020-05-14T14:18:57.6019382Z go: finding github.com/mikioh/ipaddr v0.0.0-20190404000644-d465c8ab6721
2020-05-14T14:18:57.6060749Z go: finding github.com/modern-go/concurrent v0.0.0-20180228061459-e0a39a4cb421
2020-05-14T14:18:57.6095361Z go: finding github.com/modern-go/reflect2 v1.0.1
2020-05-14T14:18:57.6127630Z go: finding github.com/onsi/ginkgo v0.0.0-20191002161935-034fd2551d22
2020-05-14T14:18:57.6167206Z go: finding github.com/onsi/gomega v1.9.0
2020-05-14T14:18:57.6210751Z go: finding github.com/pborman/uuid v1.2.0
2020-05-14T14:18:57.6244809Z go: finding github.com/peterbourgon/diskv v2.0.1+incompatible
2020-05-14T14:18:57.6282776Z go: finding github.com/pkg/errors v0.9.1
2020-05-14T14:18:57.6319210Z go: finding github.com/pmezard/go-difflib v1.0.0
2020-05-14T14:18:57.6348648Z go: finding github.com/rdegges/go-ipify v0.0.0-20150526035502-2d94a6a86c40
2020-05-14T14:18:57.6382223Z go: finding github.com/spf13/pflag v1.0.5
2020-05-14T14:18:57.6413026Z go: finding github.com/stretchr/objx v0.1.0
2020-05-14T14:18:57.6460882Z go: finding github.com/stretchr/testify v1.3.0
2020-05-14T14:18:57.6496448Z go: finding github.com/submariner-io/shipyard v0.0.0-20200415131458-43e0c8dc8ea3
2020-05-14T14:18:57.6533714Z go: finding github.com/vishvananda/netlink v1.1.0
2020-05-14T14:18:57.6568267Z go: finding github.com/vishvananda/netns v0.0.0-20191106174202-0a2b9b5464df
2020-05-14T14:18:57.6609030Z go: finding golang.org/x/crypto v0.0.0-20200311171314-f7b00557c8c4
2020-05-14T14:18:57.6653299Z go: finding golang.org/x/net v0.0.0-20200202094626-16171245cfb2
2020-05-14T14:18:57.6688838Z go: finding golang.org/x/oauth2 v0.0.0-20200107190931-bf48bf16ab8d
2020-05-14T14:18:57.6727997Z go: finding golang.org/x/sync v0.0.0-20181221193216-37e7f081c4d4
2020-05-14T14:18:57.6768296Z go: finding golang.org/x/sys v0.0.0-20200202164722-d101bd2416d5
2020-05-14T14:18:57.6813408Z go: finding golang.org/x/text v0.3.2
2020-05-14T14:18:57.6846533Z go: finding golang.org/x/time v0.0.0-20190308202827-9d24e82272b4
2020-05-14T14:18:57.6897043Z go: finding golang.org/x/tools v0.0.0-20180917221912-90fa682c2a6e
2020-05-14T14:18:57.6934358Z go: finding golang.org/x/xerrors v0.0.0-20191204190536-9bdfabe68543
2020-05-14T14:18:57.6963180Z go: finding golang.zx2c4.com/wireguard v0.0.20200121
2020-05-14T14:18:57.6997835Z go: finding golang.zx2c4.com/wireguard/wgctrl v0.0.0-20200324154536-ceff61240acf
2020-05-14T14:18:57.7032952Z go: finding google.golang.org/appengine v1.4.0
2020-05-14T14:18:57.7071654Z go: finding gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405
2020-05-14T14:18:57.7186929Z go: finding gopkg.in/inf.v0 v0.9.1
2020-05-14T14:18:57.7221854Z go: finding gopkg.in/yaml.v2 v2.2.4
2020-05-14T14:18:57.7258227Z go: finding k8s.io/api v0.0.0-20190222213804-5cb15d344471
2020-05-14T14:18:57.7292863Z go: finding k8s.io/apimachinery v0.0.0-20190629003722-e20a3a656cff
2020-05-14T14:18:57.7329315Z go: finding k8s.io/client-go v0.0.0-20190521190702-177766529176
2020-05-14T14:18:57.7371326Z go: finding k8s.io/klog v0.0.0-20181108234604-8139d8cb77af
2020-05-14T14:18:57.7406687Z go: finding k8s.io/kube-openapi v0.0.0-20181109181836-c59034cc13d5
2020-05-14T14:18:57.7441687Z go: finding sigs.k8s.io/controller-runtime v0.1.12
2020-05-14T14:18:57.7483669Z go: finding sigs.k8s.io/yaml v0.0.0-20181102190223-fd68e9863619
2020-05-14T14:18:59.8746700Z go mod vendor
2020-05-14T14:19:00.3786203Z ./scripts/build --build_debug false
2020-05-14T14:19:00.3836695Z [submariner]$ source ./scripts/lib/version
2020-05-14T14:19:00.3848167Z [submariner]$ dirname ./scripts/build
2020-05-14T14:19:00.3868543Z [submariner]$ git status --porcelain --untracked-files=no
2020-05-14T14:19:00.4633315Z [submariner]$ COMMIT=6970a39
2020-05-14T14:19:00.4647329Z [submariner]$ git rev-parse --short HEAD
2020-05-14T14:19:00.5402129Z [submariner]$ GIT_TAG=
2020-05-14T14:19:00.5480465Z [submariner]$ git tag -l --contains HEAD
2020-05-14T14:19:00.5518866Z [submariner]$ head -n 1
2020-05-14T14:19:00.5847440Z [submariner]$ VERSION=dev
2020-05-14T14:19:00.5869728Z [submariner]$ cd ./scripts/
2020-05-14T14:19:00.5882852Z [submariner]$ dirname ./scripts/build
2020-05-14T14:19:00.5899003Z [scripts]$ LONGOPTS=build_debug:
2020-05-14T14:19:00.5905291Z [scripts]$ SHORTOPTS=
2020-05-14T14:19:00.5928980Z [scripts]$ PARSED= --build_debug 'false' --
2020-05-14T14:19:00.5942165Z [scripts]$ getopt --options= --longoptions=build_debug: --name ./scripts/build -- --build_debug false
2020-05-14T14:19:00.5956769Z [scripts]$ eval set --  --build_debug 'false' --
2020-05-14T14:19:00.5966934Z [scripts]$ set -- --build_debug false --
2020-05-14T14:19:00.5974445Z [scripts]$ true
2020-05-14T14:19:00.5982703Z [scripts]$ case --build_debug in
2020-05-14T14:19:00.5990581Z [scripts]$ build_debug=false
2020-05-14T14:19:00.6000193Z [scripts]$ shift 2
2020-05-14T14:19:00.6010177Z [scripts]$ true
2020-05-14T14:19:00.6021029Z [scripts]$ case -- in
2020-05-14T14:19:00.6029199Z [scripts]$ break
2020-05-14T14:19:00.6040461Z [scripts]$ ./build-engine false
2020-05-14T14:19:00.6089499Z [scripts]$ source ./lib/version
2020-05-14T14:19:00.6099623Z [scripts]$ dirname ./build-engine
2020-05-14T14:19:00.6124040Z [scripts]$ git status --porcelain --untracked-files=no
2020-05-14T14:19:00.6904877Z [scripts]$ COMMIT=6970a39
2020-05-14T14:19:00.6917108Z [scripts]$ git rev-parse --short HEAD
2020-05-14T14:19:00.7753393Z [scripts]$ GIT_TAG=
2020-05-14T14:19:00.7768775Z [scripts]$ git tag -l --contains HEAD
2020-05-14T14:19:00.7779702Z [scripts]$ head -n 1
2020-05-14T14:19:00.8128523Z [scripts]$ VERSION=dev
2020-05-14T14:19:00.8136275Z [scripts]$ build_debug=false
2020-05-14T14:19:00.8159252Z [scripts]$ cd ./..
2020-05-14T14:19:00.8174014Z [scripts]$ dirname ./build-engine
2020-05-14T14:19:00.8186529Z [submariner]$ mkdir -p bin
2020-05-14T14:19:00.8198393Z Building submariner-engine version dev
2020-05-14T14:19:00.8206487Z [submariner]$ ldflags=-X main.VERSION=dev
2020-05-14T14:19:00.8216177Z [submariner]$ ldflags=-s -w -X main.VERSION=dev
2020-05-14T14:19:00.8224494Z [submariner]$ CGO_ENABLED=0 go build -ldflags -s -w -X main.VERSION=dev -o bin/submariner-engine main.go
2020-05-14T14:19:41.0464630Z 
2020-05-14T14:19:41.0473686Z [submariner]$ upx bin/submariner-engine
2020-05-14T14:19:46.7105965Z                        Ultimate Packer for eXecutables
2020-05-14T14:19:46.7107375Z                           Copyright (C) 1996 - 2020
2020-05-14T14:19:46.7107681Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2020-05-14T14:19:46.7107869Z
2020-05-14T14:19:46.7108076Z         File size         Ratio      Format      Name
2020-05-14T14:19:46.7108869Z    --------------------   ------   -----------   -----------
2020-05-14T14:19:46.7109668Z   25620480 ->   8029520   31.34%   linux/amd64   submariner-engine
2020-05-14T14:19:46.7110172Z
2020-05-14T14:19:46.7110387Z Packed 1 file.
2020-05-14T14:19:46.7120298Z [scripts]$ ./build-routeagent false
2020-05-14T14:19:46.7168327Z [scripts]$ source ./lib/version
2020-05-14T14:19:46.7182181Z [scripts]$ dirname ./build-routeagent
2020-05-14T14:19:46.7207646Z [scripts]$ git status --porcelain --untracked-files=no
2020-05-14T14:19:46.7953779Z [scripts]$ COMMIT=6970a39
2020-05-14T14:19:46.7969413Z [scripts]$ git rev-parse --short HEAD
2020-05-14T14:19:46.8750934Z [scripts]$ GIT_TAG=
2020-05-14T14:19:46.8764488Z [scripts]$ git tag -l --contains HEAD
2020-05-14T14:19:46.8775199Z [scripts]$ head -n 1
2020-05-14T14:19:46.9174641Z [scripts]$ VERSION=dev
2020-05-14T14:19:46.9186369Z [scripts]$ build_debug=false
2020-05-14T14:19:46.9211061Z [scripts]$ cd ./..
2020-05-14T14:19:46.9222622Z [scripts]$ dirname ./build-routeagent
2020-05-14T14:19:46.9238549Z [submariner]$ mkdir -p bin
2020-05-14T14:19:46.9253320Z Building submariner-route-agent version dev
2020-05-14T14:19:46.9269124Z [submariner]$ ldflags=-X main.VERSION=dev
2020-05-14T14:19:46.9280627Z [submariner]$ ldflags=-s -w -X main.VERSION=dev
2020-05-14T14:19:46.9291500Z [submariner]$ CGO_ENABLED=0 go build -ldflags -s -w -X main.VERSION=dev -o bin/submariner-route-agent ./pkg/routeagent/main.go
2020-05-14T14:19:59.4061613Z 
2020-05-14T14:19:59.4068059Z [submariner]$ upx bin/submariner-route-agent
2020-05-14T14:20:04.9623623Z                        Ultimate Packer for eXecutables
2020-05-14T14:20:04.9625195Z                           Copyright (C) 1996 - 2020
2020-05-14T14:20:04.9625637Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2020-05-14T14:20:04.9625998Z
2020-05-14T14:20:04.9626194Z         File size         Ratio      Format      Name
2020-05-14T14:20:04.9626585Z    --------------------   ------   -----------   -----------
2020-05-14T14:20:04.9627210Z   25735168 ->   7824348   30.40%   linux/amd64   submariner-route-agent
2020-05-14T14:20:04.9627413Z
2020-05-14T14:20:04.9627605Z Packed 1 file.
2020-05-14T14:20:04.9638846Z [scripts]$ ./build-globalnet false
2020-05-14T14:20:04.9691498Z [scripts]$ source ./lib/version
2020-05-14T14:20:04.9701669Z [scripts]$ dirname ./build-globalnet
2020-05-14T14:20:04.9724352Z [scripts]$ git status --porcelain --untracked-files=no
2020-05-14T14:20:05.0524008Z [scripts]$ COMMIT=6970a39
2020-05-14T14:20:05.0539908Z [scripts]$ git rev-parse --short HEAD
2020-05-14T14:20:05.1319957Z [scripts]$ GIT_TAG=
2020-05-14T14:20:05.1331634Z [scripts]$ git tag -l --contains HEAD
2020-05-14T14:20:05.1341589Z [scripts]$ head -n 1
2020-05-14T14:20:05.1734523Z [scripts]$ VERSION=dev
2020-05-14T14:20:05.1741596Z [scripts]$ build_debug=false
2020-05-14T14:20:05.1770649Z [scripts]$ cd ./..
2020-05-14T14:20:05.1785862Z [scripts]$ dirname ./build-globalnet
2020-05-14T14:20:05.1802170Z [submariner]$ mkdir -p bin
2020-05-14T14:20:05.1815452Z Building submariner-globalnet version dev
2020-05-14T14:20:05.1826094Z [submariner]$ ldflags=-X main.VERSION=dev
2020-05-14T14:20:05.1839478Z [submariner]$ ldflags=-s -w -X main.VERSION=dev
2020-05-14T14:20:05.1850014Z [submariner]$ CGO_ENABLED=0 go build -ldflags -s -w -X main.VERSION=dev -o bin/submariner-globalnet ./pkg/globalnet/main.go
2020-05-14T14:20:08.5527469Z 
2020-05-14T14:20:08.5534241Z [submariner]$ upx bin/submariner-globalnet
2020-05-14T14:20:13.7886315Z                        Ultimate Packer for eXecutables
2020-05-14T14:20:13.7887538Z                           Copyright (C) 1996 - 2020
2020-05-14T14:20:13.7887926Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2020-05-14T14:20:13.7888112Z
2020-05-14T14:20:13.7888287Z         File size         Ratio      Format      Name
2020-05-14T14:20:13.7892055Z    --------------------   ------   -----------   -----------
2020-05-14T14:20:13.7893602Z   24707072 ->   7460676   30.20%   linux/amd64   submariner-globalnet
2020-05-14T14:20:13.7893814Z
2020-05-14T14:20:13.7893981Z Packed 1 file.
2020-05-14T14:20:13.7894212Z ./scripts/images
2020-05-14T14:20:13.7945324Z [submariner]$ source ./scripts/lib/version
2020-05-14T14:20:13.7958302Z [submariner]$ dirname ./scripts/images
2020-05-14T14:20:13.7975824Z [submariner]$ git status --porcelain --untracked-files=no
2020-05-14T14:20:13.8752955Z [submariner]$ COMMIT=6970a39
2020-05-14T14:20:13.8764832Z [submariner]$ git rev-parse --short HEAD
2020-05-14T14:20:13.9512116Z [submariner]$ GIT_TAG=
2020-05-14T14:20:13.9523983Z [submariner]$ git tag -l --contains HEAD
2020-05-14T14:20:13.9533378Z [submariner]$ head -n 1
2020-05-14T14:20:13.9905008Z [submariner]$ VERSION=dev
2020-05-14T14:20:13.9914804Z [submariner]$ extra_flags=
2020-05-14T14:20:13.9940312Z [submariner]$ cd ./scripts/../package
2020-05-14T14:20:13.9954554Z [submariner]$ dirname ./scripts/images
2020-05-14T14:20:13.9970597Z [package]$ cp ../bin/submariner-engine submariner-engine
2020-05-14T14:20:14.0084383Z [package]$ cp ../bin/submariner-route-agent submariner-route-agent
2020-05-14T14:20:14.0207379Z [package]$ cp ../bin/submariner-globalnet submariner-globalnet
2020-05-14T14:20:14.0307519Z [package]$ /opt/shipyard/scripts/build_image.sh -i submariner -f Dockerfile
2020-05-14T14:20:14.1812403Z [package]$ set -e
2020-05-14T14:20:14.1821452Z [package]$ local_image=quay.io/submariner/submariner:dev
2020-05-14T14:20:14.1829110Z [package]$ latest_image=quay.io/submariner/submariner:latest
2020-05-14T14:20:14.1839669Z [package]$ cache_flag=
2020-05-14T14:20:14.1852006Z [package]$ cache_flag=--cache-from quay.io/submariner/submariner:latest
2020-05-14T14:20:14.1861647Z [package]$ docker pull quay.io/submariner/submariner:latest
2020-05-14T14:20:14.6404129Z latest: Pulling from submariner/submariner
2020-05-14T14:20:14.6407501Z fe04b97b6519: Already exists
2020-05-14T14:20:14.6431564Z 99392855ad99: Pulling fs layer
2020-05-14T14:20:14.6434061Z 614d47f8d11c: Pulling fs layer
2020-05-14T14:20:14.6435985Z 682c86811a52: Pulling fs layer
2020-05-14T14:20:14.8745920Z 682c86811a52: Verifying Checksum
2020-05-14T14:20:14.9323704Z 614d47f8d11c: Verifying Checksum
2020-05-14T14:20:14.9324140Z 614d47f8d11c: Download complete
2020-05-14T14:20:14.9475781Z 99392855ad99: Verifying Checksum
2020-05-14T14:20:14.9475894Z 99392855ad99: Download complete
2020-05-14T14:20:14.9979341Z 99392855ad99: Pull complete
2020-05-14T14:20:15.5666696Z 614d47f8d11c: Pull complete
2020-05-14T14:20:15.6858165Z 682c86811a52: Pull complete
2020-05-14T14:20:15.6882335Z Digest: sha256:45046ef833a781f5b607d7e7ed7d9ef1d11bb043719fcc36b921fc99fd6b0f00
2020-05-14T14:20:15.6930062Z Status: Downloaded newer image for quay.io/submariner/submariner:latest
2020-05-14T14:20:15.6999421Z [package]$ docker build -t quay.io/submariner/submariner:dev --cache-from quay.io/submariner/submariner:latest -f Dockerfile .
2020-05-14T14:20:15.6999579Z quay.io/submariner/submariner:latest
2020-05-14T14:20:16.1779710Z Sending build context to Docker daemon  23.33MB
2020-05-14T14:20:16.1779829Z
2020-05-14T14:20:16.1812312Z Step 1/5 : FROM fedora:31
2020-05-14T14:20:16.3023283Z 31: Pulling from library/fedora
2020-05-14T14:20:16.3504949Z fe04b97b6519: Already exists
2020-05-14T14:20:16.4475116Z Digest: sha256:f2d15cd8f8424575f30fcf2df31384a1a8f6ace986764d98562779559546664d
2020-05-14T14:20:16.4498826Z Status: Downloaded newer image for fedora:31
2020-05-14T14:20:16.4507341Z  ---> 920eaf721cff
2020-05-14T14:20:16.4507496Z Step 2/5 : WORKDIR /var/submariner
2020-05-14T14:20:16.4540876Z  ---> Using cache
2020-05-14T14:20:16.4541093Z  ---> 4d020d5a85e0
2020-05-14T14:20:16.4542182Z Step 3/5 : RUN dnf -y distrosync --nodocs --setopt=install_weak_deps=False &&     dnf -y install --nodocs --setopt=install_weak_deps=False                    iproute iptables strongswan procps-ng &&     dnf -y clean all &&     rpm -e gnupg2 rpm-sign-libs gpgme dnf libdnf yum python3-rpm            python3-dnf python3-gpg librepo python3-libdnf python3-hawkey            glib2 libmodulemd libsolv libyaml libassuan            shadow-utils tss2 ima-evm-utils            zchunk-libs vim-minimal npth sudo tar libusbx acl dnf-data            libksba libreport-filesystem libsemanage libstdc++ openssl            python3-libcomps rpm-build-libs sssd-client
2020-05-14T14:20:16.4571578Z  ---> Using cache
2020-05-14T14:20:16.4571830Z  ---> 03b3cb050d9c
2020-05-14T14:20:16.4572089Z Step 4/5 : COPY submariner.sh submariner-engine /usr/local/bin/
2020-05-14T14:20:19.3657990Z  ---> b8e057621cb6
2020-05-14T14:20:19.3658166Z Step 5/5 : ENTRYPOINT submariner.sh
2020-05-14T14:20:19.3881798Z  ---> Running in d77ccbcedc99
2020-05-14T14:20:20.0285181Z Removing intermediate container d77ccbcedc99
2020-05-14T14:20:20.0286237Z  ---> 50266b49fdc5
2020-05-14T14:20:20.0313878Z Successfully built 50266b49fdc5
2020-05-14T14:20:20.0439218Z Successfully tagged quay.io/submariner/submariner:dev
2020-05-14T14:20:20.0443714Z [package]$ docker tag quay.io/submariner/submariner:dev quay.io/submariner/submariner:latest
2020-05-14T14:20:20.3594694Z [package]$ /opt/shipyard/scripts/build_image.sh -i submariner-route-agent -f Dockerfile.routeagent
2020-05-14T14:20:20.5107390Z [package]$ set -e
2020-05-14T14:20:20.5117332Z [package]$ local_image=quay.io/submariner/submariner-route-agent:dev
2020-05-14T14:20:20.5128123Z [package]$ latest_image=quay.io/submariner/submariner-route-agent:latest
2020-05-14T14:20:20.5139989Z [package]$ cache_flag=
2020-05-14T14:20:20.5148646Z [package]$ cache_flag=--cache-from quay.io/submariner/submariner-route-agent:latest
2020-05-14T14:20:20.5161543Z [package]$ docker pull quay.io/submariner/submariner-route-agent:latest
2020-05-14T14:20:20.9606099Z latest: Pulling from submariner/submariner-route-agent
2020-05-14T14:20:20.9607642Z e96e3a1df3b2: Pulling fs layer
2020-05-14T14:20:20.9607945Z 1b99828eddf5: Pulling fs layer
2020-05-14T14:20:20.9608541Z 47ad0195a687: Pulling fs layer
2020-05-14T14:20:20.9608836Z 24b6ce6dd6ca: Pulling fs layer
2020-05-14T14:20:20.9609155Z f54fbd0f9f89: Pulling fs layer
2020-05-14T14:20:20.9616584Z fe3359b7a2a8: Pulling fs layer
2020-05-14T14:20:20.9617049Z 179935354d07: Pulling fs layer
2020-05-14T14:20:20.9617273Z 024c4719638a: Pulling fs layer
2020-05-14T14:20:20.9617464Z 24b6ce6dd6ca: Waiting
2020-05-14T14:20:20.9617825Z f54fbd0f9f89: Waiting
2020-05-14T14:20:20.9618043Z fe3359b7a2a8: Waiting
2020-05-14T14:20:20.9618239Z 179935354d07: Waiting
2020-05-14T14:20:20.9622067Z 024c4719638a: Waiting
2020-05-14T14:20:21.0308774Z 1b99828eddf5: Verifying Checksum
2020-05-14T14:20:21.0310060Z 1b99828eddf5: Download complete
2020-05-14T14:20:21.0605173Z 47ad0195a687: Verifying Checksum
2020-05-14T14:20:21.0605804Z 47ad0195a687: Download complete
2020-05-14T14:20:21.2131212Z f54fbd0f9f89: Verifying Checksum
2020-05-14T14:20:21.2131445Z f54fbd0f9f89: Download complete
2020-05-14T14:20:21.2195569Z 24b6ce6dd6ca: Verifying Checksum
2020-05-14T14:20:21.2195844Z 24b6ce6dd6ca: Download complete
2020-05-14T14:20:21.3321626Z fe3359b7a2a8: Verifying Checksum
2020-05-14T14:20:21.3321865Z fe3359b7a2a8: Download complete
2020-05-14T14:20:21.4151636Z e96e3a1df3b2: Verifying Checksum
2020-05-14T14:20:21.4151780Z e96e3a1df3b2: Download complete
2020-05-14T14:20:21.4151907Z 179935354d07: Verifying Checksum
2020-05-14T14:20:21.4152002Z 179935354d07: Download complete
2020-05-14T14:20:21.8224687Z 024c4719638a: Verifying Checksum
2020-05-14T14:20:21.8224810Z 024c4719638a: Download complete
2020-05-14T14:20:23.3215987Z e96e3a1df3b2: Pull complete
2020-05-14T14:20:23.3651015Z 1b99828eddf5: Pull complete
2020-05-14T14:20:23.4035860Z 47ad0195a687: Pull complete
2020-05-14T14:20:23.4457839Z 24b6ce6dd6ca: Pull complete
2020-05-14T14:20:23.6607115Z f54fbd0f9f89: Pull complete
2020-05-14T14:20:23.7035861Z fe3359b7a2a8: Pull complete
2020-05-14T14:20:26.3617243Z 179935354d07: Pull complete
2020-05-14T14:20:26.4000021Z 024c4719638a: Pull complete
2020-05-14T14:20:26.4032746Z Digest: sha256:c7df327f7c37ec4c0e41c46799df182393b1fb4d062317a187115ade087579e9
2020-05-14T14:20:26.4061716Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:latest
2020-05-14T14:20:26.4080855Z quay.io/submariner/submariner-route-agent:latest
2020-05-14T14:20:26.4122154Z [package]$ docker build -t quay.io/submariner/submariner-route-agent:dev --cache-from quay.io/submariner/submariner-route-agent:latest -f Dockerfile.routeagent .
2020-05-14T14:20:26.8923277Z Sending build context to Docker daemon  23.33MB
2020-05-14T14:20:26.8927194Z
2020-05-14T14:20:26.8954061Z Step 1/9 : FROM registry.access.redhat.com/ubi8/ubi-minimal
2020-05-14T14:20:27.5440279Z latest: Pulling from ubi8/ubi-minimal
2020-05-14T14:20:27.9956030Z e96e3a1df3b2: Already exists
2020-05-14T14:20:27.9974425Z 1b99828eddf5: Already exists
2020-05-14T14:20:28.3945031Z Digest: sha256:326c94ab44d1472a30d47c49c2f896df687184830fc66a66de00c416885125b0
2020-05-14T14:20:28.3971001Z Status: Downloaded newer image for registry.access.redhat.com/ubi8/ubi-minimal:latest
2020-05-14T14:20:28.3978401Z  ---> 401e359e0f45
2020-05-14T14:20:28.3978522Z Step 2/9 : WORKDIR /var/submariner
2020-05-14T14:20:28.4011639Z  ---> Using cache
2020-05-14T14:20:28.4011866Z  ---> acbd6eac5a95
2020-05-14T14:20:28.4012099Z Step 3/9 : RUN mkdir -p /run/user/$(id -u)
2020-05-14T14:20:28.4040715Z  ---> Using cache
2020-05-14T14:20:28.4040978Z  ---> 070fd972e457
2020-05-14T14:20:28.4041252Z Step 4/9 : RUN microdnf -y install --nodocs iproute iptables &&     microdnf clean all
2020-05-14T14:20:28.4073254Z  ---> Using cache
2020-05-14T14:20:28.4073512Z  ---> 4fb57a3f84a1
2020-05-14T14:20:28.4073773Z Step 5/9 : COPY submariner-route-agent.sh /usr/local/bin
2020-05-14T14:20:29.4162727Z  ---> f4b6c3f58994
2020-05-14T14:20:29.4163079Z Step 6/9 : RUN chmod +x /usr/local/bin/submariner-route-agent.sh
2020-05-14T14:20:29.4608651Z  ---> Running in 5246ca0a0d5a
2020-05-14T14:20:31.0226836Z Removing intermediate container 5246ca0a0d5a
2020-05-14T14:20:31.0231202Z  ---> 3b9394549150
2020-05-14T14:20:31.0234461Z Step 7/9 : COPY submariner-route-agent /usr/local/bin
2020-05-14T14:20:32.2114237Z  ---> 4897f54dc4a8
2020-05-14T14:20:32.2114933Z Step 8/9 : COPY ./iptables-wrapper.in /usr/sbin/
2020-05-14T14:20:33.0305137Z  ---> e7fde4c6dc76
2020-05-14T14:20:33.0308098Z Step 9/9 : ENTRYPOINT submariner-route-agent.sh
2020-05-14T14:20:33.0531277Z  ---> Running in 91f46c16135d
2020-05-14T14:20:34.0221640Z Removing intermediate container 91f46c16135d
2020-05-14T14:20:34.0222801Z  ---> 01ab6e885284
2020-05-14T14:20:34.0252830Z Successfully built 01ab6e885284
2020-05-14T14:20:34.0318221Z Successfully tagged quay.io/submariner/submariner-route-agent:dev
2020-05-14T14:20:34.0400796Z [package]$ docker tag quay.io/submariner/submariner-route-agent:dev quay.io/submariner/submariner-route-agent:latest
2020-05-14T14:20:34.3568532Z [package]$ /opt/shipyard/scripts/build_image.sh -i submariner-globalnet -f Dockerfile.globalnet
2020-05-14T14:20:35.4238476Z [package]$ set -e
2020-05-14T14:20:35.4239418Z latest: Pulling from submariner/submariner-globalnet
2020-05-14T14:20:35.4240557Z [package]$ local_image=quay.io/submariner/submariner-globalnet:dev
2020-05-14T14:20:35.4241064Z [package]$ latest_image=quay.io/submariner/submariner-globalnet:latest
2020-05-14T14:20:35.4241463Z [package]$ cache_flag=
2020-05-14T14:20:35.4241887Z [package]$ cache_flag=--cache-from quay.io/submariner/submariner-globalnet:latest
2020-05-14T14:20:35.4242458Z [package]$ docker pull quay.io/submariner/submariner-globalnet:latest
2020-05-14T14:20:35.4242907Z 57de4da701b5: Pulling fs layer
2020-05-14T14:20:35.4242998Z cf0f3ebe9f53: Pulling fs layer
2020-05-14T14:20:35.4243246Z 0677f148dcd9: Pulling fs layer
2020-05-14T14:20:35.4243333Z 917dba3e51ec: Pulling fs layer
2020-05-14T14:20:35.4243402Z 0f375d33fc14: Pulling fs layer
2020-05-14T14:20:35.4243488Z 35a08462a035: Pulling fs layer
2020-05-14T14:20:35.4243574Z 6743bae0c0dc: Pulling fs layer
2020-05-14T14:20:35.4243662Z 917dba3e51ec: Waiting
2020-05-14T14:20:35.4243736Z 0f375d33fc14: Waiting
2020-05-14T14:20:35.4243821Z 35a08462a035: Waiting
2020-05-14T14:20:35.4243905Z 6743bae0c0dc: Waiting
2020-05-14T14:20:35.4243989Z cf0f3ebe9f53: Verifying Checksum
2020-05-14T14:20:35.4244059Z cf0f3ebe9f53: Download complete
2020-05-14T14:20:35.4244148Z 57de4da701b5: Verifying Checksum
2020-05-14T14:20:35.4244235Z 57de4da701b5: Download complete
2020-05-14T14:20:35.4244321Z 917dba3e51ec: Verifying Checksum
2020-05-14T14:20:35.4244389Z 917dba3e51ec: Download complete
2020-05-14T14:20:35.4244473Z 0f375d33fc14: Verifying Checksum
2020-05-14T14:20:35.4244557Z 0f375d33fc14: Download complete
2020-05-14T14:20:35.5005068Z 6743bae0c0dc: Verifying Checksum
2020-05-14T14:20:35.5005297Z 6743bae0c0dc: Download complete
2020-05-14T14:20:35.5391736Z 0677f148dcd9: Verifying Checksum
2020-05-14T14:20:35.5391921Z 0677f148dcd9: Download complete
2020-05-14T14:20:35.6440902Z 35a08462a035: Verifying Checksum
2020-05-14T14:20:35.6441131Z 35a08462a035: Download complete
2020-05-14T14:20:36.4147392Z 57de4da701b5: Pull complete
2020-05-14T14:20:36.4544911Z cf0f3ebe9f53: Pull complete
2020-05-14T14:20:36.4939273Z 0677f148dcd9: Pull complete
2020-05-14T14:20:36.6770382Z 917dba3e51ec: Pull complete
2020-05-14T14:20:36.7203924Z 0f375d33fc14: Pull complete
2020-05-14T14:20:36.8804387Z 35a08462a035: Pull complete
2020-05-14T14:20:36.9185462Z 6743bae0c0dc: Pull complete
2020-05-14T14:20:36.9211078Z Digest: sha256:32d6017d6f360af776fb025c74d997334cbee0d06f8b035575b5ba504cf31283
2020-05-14T14:20:36.9261457Z Status: Downloaded newer image for quay.io/submariner/submariner-globalnet:latest
2020-05-14T14:20:36.9266773Z quay.io/submariner/submariner-globalnet:latest
2020-05-14T14:20:36.9321195Z [package]$ docker build -t quay.io/submariner/submariner-globalnet:dev --cache-from quay.io/submariner/submariner-globalnet:latest -f Dockerfile.globalnet .
2020-05-14T14:20:37.3937126Z Sending build context to Docker daemon  23.33MB
2020-05-14T14:20:37.3937261Z
2020-05-14T14:20:37.3961616Z Step 1/8 : FROM registry.access.redhat.com/ubi8/ubi-minimal:8.0
2020-05-14T14:20:38.0343543Z 8.0: Pulling from ubi8/ubi-minimal
2020-05-14T14:20:38.4515541Z 57de4da701b5: Already exists
2020-05-14T14:20:38.4537163Z cf0f3ebe9f53: Already exists
2020-05-14T14:20:38.8526216Z Digest: sha256:c505667389712dc337986e29ffcb65116879ef27629dc3ce6e1b17727c06e78f
2020-05-14T14:20:38.8561611Z Status: Downloaded newer image for registry.access.redhat.com/ubi8/ubi-minimal:8.0
2020-05-14T14:20:38.8561935Z  ---> 8c980b20fbaa
2020-05-14T14:20:38.8562043Z Step 2/8 : WORKDIR /var/submariner
2020-05-14T14:20:38.8597869Z  ---> Using cache
2020-05-14T14:20:38.8598216Z  ---> 24e97ec66b88
2020-05-14T14:20:38.8598541Z Step 3/8 : RUN microdnf -y install --nodocs iproute iptables &&     microdnf clean all
2020-05-14T14:20:38.8629548Z  ---> Using cache
2020-05-14T14:20:38.8629850Z  ---> 2ce12d46234b
2020-05-14T14:20:38.8630109Z Step 4/8 : COPY submariner-globalnet.sh /usr/local/bin
2020-05-14T14:20:41.0092051Z  ---> a9929d37a58d
2020-05-14T14:20:41.0092956Z Step 5/8 : RUN chmod +x /usr/local/bin/submariner-globalnet.sh
2020-05-14T14:20:41.0746816Z  ---> Running in ac58c0414de3
2020-05-14T14:20:42.0142394Z Removing intermediate container ac58c0414de3
2020-05-14T14:20:42.0143084Z  ---> 1684f4b5c0fe
2020-05-14T14:20:42.0143348Z Step 6/8 : COPY submariner-globalnet /usr/local/bin
2020-05-14T14:20:43.2170355Z  ---> cb43507db91a
2020-05-14T14:20:43.2170750Z Step 7/8 : COPY ./iptables-wrapper.in /usr/sbin/
2020-05-14T14:20:44.0123657Z  ---> 86aad035aa58
2020-05-14T14:20:44.0123932Z Step 8/8 : ENTRYPOINT submariner-globalnet.sh
2020-05-14T14:20:44.0316817Z  ---> Running in f09dac24bc0c
2020-05-14T14:20:45.0145690Z Removing intermediate container f09dac24bc0c
2020-05-14T14:20:45.0146800Z  ---> 785f998ae612
2020-05-14T14:20:45.0191888Z Successfully built 785f998ae612
2020-05-14T14:20:45.0239964Z Successfully tagged quay.io/submariner/submariner-globalnet:dev
2020-05-14T14:20:45.0282362Z [package]$ docker tag quay.io/submariner/submariner-globalnet:dev quay.io/submariner/submariner-globalnet:latest
2020-05-14T14:20:45.3519080Z /opt/shipyard/scripts/clusters.sh --k8s_version 1.14.6 --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner/scripts/cluster_settings --cluster_settings /go/src/github.com/submariner-io/submariner/scripts/cluster_settings
2020-05-14T14:20:45.4214570Z Running with: k8s_version=1.14.6, globalnet=true, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner/scripts/cluster_settings, timeout=5m
2020-05-14T14:20:45.4236483Z [submariner]$ source /opt/shipyard/scripts/lib/utils
2020-05-14T14:20:45.4250607Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:20:45.4264873Z [submariner]$ script_name=utils
2020-05-14T14:20:45.4275099Z [submariner]$ exec_name=clusters.sh
2020-05-14T14:20:45.4296710Z [submariner]$ source /opt/shipyard/scripts/lib/cluster_settings
2020-05-14T14:20:45.4307997Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:20:45.4318359Z [submariner]$ script_name=cluster_settings
2020-05-14T14:20:45.4330931Z [submariner]$ exec_name=clusters.sh
2020-05-14T14:20:45.4354374Z [submariner]$ broker=cluster1
2020-05-14T14:20:45.4363607Z [submariner]$ declare -gA cluster_nodes
2020-05-14T14:20:45.4374790Z [submariner]$ cluster_nodes[cluster1]=control-plane worker
2020-05-14T14:20:45.4384950Z [submariner]$ cluster_nodes[cluster2]=control-plane worker
2020-05-14T14:20:45.4397294Z [submariner]$ cluster_nodes[cluster3]=control-plane worker worker
2020-05-14T14:20:45.4410729Z [submariner]$ declare -gA cluster_subm
2020-05-14T14:20:45.4419979Z [submariner]$ cluster_subm[cluster1]=true
2020-05-14T14:20:45.4432938Z [submariner]$ cluster_subm[cluster2]=true
2020-05-14T14:20:45.4443374Z [submariner]$ cluster_subm[cluster3]=true
2020-05-14T14:20:45.4453759Z [submariner]$ declare -gA cluster_cni
2020-05-14T14:20:45.4464016Z [submariner]$ cluster_cni[cluster2]=weave
2020-05-14T14:20:45.4475115Z [submariner]$ cluster_cni[cluster3]=weave
2020-05-14T14:20:45.4488341Z [submariner]$ source /go/src/github.com/submariner-io/submariner/scripts/cluster_settings
2020-05-14T14:20:45.4500279Z [submariner]$ cluster_nodes[cluster1]=control-plane worker
2020-05-14T14:20:45.4509743Z [submariner]$ cluster_nodes[cluster2]=control-plane worker worker
2020-05-14T14:20:45.4521725Z [submariner]$ cluster_nodes[cluster3]=control-plane worker worker
2020-05-14T14:20:45.4574242Z [submariner]$ cat
2020-05-14T14:20:45.4595441Z [submariner]$ typeset -p cluster_nodes
2020-05-14T14:20:45.4608083Z [submariner]$ cut -f 2- -d=
2020-05-14T14:20:45.4632635Z [submariner]$ typeset -p cluster_subm
2020-05-14T14:20:45.4649515Z [submariner]$ cut -f 2- -d=
2020-05-14T14:20:45.4672750Z Cluster settings::
2020-05-14T14:20:45.4673264Z   broker - 'cluster1'
2020-05-14T14:20:45.4673725Z   clusters - 'cluster1' 'cluster2' 'cluster3'
2020-05-14T14:20:45.4674102Z   nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker" )
2020-05-14T14:20:45.4674440Z   install submariner - ([cluster3]="true" [cluster2]="true" [cluster1]="true" )
2020-05-14T14:20:45.4688241Z [submariner]$ rm -rf /go/src/github.com/submariner-io/submariner/output/kubeconfigs
2020-05-14T14:20:45.4707174Z [submariner]$ mkdir -p /go/src/github.com/submariner-io/submariner/output/kubeconfigs
2020-05-14T14:20:45.4734351Z [submariner]$ run_local_registry
2020-05-14T14:20:45.4744414Z [submariner]$ run_local_registry
2020-05-14T14:20:45.4755842Z [submariner]$ registry_running
2020-05-14T14:20:45.4766240Z [submariner]$ registry_running
2020-05-14T14:20:45.4777715Z [submariner]$ docker ps --filter name=^/?kind-registry$
2020-05-14T14:20:45.4790477Z [submariner]$ grep kind-registry
2020-05-14T14:20:45.7986776Z [submariner]$ return 0
2020-05-14T14:20:45.7990294Z Deploying local registry kind-registry to serve images centrally.
2020-05-14T14:20:45.8001885Z [submariner]$ local volume_flag
2020-05-14T14:20:45.8014023Z [submariner]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2020-05-14T14:20:45.8024081Z [submariner]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 5000:5000 --restart=always --name kind-registry registry:2
2020-05-14T14:20:46.1300796Z Unable to find image 'registry:2' locally
2020-05-14T14:20:46.3168536Z 2: Pulling from library/registry
2020-05-14T14:20:46.4013889Z 486039affc0a: Pulling fs layer
2020-05-14T14:20:46.4014138Z ba51a3b098e6: Pulling fs layer
2020-05-14T14:20:46.4014238Z 8bb4c43d6c8e: Pulling fs layer
2020-05-14T14:20:46.4014335Z 6f5f453e5f2d: Pulling fs layer
2020-05-14T14:20:46.4014412Z 42bc10b72f42: Pulling fs layer
2020-05-14T14:20:46.4014507Z 6f5f453e5f2d: Waiting
2020-05-14T14:20:46.4014626Z 42bc10b72f42: Waiting
2020-05-14T14:20:46.5216564Z ba51a3b098e6: Verifying Checksum
2020-05-14T14:20:46.5216691Z ba51a3b098e6: Download complete
2020-05-14T14:20:46.5354575Z 486039affc0a: Verifying Checksum
2020-05-14T14:20:46.5354736Z 486039affc0a: Download complete
2020-05-14T14:20:46.5981402Z 8bb4c43d6c8e: Verifying Checksum
2020-05-14T14:20:46.5981539Z 8bb4c43d6c8e: Download complete
2020-05-14T14:20:46.6203473Z 6f5f453e5f2d: Verifying Checksum
2020-05-14T14:20:46.6203694Z 6f5f453e5f2d: Download complete
2020-05-14T14:20:46.6419909Z 42bc10b72f42: Verifying Checksum
2020-05-14T14:20:46.6420070Z 42bc10b72f42: Download complete
2020-05-14T14:20:46.6601997Z 486039affc0a: Pull complete
2020-05-14T14:20:46.7493246Z ba51a3b098e6: Pull complete
2020-05-14T14:20:46.9582282Z 8bb4c43d6c8e: Pull complete
2020-05-14T14:20:46.9962900Z 6f5f453e5f2d: Pull complete
2020-05-14T14:20:47.0330353Z 42bc10b72f42: Pull complete
2020-05-14T14:20:47.0361777Z Digest: sha256:7d081088e4bfd632a88e3f3bcd9e007ef44a796fddfe3261407a3f9f04abe1e7
2020-05-14T14:20:47.0384745Z Status: Downloaded newer image for registry:2
2020-05-14T14:20:47.4272503Z caa97f5e66b4a283744e6933ce4bc07c422947370f80beca03c1ecc1c581c91f
2020-05-14T14:20:48.1657060Z [submariner]$ registry_ip=172.17.0.3
2020-05-14T14:20:48.1677688Z [submariner]$ docker inspect -f {{.NetworkSettings.IPAddress}} kind-registry
2020-05-14T14:20:48.4852344Z [submariner]$ declare_cidrs
2020-05-14T14:20:48.4861763Z [submariner]$ declare_cidrs
2020-05-14T14:20:48.4875984Z [submariner]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2020-05-14T14:20:48.4885245Z [submariner]$ i=1
2020-05-14T14:20:48.4899020Z [submariner]$ [cluster1] add_cluster_cidrs 1 cluster1
2020-05-14T14:20:48.4910087Z [submariner]$ [cluster1] add_cluster_cidrs 1 cluster1
2020-05-14T14:20:48.4921801Z [submariner]$ [cluster1] local val=1
2020-05-14T14:20:48.4931940Z [submariner]$ [cluster1] local idx=cluster1
2020-05-14T14:20:48.4944206Z [submariner]$ [cluster1] val=0
2020-05-14T14:20:48.4954316Z [submariner]$ [cluster1] cluster_CIDRs[cluster1]=10.240.0.0/16
2020-05-14T14:20:48.4965412Z [submariner]$ [cluster1] service_CIDRs[cluster1]=100.90.0.0/16
2020-05-14T14:20:48.4977880Z [submariner]$ [cluster1] global_CIDRs[cluster1]=169.254.1.0/24
2020-05-14T14:20:48.4987885Z [submariner]$ [cluster1] i=2
2020-05-14T14:20:48.5001575Z [submariner]$ [cluster2] add_cluster_cidrs 2 cluster2
2020-05-14T14:20:48.5012284Z [submariner]$ [cluster2] add_cluster_cidrs 2 cluster2
2020-05-14T14:20:48.5021972Z [submariner]$ [cluster2] local val=2
2020-05-14T14:20:48.5038226Z [submariner]$ [cluster2] local idx=cluster2
2020-05-14T14:20:48.5049242Z [submariner]$ [cluster2] val=0
2020-05-14T14:20:48.5061547Z [submariner]$ [cluster2] cluster_CIDRs[cluster2]=10.240.0.0/16
2020-05-14T14:20:48.5072482Z [submariner]$ [cluster2] service_CIDRs[cluster2]=100.90.0.0/16
2020-05-14T14:20:48.5084594Z [submariner]$ [cluster2] global_CIDRs[cluster2]=169.254.2.0/24
2020-05-14T14:20:48.5094015Z [submariner]$ [cluster2] i=3
2020-05-14T14:20:48.5105481Z [submariner]$ [cluster3] add_cluster_cidrs 3 cluster3
2020-05-14T14:20:48.5115659Z [submariner]$ [cluster3] add_cluster_cidrs 3 cluster3
2020-05-14T14:20:48.5128157Z [submariner]$ [cluster3] local val=3
2020-05-14T14:20:48.5138573Z [submariner]$ [cluster3] local idx=cluster3
2020-05-14T14:20:48.5148750Z [submariner]$ [cluster3] val=0
2020-05-14T14:20:48.5161585Z [submariner]$ [cluster3] cluster_CIDRs[cluster3]=10.240.0.0/16
2020-05-14T14:20:48.5171449Z [submariner]$ [cluster3] service_CIDRs[cluster3]=100.90.0.0/16
2020-05-14T14:20:48.5183609Z [submariner]$ [cluster3] global_CIDRs[cluster3]=169.254.3.0/24
2020-05-14T14:20:48.5197379Z [submariner]$ [cluster3] i=4
2020-05-14T14:20:48.5212361Z [submariner]$ [cluster3] run_all_clusters with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5224464Z [submariner]$ [cluster3] run_all_clusters with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5235275Z [submariner]$ [cluster3] run_parallel cluster1 cluster2 cluster3 with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5245744Z [submariner]$ [cluster3] run_parallel cluster1 cluster2 cluster3 cluster1 cluster2 cluster3 with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5255916Z [submariner]$ [cluster3] local cmnd=with_retries
2020-05-14T14:20:48.5265683Z [submariner]$ [cluster3] declare -A pids
2020-05-14T14:20:48.5282173Z [submariner]$ [cluster3] eval echo cluster1 cluster2 cluster3
2020-05-14T14:20:48.5301740Z [submariner]$ [cluster1] pids[cluster1]=2589
2020-05-14T14:20:48.5307583Z [submariner]$ [cluster1] set -o pipefail
2020-05-14T14:20:48.5320097Z [submariner]$ [cluster1] with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5323347Z [submariner]$ [cluster2] pids[cluster2]=2592
2020-05-14T14:20:48.5347180Z [submariner]$ [cluster3] pids[cluster3]=2597
2020-05-14T14:20:48.5354617Z [submariner]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2020-05-14T14:20:48.5361691Z [submariner]$ [cluster2] set -o pipefail
2020-05-14T14:20:48.5372920Z [submariner]$ [cluster3] wait 2597
2020-05-14T14:20:48.5381077Z [submariner]$ [cluster3] set -o pipefail
2020-05-14T14:20:48.5392271Z [submariner]$ [cluster3] with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5402928Z [submariner]$ [cluster2] with_retries 3 create_kind_cluster
2020-05-14T14:20:48.5415066Z [submariner]$ [cluster3] sed /\[cluster3]/!s/^/[cluster3] /
2020-05-14T14:20:48.5425823Z [submariner]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2020-05-14T14:25:13.5963307Z [submariner]$ [cluster2] with_retries
2020-05-14T14:25:13.5963622Z [submariner]$ [cluster2] local retries
2020-05-14T14:25:13.5964262Z [submariner]$ [cluster2] retries=1 2 3
2020-05-14T14:25:13.5964555Z [submariner]$ [cluster2] eval echo {1..3}
2020-05-14T14:25:13.5964819Z [submariner]$ [cluster2] local cmnd=create_kind_cluster
2020-05-14T14:25:13.5965068Z [submariner]$ [cluster2] wait 2634
2020-05-14T14:25:13.5965314Z [submariner]$ [cluster2] create_kind_cluster
2020-05-14T14:25:13.5965541Z [submariner]$ [cluster2] create_kind_cluster
2020-05-14T14:25:13.5965877Z [submariner]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:25:13.5966378Z [submariner]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:25:13.5966639Z [submariner]$ [cluster2] kind get clusters
2020-05-14T14:25:13.5966885Z [submariner]$ [cluster2] grep -q ^cluster2$
2020-05-14T14:25:13.5966994Z [cluster2] Creating KIND cluster...
2020-05-14T14:25:13.5967234Z [submariner]$ [cluster2] generate_cluster_yaml
2020-05-14T14:25:13.5967486Z [submariner]$ [cluster2] generate_cluster_yaml
2020-05-14T14:25:13.5967744Z [submariner]$ [cluster2] local pod_cidr=10.240.0.0/16
2020-05-14T14:25:13.5968007Z [submariner]$ [cluster2] local service_cidr=100.90.0.0/16
2020-05-14T14:25:13.5968250Z [submariner]$ [cluster2] local dns_domain=cluster2.local
2020-05-14T14:25:13.5968505Z [submariner]$ [cluster2] local disable_cni=false
2020-05-14T14:25:13.5968751Z [submariner]$ [cluster2] disable_cni=true
2020-05-14T14:25:13.5968988Z [submariner]$ [cluster2] local nodes
2020-05-14T14:25:13.5969207Z [submariner]$ [cluster2] nodes=
2020-05-14T14:25:13.5969434Z [cluster2] - role: control-plane
2020-05-14T14:25:13.5969788Z [submariner]$ [cluster2] nodes=
2020-05-14T14:25:13.5970012Z [cluster2] - role: control-plane
2020-05-14T14:25:13.5970215Z [cluster2] - role: worker
2020-05-14T14:25:13.5970448Z [submariner]$ [cluster2] nodes=
2020-05-14T14:25:13.5970674Z [cluster2] - role: control-plane
2020-05-14T14:25:13.5970889Z [cluster2] - role: worker
2020-05-14T14:25:13.5971088Z [cluster2] - role: worker
2020-05-14T14:25:13.5972459Z [cluster2] 
2020-05-14T14:25:13.5972688Z [cluster2] 
2020-05-14T14:25:13.5972946Z [submariner]$ [cluster2] eval echo "kind: Cluster
2020-05-14T14:25:13.5973188Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2020-05-14T14:25:13.5973298Z [cluster2] networking:
2020-05-14T14:25:13.5973406Z [cluster2]   disableDefaultCNI: ${disable_cni}
2020-05-14T14:25:13.5973513Z [cluster2] containerdConfigPatches:
2020-05-14T14:25:13.5973734Z [cluster2] - |-
2020-05-14T14:25:13.5973843Z [cluster2]   [plugins.cri.registry.mirrors.\"localhost:5000\"]
2020-05-14T14:25:13.5974021Z [cluster2]     endpoint = [\"http://${registry_ip}:5000\"]
2020-05-14T14:25:13.5974137Z [cluster2] kubeadmConfigPatches:
2020-05-14T14:25:13.5974359Z [cluster2] - |
2020-05-14T14:25:13.5974452Z [cluster2]   apiVersion: kubeadm.k8s.io/v1beta1
2020-05-14T14:25:13.5974559Z [cluster2]   kind: ClusterConfiguration
2020-05-14T14:25:13.5974663Z [cluster2]   metadata:
2020-05-14T14:25:13.5974767Z [cluster2]     name: config
2020-05-14T14:25:13.5974853Z [cluster2]   networking:
2020-05-14T14:25:13.5974958Z [cluster2]     podSubnet: ${pod_cidr}
2020-05-14T14:25:13.5975458Z [cluster2]     serviceSubnet: ${service_cidr}
2020-05-14T14:25:13.5975557Z [cluster2]     dnsDomain: ${dns_domain}
2020-05-14T14:25:13.5975770Z [cluster2] nodes:${nodes}"
2020-05-14T14:25:13.5976219Z [submariner]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2020-05-14T14:25:13.5976490Z [submariner]$ [cluster2] local image_flag=
2020-05-14T14:25:13.5976765Z [submariner]$ [cluster2] image_flag=--image=kindest/node:v1.14.6
2020-05-14T14:25:13.5977250Z [submariner]$ [cluster2] kind create cluster --image=kindest/node:v1.14.6 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2020-05-14T14:25:13.5977399Z [cluster2] Creating cluster "cluster2" ...
2020-05-14T14:25:13.5977734Z [cluster2]  • Ensuring node image (kindest/node:v1.14.6) 🖼  ...
2020-05-14T14:25:13.5978013Z [cluster2]  ✓ Ensuring node image (kindest/node:v1.14.6) 🖼
2020-05-14T14:25:13.5978254Z [cluster2]  • Preparing nodes 📦  ...
2020-05-14T14:25:13.5978473Z [cluster2]  ✓ Preparing nodes 📦
2020-05-14T14:25:13.5978721Z [cluster2]  • Writing configuration 📜  ...
2020-05-14T14:25:13.5978962Z [cluster2]  ✓ Writing configuration 📜
2020-05-14T14:25:13.5979208Z [cluster2]  • Starting control-plane 🕹️  ...
2020-05-14T14:25:13.5979635Z [cluster2]  ✓ Starting control-plane 🕹️
2020-05-14T14:25:13.5979885Z [cluster2]  • Installing StorageClass 💾  ...
2020-05-14T14:25:13.5980534Z [cluster2]  ✓ Installing StorageClass 💾
2020-05-14T14:25:13.5980785Z [cluster2]  • Joining worker nodes 🚜  ...
2020-05-14T14:25:13.5981006Z [cluster2]  ✓ Joining worker nodes 🚜
2020-05-14T14:25:13.5981300Z [cluster2] Set kubectl context to "kind-cluster2"
2020-05-14T14:25:13.5981410Z [cluster2] You can now use your cluster with:
2020-05-14T14:25:13.5981511Z [cluster2]
2020-05-14T14:25:13.5981751Z [cluster2] kubectl cluster-info --context kind-cluster2
2020-05-14T14:25:13.5981863Z [cluster2]
2020-05-14T14:25:13.5982202Z [cluster2] Not sure what to do next? 😅 Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2020-05-14T14:25:13.5982487Z [submariner]$ [cluster2] kind_fixup_config
2020-05-14T14:25:13.5982721Z [submariner]$ [cluster2] kind_fixup_config
2020-05-14T14:25:13.5982992Z [submariner]$ [cluster2] local master_ip=172.17.0.8
2020-05-14T14:25:13.5983418Z [submariner]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2020-05-14T14:25:13.5983681Z [submariner]$ [cluster2] head -n 1
2020-05-14T14:25:24.1268318Z [submariner]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.17.0.8:6443/g /go/src/github.com/submariner-io/submariner/output[submariner]$ [cluster1] with_retries
2020-05-14T14:25:24.1268820Z [submariner]$ [cluster1] local retries
2020-05-14T14:25:24.1269077Z [submariner]$ [cluster1] retries=1 2 3
2020-05-14T14:25:24.1269281Z [submariner]$ [cluster1] eval echo {1..3}
2020-05-14T14:25:24.1269539Z [submariner]$ [cluster1] local cmnd=create_kind_cluster
2020-05-14T14:25:24.1269976Z [submariner]$ [cluster1] wait 2627
2020-05-14T14:25:24.1270216Z [submariner]$ [cluster1] create_kind_cluster
2020-05-14T14:25:24.1270424Z [submariner]$ [cluster1] create_kind_cluster
2020-05-14T14:25:24.1270863Z [submariner]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1271201Z [submariner]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1271458Z [submariner]$ [cluster1] kind get clusters
2020-05-14T14:25:24.1271706Z [submariner]$ [cluster1] grep -q ^cluster1$
2020-05-14T14:25:24.1271786Z [cluster1] Creating KIND cluster...
2020-05-14T14:25:24.1272035Z [submariner]$ [cluster1] generate_cluster_yaml
2020-05-14T14:25:24.1272458Z [submariner]$ [cluster1] generate_cluster_yaml
2020-05-14T14:25:24.1273113Z [submariner]$ [cluster1] local pod_cidr=10.240.0.0/16
2020-05-14T14:25:24.1273512Z [submariner]$ [cluster1] local service_cidr=100.90.0.0/16
2020-05-14T14:25:24.1273792Z [submariner]$ [cluster1] local dns_domain=cluster1.local
2020-05-14T14:25:24.1274312Z [submariner]$ [cluster1] local disable_cni=false
2020-05-14T14:25:24.1274576Z [submariner]$ [cluster1] local nodes
2020-05-14T14:25:24.1274960Z [submariner]$ [cluster1] nodes=
2020-05-14T14:25:24.1275227Z [cluster1] - role: control-plane
2020-05-14T14:25:24.1275483Z [submariner]$ [cluster1] nodes=
2020-05-14T14:25:24.1275912Z [cluster1] - role: control-plane
2020-05-14T14:25:24.1276847Z [cluster1] - role: worker
2020-05-14T14:25:24.1277396Z [cluster1] 
2020-05-14T14:25:24.1277610Z [cluster1] 
2020-05-14T14:25:24.1277862Z [submariner]$ [cluster1] eval echo "kind: Cluster
2020-05-14T14:25:24.1278133Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2020-05-14T14:25:24.1278211Z [cluster1] networking:
2020-05-14T14:25:24.1278315Z [cluster1]   disableDefaultCNI: ${disable_cni}
2020-05-14T14:25:24.1278417Z [cluster1] containerdConfigPatches:
2020-05-14T14:25:24.1278631Z [cluster1] - |-
2020-05-14T14:25:24.1278706Z [cluster1]   [plugins.cri.registry.mirrors.\"localhost:5000\"]
2020-05-14T14:25:24.1278963Z [cluster1]     endpoint = [\"http://${registry_ip}:5000\"]
2020-05-14T14:25:24.1279075Z [cluster1] kubeadmConfigPatches:
2020-05-14T14:25:24.1279329Z [cluster1] - |
2020-05-14T14:25:24.1279401Z [cluster1]   apiVersion: kubeadm.k8s.io/v1beta1
2020-05-14T14:25:24.1279507Z [cluster1]   kind: ClusterConfiguration
2020-05-14T14:25:24.1279645Z [cluster1]   metadata:
2020-05-14T14:25:24.1279749Z [cluster1]     name: config
2020-05-14T14:25:24.1279818Z [cluster1]   networking:
2020-05-14T14:25:24.1280100Z [cluster1]     podSubnet: ${pod_cidr}
2020-05-14T14:25:24.1280207Z [cluster1]     serviceSubnet: ${service_cidr}
2020-05-14T14:25:24.1280313Z [cluster1]     dnsDomain: ${dns_domain}
2020-05-14T14:25:24.1280519Z [cluster1] nodes:${nodes}"
2020-05-14T14:25:24.1280818Z [submariner]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2020-05-14T14:25:24.1281087Z [submariner]$ [cluster1] local image_flag=
2020-05-14T14:25:24.1281372Z [submariner]$ [cluster1] image_flag=--image=kindest/node:v1.14.6
2020-05-14T14:25:24.1281696Z [submariner]$ [cluster1] kind create cluster --image=kindest/node:v1.14.6 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2020-05-14T14:25:24.1281867Z [cluster1] Creating cluster "cluster1" ...
2020-05-14T14:25:24.1282267Z [cluster1]  • Ensuring node image (kindest/node:v1.14.6) 🖼  ...
2020-05-14T14:25:24.1282555Z [cluster1]  ✓ Ensuring node image (kindest/node:v1.14.6) 🖼
2020-05-14T14:25:24.1283197Z [cluster1]  • Preparing nodes 📦  ...
2020-05-14T14:25:24.1284568Z [cluster1]  ✓ Preparing nodes 📦
2020-05-14T14:25:24.1284977Z [cluster1]  • Writing configuration 📜  ...
2020-05-14T14:25:24.1285295Z [cluster1]  ✓ Writing configuration 📜
2020-05-14T14:25:24.1285676Z [cluster1]  • Starting control-plane 🕹️  ...
2020-05-14T14:25:24.1285924Z [cluster1]  ✓ Starting control-plane 🕹️
2020-05-14T14:25:24.1286220Z [cluster1]  • Installing CNI 🔌  ...
2020-05-14T14:25:24.1286628Z [cluster1]  ✓ Installing CNI 🔌
2020-05-14T14:25:24.1286923Z [cluster1]  • Installing StorageClass 💾  ...
2020-05-14T14:25:24.1287164Z [cluster1]  ✓ Installing StorageClass 💾
2020-05-14T14:25:24.1287466Z [cluster1]  • Joining worker nodes 🚜  ...
2020-05-14T14:25:24.1287763Z [cluster1]  ✓ Joining worker nodes 🚜
2020-05-14T14:25:24.1288581Z [cluster1] Set kubectl context to "kind-cluster1"
2020-05-14T14:25:24.1288839Z [cluster1] You can now use your cluster with:
2020-05-14T14:25:24.1288967Z [cluster1]
2020-05-14T14:25:24.1289248Z [cluster1] kubectl cluster-info --context kind-cluster1
2020-05-14T14:25:24.1289381Z [cluster1]
2020-05-14T14:25:24.1289852Z [cluster1] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2020-05-14T14:25:24.1290187Z [submariner]$ [cluster1] kind_fixup_config
2020-05-14T14:25:24.1290454Z [submariner]$ [cluster1] kind_fixup_config
2020-05-14T14:25:24.1290723Z [submariner]$ [cluster1] local master_ip=172.17.0.6
2020-05-14T14:25:24.1291260Z [submariner]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2020-05-14T14:25:24.1291476Z [submariner]$ [cluster1] head -n 1
2020-05-14T14:25:24.1300392Z [submariner]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.17.0.6:6443/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1671739Z [submariner]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1672281Z [submariner]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1672669Z [submariner]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1673339Z [submariner]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1673696Z [submariner]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1
2020-05-14T14:25:24.1673931Z [submariner]$ [cluster1] wait 4506
2020-05-14T14:25:24.1674215Z [submariner]$ [cluster1] deploy_cni
2020-05-14T14:25:24.1674643Z [submariner]$ [cluster1] deploy_cni
2020-05-14T14:25:24.1675092Z [submariner]$ [cluster1] return 0
2020-05-14T14:25:24.1675309Z [submariner]$ [cluster1] return 0
2020-05-14T14:25:38.6644593Z [submariner]$ [cluster3] with_retries
2020-05-14T14:25:38.6645671Z [submariner]$ [cluster3] local retries
2020-05-14T14:25:38.6646253Z [submariner]$ [cluster3] retries=1 2 3
2020-05-14T14:25:38.6647176Z [submariner]$ [cluster3] eval echo {1..3}
2020-05-14T14:25:38.6647860Z [submariner]$ [cluster3] local cmnd=create_kind_cluster
2020-05-14T14:25:38.6648579Z [submariner]$ [cluster3] wait 2641
2020-05-14T14:25:38.6649165Z [submariner]$ [cluster3] create_kind_cluster
2020-05-14T14:25:38.6649731Z [submariner]$ [cluster3] create_kind_cluster
2020-05-14T14:25:38.6650586Z [submariner]$ [cluster3] export KUBECONFIG=/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:25:38.6651515Z [submariner]$ [cluster3] rm -f /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:25:38.6652154Z [submariner]$ [cluster3] kind get clusters
2020-05-14T14:25:38.6652685Z [submariner]$ [cluster3] grep -q ^cluster3$
2020-05-14T14:25:38.6653241Z [cluster3] Creating KIND cluster...
2020-05-14T14:25:38.6653829Z [submariner]$ [cluster3] generate_cluster_yaml
2020-05-14T14:25:38.6654553Z [submariner]$ [cluster3] generate_cluster_yaml
2020-05-14T14:25:38.6655141Z [submariner]$ [cluster3] local pod_cidr=10.240.0.0/16
2020-05-14T14:25:38.6655670Z [submariner]$ [cluster3] local service_cidr=100.90.0.0/16
2020-05-14T14:25:38.6656608Z [submariner]$ [cluster3] local dns_domain=cluster3.local
2020-05-14T14:25:38.6657426Z [submariner]$ [cluster3] local disable_cni=false
2020-05-14T14:25:38.6658034Z [submariner]$ [cluster3] disable_cni=true
2020-05-14T14:25:38.6658613Z [submariner]$ [cluster3] local nodes
2020-05-14T14:25:38.6659309Z [submariner]$ [cluster3] nodes=
2020-05-14T14:25:38.6660056Z [cluster3] - role: control-plane
2020-05-14T14:25:38.6660613Z [submariner]$ [cluster3] nodes=
2020-05-14T14:25:38.6661785Z [cluster3] - role: control-plane
2020-05-14T14:25:38.6662480Z [cluster3] - role: worker
2020-05-14T14:25:38.6663051Z [submariner]$ [cluster3] nodes=
2020-05-14T14:25:38.6663837Z [cluster3] - role: control-plane
2020-05-14T14:25:38.6664478Z [cluster3] - role: worker
2020-05-14T14:25:38.6665520Z [cluster3] - role: worker
2020-05-14T14:25:38.6666393Z [cluster3] 
2020-05-14T14:25:38.6667165Z [cluster3] 
2020-05-14T14:25:38.6671465Z [submariner]$ [cluster3] eval echo "kind: Cluster
2020-05-14T14:25:38.6671763Z [cluster3] apiVersion: kind.x-k8s.io/v1alpha4
2020-05-14T14:25:38.6672055Z [cluster3] networking:
2020-05-14T14:25:38.6672184Z [cluster3]   disableDefaultCNI: ${disable_cni}
2020-05-14T14:25:38.6672256Z [cluster3] containerdConfigPatches:
2020-05-14T14:25:38.6672702Z [cluster3] - |-
2020-05-14T14:25:38.6672828Z [cluster3]   [plugins.cri.registry.mirrors.\"localhost:5000\"]
2020-05-14T14:25:38.6672997Z [cluster3]     endpoint = [\"http://${registry_ip}:5000\"]
2020-05-14T14:25:38.6673256Z [cluster3] kubeadmConfigPatches:
2020-05-14T14:25:38.6673498Z [cluster3] - |
2020-05-14T14:25:38.6673646Z [cluster3]   apiVersion: kubeadm.k8s.io/v1beta1
2020-05-14T14:25:38.6673770Z [cluster3]   kind: ClusterConfiguration
2020-05-14T14:25:38.6673962Z [cluster3]   metadata:
2020-05-14T14:25:38.6674085Z [cluster3]     name: config
2020-05-14T14:25:38.6674209Z [cluster3]   networking:
2020-05-14T14:25:38.6674377Z [cluster3]     podSubnet: ${pod_cidr}
2020-05-14T14:25:38.6674455Z [cluster3]     serviceSubnet: ${service_cidr}
2020-05-14T14:25:38.6674767Z [cluster3]     dnsDomain: ${dns_domain}
2020-05-14T14:25:38.6675259Z [cluster3] nodes:${nodes}"
2020-05-14T14:25:38.6675796Z [submariner]$ [cluster3] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2020-05-14T14:25:38.6676118Z [submariner]$ [cluster3] local image_flag=
2020-05-14T14:25:38.6676886Z [submariner]$ [cluster3] image_flag=--image=kindest/node:v1.14.6
2020-05-14T14:25:38.6677372Z [submariner]$ [cluster3] kind create cluster --image=kindest/node:v1.14.6 --name=cluster3 --config=/opt/shipyard/scripts/resources/cluster3-config.yaml
2020-05-14T14:25:38.6677545Z [cluster3] Creating cluster "cluster3" ...
2020-05-14T14:25:38.6677886Z [cluster3]  • Ensuring node image (kindest/node:v1.14.6) 🖼  ...
2020-05-14T14:25:38.6678316Z [cluster3]  ✓ Ensuring node image (kindest/node:v1.14.6) 🖼
2020-05-14T14:25:38.6678638Z [cluster3]  • Preparing nodes 📦  ...
2020-05-14T14:25:38.6679233Z [cluster3]  ✓ Preparing nodes 📦
2020-05-14T14:25:38.6679545Z [cluster3]  • Writing configuration 📜  ...
2020-05-14T14:25:38.6680038Z [cluster3]  ✓ Writing configuration 📜
2020-05-14T14:25:38.6680271Z [cluster3]  • Starting control-plane 🕹️  ...
2020-05-14T14:25:38.6680695Z [cluster3]  ✓ Starting control-plane 🕹️
2020-05-14T14:25:38.6680938Z [cluster3]  • Installing StorageClass 💾  ...
2020-05-14T14:25:38.6681183Z [cluster3]  ✓ Installing StorageClass 💾
2020-05-14T14:25:38.6681383Z [cluster3]  • Joining worker nodes 🚜  ...
2020-05-14T14:25:38.6681630Z [cluster3]  ✓ Joining worker nodes 🚜
2020-05-14T14:25:38.6681904Z [cluster3] Set kubectl context to "kind-cluster3"
2020-05-14T14:25:38.6682031Z [cluster3] You can now use your cluster with:
2020-05-14T14:25:38.6682131Z [cluster3]
2020-05-14T14:25:38.6682413Z [cluster3] kubectl cluster-info --context kind-cluster3
2020-05-14T14:25:38.6682539Z [cluster3]
2020-05-14T14:25:38.6682961Z [cluster3] Thanks for using kind! 😊
2020-05-14T14:25:38.6683577Z [submariner]$ [cluster3] kind_fixup_config
2020-05-14T14:25:38.6684060Z [submariner]$ [cluster3] kind_fixup_config
2020-05-14T14:25:38.6684580Z [submariner]$ [cluster3] local master_ip=172.17.0.10
2020-05-14T14:25:38.6684969Z [submariner]$ [cluster3] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster3-control-plane
2020-05-14T14:25:38.6685221Z [submariner]$ [cluster3] head -n 1
2020-05-14T14:25:38.6686396Z [submariner]$ [cluster3] sed -i -- s/server: .*/server: https:\/\/172.17.0.10:6443/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:26:04.0373429Z [submariner]$ [c/kubeconfigs/kind-config-cluster2
2020-05-14T14:26:04.0374928Z [submariner]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:26:04.0375967Z [submariner]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:26:04.0377143Z [submariner]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:26:04.0379381Z [submariner]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:26:04.0384544Z [submariner]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2
2020-05-14T14:26:04.0385387Z [submariner]$ [cluster2] wait 4358
2020-05-14T14:26:04.0385864Z [submariner]$ [cluster2] deploy_cni
2020-05-14T14:26:04.0386136Z [submariner]$ [cluster2] deploy_cni
2020-05-14T14:26:04.0386422Z [submariner]$ [cluster2] eval deploy_weave_cni
2020-05-14T14:26:04.0386696Z [submariner]$ [cluster2] deploy_weave_cni
2020-05-14T14:26:04.0386913Z [submariner]$ [cluster2] deploy_weave_cni
2020-05-14T14:26:04.0387056Z [cluster2] Applying weave network...
2020-05-14T14:26:04.0387496Z [submariner]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.14.6&env.IPALLOC_RANGE=10.240.0.0/16
2020-05-14T14:26:04.0387910Z [submariner]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.14.6&env.IPALLOC_RANGE=10.240.0.0/16
2020-05-14T14:26:04.0388286Z [submariner]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.14.6&env.IPALLOC_RANGE=10.240.0.0/16
2020-05-14T14:26:04.0388633Z [cluster2] serviceaccount/weave-net created
2020-05-14T14:26:04.0388927Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:04.0389235Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:04.0389523Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:04.0389762Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:04.0390031Z [cluster2] daemonset.apps/weave-net created
2020-05-14T14:26:04.0390303Z [cluster2] Waiting for weave-net pods to be ready...
2020-05-14T14:26:04.0390638Z [submariner]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:04.0390983Z [submariner]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:04.0391307Z [submariner]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:04.0391712Z [submariner]$ [cluster2] kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:04.0391988Z [cluster2] pod/weave-net-jj8td condition met
2020-05-14T14:26:04.0392258Z [cluster2] pod/weave-net-l6rkq condition met
2020-05-14T14:26:04.0392528Z [cluster2] pod/weave-net-z2ctm condition met
2020-05-14T14:26:04.0392752Z [cluster2] Waiting for core-dns deployment to be ready...
2020-05-14T14:26:04.0393075Z [submariner]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:04.0393398Z [submariner]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:04.0393751Z [submariner]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:04.0394096Z [submariner]$ [cluster2] kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:04.0394212Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2020-05-14T14:26:04.0394395Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2020-05-14T14:26:04.0394548Z [cluster2] deployment "coredns" successfully rolled out
2020-05-14T14:26:04.0394913Z [submariner]$ [cluster2] return 0
2020-05-14T14:26:26.9219265Z luster3] sed -i -- s/user: kind-.*/user: cluster3/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:26:26.9220268Z [submariner]$ [cluster3] sed -i -- s/name: kind-.*/name: cluster3/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:26:26.9220886Z [submariner]$ [cluster3] sed -i -- s/cluster: kind-.*/cluster: cluster3/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:26:26.9221759Z [submariner]$ [cluster3] sed -i -- s/current-context: .*/current-context: cluster3/g /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:26:26.9222310Z [submariner]$ [cluster3] chmod a+r /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3
2020-05-14T14:26:26.9222881Z [submariner]$ [cluster3] wait 4646
2020-05-14T14:26:26.9223300Z [submariner]$ [cluster3] deploy_cni
2020-05-14T14:26:26.9223701Z [submariner]$ [cluster3] deploy_cni
2020-05-14T14:26:26.9224452Z [submariner]$ [cluster3] eval deploy_weave_cni
2020-05-14T14:26:26.9224882Z [submariner]$ [cluster3] deploy_weave_cni
2020-05-14T14:26:26.9225294Z [submariner]$ [cluster3] deploy_weave_cni
2020-05-14T14:26:26.9225512Z [cluster3] Applying weave network...
2020-05-14T14:26:26.9226235Z [submariner]$ [cluster3] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.14.6&env.IPALLOC_RANGE=10.240.0.0/16
2020-05-14T14:26:26.9226864Z [submariner]$ [cluster3] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.14.6&env.IPALLOC_RANGE=10.240.0.0/16
2020-05-14T14:26:26.9227961Z [submariner]$ [cluster3] command kubectl --context=cluster3 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.14.6&env.IPALLOC_RANGE=10.240.0.0/16
2020-05-14T14:26:26.9228416Z [cluster3] serviceaccount/weave-net created
2020-05-14T14:26:26.9228844Z [cluster3] clusterrole.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:26.9229309Z [cluster3] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:26.9230057Z [cluster3] role.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:26.9230481Z [cluster3] rolebinding.rbac.authorization.k8s.io/weave-net created
2020-05-14T14:26:26.9230892Z [cluster3] daemonset.apps/weave-net created
2020-05-14T14:26:26.9231288Z [cluster3] Waiting for weave-net pods to be ready...
2020-05-14T14:26:26.9231784Z [submariner]$ [cluster3] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:26.9232246Z [submariner]$ [cluster3] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:26.9232757Z [submariner]$ [cluster3] command kubectl --context=cluster3 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:26.9233265Z [submariner]$ [cluster3] kubectl --context=cluster3 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2020-05-14T14:26:26.9234205Z [cluster3] pod/weave-net-4d26q condition met
2020-05-14T14:26:26.9234880Z [cluster3] pod/weave-net-8jpct condition met
2020-05-14T14:26:26.9235302Z [cluster3] pod/weave-net-zcdms condition met
2020-05-14T14:26:26.9235740Z [cluster3] Waiting for core-dns deployment to be ready...
2020-05-14T14:26:26.9236171Z [submariner]$ [cluster3] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:26.9237769Z [submariner]$ [cluster3] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:26.9238747Z [submariner]$ [cluster3] command kubectl --context=cluster3 -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:26.9239889Z [submariner]$ [cluster3] kubectl --context=cluster3 -n kube-system rollout status deploy/coredns --timeout=5m
2020-05-14T14:26:26.9240812Z [cluster3] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2020-05-14T14:26:26.9240987Z [cluster3] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2020-05-14T14:26:26.9241070Z [cluster3] deployment "coredns" successfully rolled out
2020-05-14T14:26:26.9241380Z [submariner]$ [cluster3] return 0
2020-05-14T14:26:26.9264738Z [submariner]$ [cluster3] wait 2592
2020-05-14T14:26:26.9279195Z [submariner]$ [cluster3] wait 2589
2020-05-14T14:26:26.9353584Z [submariner]$ [cluster3] print_clusters_message
2020-05-14T14:26:27.5759933Z [submariner]$ [cluster3] print_clusters_message
2020-05-14T14:26:27.5760245Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2020-05-14T14:26:27.5760370Z
2020-05-14T14:26:27.5760872Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f | -printf %p:)
2020-05-14T14:26:27.5761109Z
2020-05-14T14:26:27.5761437Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2020-05-14T14:26:27.5761498Z
2020-05-14T14:26:27.5761631Z To clean everthing up, just run: make cleanup
2020-05-14T14:26:27.5761988Z /opt/shipyard/scripts/deploy.sh --deploytool operator --globalnet --deploytool operator
2020-05-14T14:26:27.5762343Z Running with: globalnet='true', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='', timeout=5m
2020-05-14T14:26:27.5769725Z [submariner]$ [cluster3] cat
2020-05-14T14:26:27.5770279Z [submariner]$ source /opt/shipyard/scripts/lib/version
2020-05-14T14:26:27.5770859Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:26:27.5771346Z [submariner]$ script_name=version
2020-05-14T14:26:27.5771713Z [submariner]$ exec_name=deploy.sh
2020-05-14T14:26:27.5772138Z [submariner]$ git status --porcelain --untracked-files=no
2020-05-14T14:26:27.5772435Z [submariner]$ git_tag=
2020-05-14T14:26:27.5772721Z [submariner]$ git tag -l --contains HEAD
2020-05-14T14:26:27.5773184Z [submariner]$ head -n 1
2020-05-14T14:26:27.5773659Z [submariner]$ source /opt/shipyard/scripts/lib/utils
2020-05-14T14:26:27.5774080Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:26:27.5774539Z [submariner]$ script_name=utils
2020-05-14T14:26:27.5775045Z [submariner]$ exec_name=deploy.sh
2020-05-14T14:26:27.5775526Z [submariner]$ source /opt/shipyard/scripts/lib/deploy_funcs
2020-05-14T14:26:27.5776063Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:26:27.5776527Z [submariner]$ script_name=deploy_funcs
2020-05-14T14:26:27.5776920Z [submariner]$ exec_name=deploy.sh
2020-05-14T14:26:27.5777401Z [submariner]$ source /opt/shipyard/scripts/lib/cluster_settings
2020-05-14T14:26:27.5777897Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:26:27.5778377Z [submariner]$ script_name=cluster_settings
2020-05-14T14:26:27.5778663Z [submariner]$ exec_name=deploy.sh
2020-05-14T14:26:27.5778882Z [submariner]$ broker=cluster1
2020-05-14T14:26:27.5779340Z [submariner]$ declare -gA cluster_nodes
2020-05-14T14:26:27.5779679Z [submariner]$ cluster_nodes[cluster1]=control-plane worker
2020-05-14T14:26:27.5779983Z [submariner]$ cluster_nodes[cluster2]=control-plane worker
2020-05-14T14:26:27.5780240Z [submariner]$ cluster_nodes[cluster3]=control-plane worker worker
2020-05-14T14:26:27.5780547Z [submariner]$ declare -gA cluster_subm
2020-05-14T14:26:27.5781048Z [submariner]$ cluster_subm[cluster1]=true
2020-05-14T14:26:27.5781346Z [submariner]$ cluster_subm[cluster2]=true
2020-05-14T14:26:27.5781805Z [submariner]$ cluster_subm[cluster3]=true
2020-05-14T14:26:27.5782544Z [submariner]$ declare -gA cluster_cni
2020-05-14T14:26:27.5783018Z [submariner]$ cluster_cni[cluster2]=weave
2020-05-14T14:26:27.5783571Z [submariner]$ cluster_cni[cluster3]=weave
2020-05-14T14:26:27.5784020Z [submariner]$ declare_cidrs
2020-05-14T14:26:27.5784523Z [submariner]$ declare_cidrs
2020-05-14T14:26:27.5785125Z [submariner]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2020-05-14T14:26:27.5785541Z [submariner]$ i=1
2020-05-14T14:26:27.5786524Z [submariner]$ [cluster1] add_cluster_cidrs 1 cluster1
2020-05-14T14:26:27.5787070Z [submariner]$ [cluster1] add_cluster_cidrs 1 cluster1
2020-05-14T14:26:27.5787697Z [submariner]$ [cluster1] local val=1
2020-05-14T14:26:27.5788201Z [submariner]$ [cluster1] local idx=cluster1
2020-05-14T14:26:27.5789117Z [submariner]$ [cluster1] val=0
2020-05-14T14:26:27.5789543Z [submariner]$ [cluster1] cluster_CIDRs[cluster1]=10.240.0.0/16
2020-05-14T14:26:27.5790028Z [submariner]$ [cluster1] service_CIDRs[cluster1]=100.90.0.0/16
2020-05-14T14:26:27.5790506Z [submariner]$ [cluster1] global_CIDRs[cluster1]=169.254.1.0/24
2020-05-14T14:26:27.5790946Z [submariner]$ [cluster1] i=2
2020-05-14T14:26:27.5791409Z [submariner]$ [cluster2] add_cluster_cidrs 2 cluster2
2020-05-14T14:26:27.5791868Z [submariner]$ [cluster2] add_cluster_cidrs 2 cluster2
2020-05-14T14:26:27.5792248Z [submariner]$ [cluster2] local val=2
2020-05-14T14:26:27.5792712Z [submariner]$ [cluster2] local idx=cluster2
2020-05-14T14:26:27.5793197Z [submariner]$ [cluster2] val=0
2020-05-14T14:26:27.5793668Z [submariner]$ [cluster2] cluster_CIDRs[cluster2]=10.240.0.0/16
2020-05-14T14:26:27.5794140Z [submariner]$ [cluster2] service_CIDRs[cluster2]=100.90.0.0/16
2020-05-14T14:26:27.5794609Z [submariner]$ [cluster2] global_CIDRs[cluster2]=169.254.2.0/24
2020-05-14T14:26:27.5794990Z [submariner]$ [cluster2] i=3
2020-05-14T14:26:27.5795635Z [submariner]$ [cluster3] add_cluster_cidrs 3 cluster3
2020-05-14T14:26:27.5796111Z [submariner]$ [cluster3] add_cluster_cidrs 3 cluster3
2020-05-14T14:26:27.5797791Z [submariner]$ [cluster3] local val=3
2020-05-14T14:26:27.5798343Z [submariner]$ [cluster3] local idx=cluster3
2020-05-14T14:26:27.5799108Z [submariner]$ [cluster3] val=0
2020-05-14T14:26:27.5799833Z [submariner]$ [cluster3] cluster_CIDRs[cluster3]=10.240.0.0/16
2020-05-14T14:26:27.5800491Z [submariner]$ [cluster3] service_CIDRs[cluster3]=100.90.0.0/16
2020-05-14T14:26:27.5801174Z [submariner]$ [cluster3] global_CIDRs[cluster3]=169.254.3.0/24
2020-05-14T14:26:27.5801603Z [submariner]$ [cluster3] i=4
2020-05-14T14:26:27.5802053Z [submariner]$ [cluster3] declare_kubeconfig
2020-05-14T14:26:27.5802443Z [submariner]$ [cluster3] declare_kubeconfig
2020-05-14T14:26:27.5802920Z [submariner]$ [cluster3] source /opt/shipyard/scripts/lib/kubecfg
2020-05-14T14:26:27.5803397Z [submariner]$ [cluster3] export KUBECONFIG
2020-05-14T14:26:27.5804133Z [submariner]$ [cluster3] KUBECONFIG=/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2:/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1:/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3:
2020-05-14T14:26:27.5804752Z [submariner]$ [cluster3] find /go/src/github.com/submariner-io/submariner/output/kubeconfigs -type f -printf %p:
2020-05-14T14:26:27.5805246Z [submariner]$ [cluster3] import_image quay.io/submariner/nettest
2020-05-14T14:26:27.5805788Z [submariner]$ [cluster3] import_image quay.io/submariner/nettest
2020-05-14T14:26:27.5806303Z [submariner]$ [cluster3] local orig_image=quay.io/submariner/nettest
2020-05-14T14:26:27.5806805Z [submariner]$ [cluster3] local versioned_image=quay.io/submariner/nettest:dev
2020-05-14T14:26:27.5807433Z [submariner]$ [cluster3] local local_image=localhost:5000/nettest:local
2020-05-14T14:26:27.5808027Z [submariner]$ [cluster3] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2020-05-14T14:26:27.7126899Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2020-05-14T14:26:27.7171707Z [submariner]$ [cluster3] docker pull quay.io/submariner/nettest:latest
2020-05-14T14:26:28.2442269Z latest: Pulling from submariner/nettest
2020-05-14T14:26:28.2472668Z cbdbe7a5bc2a: Pulling fs layer
2020-05-14T14:26:28.2474843Z 99de5864734b: Pulling fs layer
2020-05-14T14:26:28.2477701Z e72f6f4231c7: Pulling fs layer
2020-05-14T14:26:28.3043845Z 99de5864734b: Verifying Checksum
2020-05-14T14:26:28.3044428Z 99de5864734b: Download complete
2020-05-14T14:26:28.4384927Z e72f6f4231c7: Verifying Checksum
2020-05-14T14:26:28.4385056Z e72f6f4231c7: Download complete
2020-05-14T14:26:28.4614906Z cbdbe7a5bc2a: Download complete
2020-05-14T14:26:28.8417232Z cbdbe7a5bc2a: Pull complete
2020-05-14T14:26:28.8877348Z 99de5864734b: Pull complete
2020-05-14T14:26:29.2050822Z e72f6f4231c7: Pull complete
2020-05-14T14:26:29.2083015Z Digest: sha256:cb0847e78a2787c629b15e430fd61ccae511835e69f84eaf9bb40edbb67739ac
2020-05-14T14:26:29.2101118Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2020-05-14T14:26:29.2139657Z quay.io/submariner/nettest:latest
2020-05-14T14:26:29.2154067Z [submariner]$ [cluster3] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:dev
2020-05-14T14:26:29.5679587Z [submariner]$ [cluster3] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2020-05-14T14:26:29.9144651Z [submariner]$ [cluster3] docker push localhost:5000/nettest:local
2020-05-14T14:26:30.2568444Z The push refers to repository [localhost:5000/nettest]
2020-05-14T14:26:30.3272083Z e777467347f7: Preparing
2020-05-14T14:26:30.3272244Z 58ab4f45709a: Preparing
2020-05-14T14:26:30.3272403Z 3e207b409db3: Preparing
2020-05-14T14:26:30.4621442Z 58ab4f45709a: Pushed
2020-05-14T14:26:30.8770166Z 3e207b409db3: Pushed
2020-05-14T14:26:32.0870059Z e777467347f7: Pushed
2020-05-14T14:26:32.1102600Z local: digest: sha256:cb0847e78a2787c629b15e430fd61ccae511835e69f84eaf9bb40edbb67739ac size: 946
2020-05-14T14:26:32.1191048Z [submariner]$ [cluster3] import_image quay.io/submariner/submariner
2020-05-14T14:26:32.1203636Z [submariner]$ [cluster3] import_image quay.io/submariner/submariner
2020-05-14T14:26:32.1215240Z [submariner]$ [cluster3] local orig_image=quay.io/submariner/submariner
2020-05-14T14:26:32.1237500Z [submariner]$ [cluster3] local versioned_image=quay.io/submariner/submariner:dev
2020-05-14T14:26:32.1245456Z [submariner]$ [cluster3] local local_image=localhost:5000/submariner:local
2020-05-14T14:26:32.1258510Z [submariner]$ [cluster3] docker tag quay.io/submariner/submariner:dev localhost:5000/submariner:local
2020-05-14T14:26:32.4746820Z [submariner]$ [cluster3] docker push localhost:5000/submariner:local
2020-05-14T14:26:32.8205944Z The push refers to repository [localhost:5000/submariner]
2020-05-14T14:26:32.8289289Z e26c48551867: Preparing
2020-05-14T14:26:32.8289711Z 9906e23560fe: Preparing
2020-05-14T14:26:32.8290004Z 1c7ad7298c58: Preparing
2020-05-14T14:26:32.8290294Z 8a10ace26c00: Preparing
2020-05-14T14:26:32.8815793Z 1c7ad7298c58: Pushed
2020-05-14T14:26:33.8029801Z e26c48551867: Pushed
2020-05-14T14:26:36.1313688Z 9906e23560fe: Pushed
2020-05-14T14:26:47.5430330Z 8a10ace26c00: Pushed
2020-05-14T14:26:47.5618945Z local: digest: sha256:dcc5c966cd011930968eda73dc441ff9555619be409b89158f097e3892e02d08 size: 1159
2020-05-14T14:26:47.5681226Z [submariner]$ [cluster3] import_image quay.io/submariner/submariner-route-agent
2020-05-14T14:26:47.5691105Z [submariner]$ [cluster3] import_image quay.io/submariner/submariner-route-agent
2020-05-14T14:26:47.5700557Z [submariner]$ [cluster3] local orig_image=quay.io/submariner/submariner-route-agent
2020-05-14T14:26:47.5710994Z [submariner]$ [cluster3] local versioned_image=quay.io/submariner/submariner-route-agent:dev
2020-05-14T14:26:47.5722779Z [submariner]$ [cluster3] local local_image=localhost:5000/submariner-route-agent:local
2020-05-14T14:26:47.5731916Z [submariner]$ [cluster3] docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2020-05-14T14:26:47.9431502Z [submariner]$ [cluster3] docker push localhost:5000/submariner-route-agent:local
2020-05-14T14:26:48.2805977Z The push refers to repository [localhost:5000/submariner-route-agent]
2020-05-14T14:26:48.2879799Z c096ce2df016: Preparing
2020-05-14T14:26:48.2880195Z def6e1c50bd9: Preparing
2020-05-14T14:26:48.2880305Z 87472a3003fd: Preparing
2020-05-14T14:26:48.2880407Z 5899a5a74e27: Preparing
2020-05-14T14:26:48.2880489Z 12f4f17347bc: Preparing
2020-05-14T14:26:48.2880587Z 260860e5eb1a: Preparing
2020-05-14T14:26:48.2880702Z 133b5003f6eb: Preparing
2020-05-14T14:26:48.2880781Z 1776c40df06e: Preparing
2020-05-14T14:26:48.2880879Z 260860e5eb1a: Waiting
2020-05-14T14:26:48.2880976Z 133b5003f6eb: Waiting
2020-05-14T14:26:48.2881074Z 1776c40df06e: Waiting
2020-05-14T14:26:48.7878305Z 87472a3003fd: Pushed
2020-05-14T14:26:48.8087118Z 12f4f17347bc: Pushed
2020-05-14T14:26:48.8087523Z c096ce2df016: Pushed
2020-05-14T14:26:48.8230120Z def6e1c50bd9: Pushed
2020-05-14T14:26:48.9905479Z 260860e5eb1a: Pushed
2020-05-14T14:26:49.4064630Z 133b5003f6eb: Pushed
2020-05-14T14:26:49.4104755Z 5899a5a74e27: Pushed
2020-05-14T14:26:59.4546353Z 1776c40df06e: Pushed
2020-05-14T14:26:59.4735868Z local: digest: sha256:5c3892c68c06cef41f25b45efe32c396bd3c90d376aba7ee8ad1ecfc4f68f497 size: 1987
2020-05-14T14:26:59.4800709Z [submariner]$ [cluster3] import_image quay.io/submariner/submariner-globalnet
2020-05-14T14:26:59.4812410Z [submariner]$ [cluster3] import_image quay.io/submariner/submariner-globalnet
2020-05-14T14:26:59.4823087Z [submariner]$ [cluster3] local orig_image=quay.io/submariner/submariner-globalnet
2020-05-14T14:26:59.4830926Z [submariner]$ [cluster3] local versioned_image=quay.io/submariner/submariner-globalnet:dev
2020-05-14T14:26:59.4844395Z [submariner]$ [cluster3] local local_image=localhost:5000/submariner-globalnet:local
2020-05-14T14:26:59.4855301Z [submariner]$ [cluster3] docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local
2020-05-14T14:26:59.8410282Z [submariner]$ [cluster3] docker push localhost:5000/submariner-globalnet:local
2020-05-14T14:27:00.1870123Z The push refers to repository [localhost:5000/submariner-globalnet]
2020-05-14T14:27:00.1910017Z 61fe0dc8b737: Preparing
2020-05-14T14:27:00.1910297Z 38a1d4e1bba6: Preparing
2020-05-14T14:27:00.1982403Z e140a3a93d2b: Preparing
2020-05-14T14:27:00.1982531Z b14c093fd9e0: Preparing
2020-05-14T14:27:00.1982884Z cc35892732c5: Preparing
2020-05-14T14:27:00.1983024Z b6f081e4b2b6: Preparing
2020-05-14T14:27:00.1983146Z d8e1f35641ac: Preparing
2020-05-14T14:27:00.1985714Z b6f081e4b2b6: Waiting
2020-05-14T14:27:00.1985832Z d8e1f35641ac: Waiting
2020-05-14T14:27:00.5203042Z 61fe0dc8b737: Pushed
2020-05-14T14:27:00.7118283Z e140a3a93d2b: Pushed
2020-05-14T14:27:00.7188960Z cc35892732c5: Pushed
2020-05-14T14:27:01.1823017Z 38a1d4e1bba6: Pushed
2020-05-14T14:27:01.2791564Z b6f081e4b2b6: Pushed
2020-05-14T14:27:01.2825899Z b14c093fd9e0: Pushed
2020-05-14T14:27:07.0840172Z d8e1f35641ac: Pushed
2020-05-14T14:27:07.1045730Z local: digest: sha256:837ae367bbae9119a87b0f0730acadace60f92333d1501985e2df400be354acf size: 1780
2020-05-14T14:27:07.1108023Z [submariner]$ [cluster3] load_deploytool operator
2020-05-14T14:27:07.1123716Z [submariner]$ [cluster3] load_deploytool operator
2020-05-14T14:27:07.1140353Z [submariner]$ [cluster3] local deploytool=operator
2020-05-14T14:27:07.1151577Z [submariner]$ [cluster3] local deploy_lib=/opt/shipyard/scripts/lib/deploy_operator
2020-05-14T14:27:07.1156041Z Will deploy submariner using operator
2020-05-14T14:27:07.1166964Z [submariner]$ [cluster3] . /opt/shipyard/scripts/lib/deploy_operator
2020-05-14T14:27:07.1180903Z [submariner]$ [cluster3] . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:27:07.1198312Z [submariner]$ [cluster3] script_name=deploy_operator
2020-05-14T14:27:07.1209911Z [submariner]$ [cluster3] exec_name=deploy.sh
2020-05-14T14:27:07.1225854Z [submariner]$ [cluster3] deploytool_prereqs
2020-05-14T14:27:07.1237263Z [submariner]$ [cluster3] deploytool_prereqs
2020-05-14T14:27:07.1248170Z [submariner]$ [cluster3] test -x /go/bin/subctl
2020-05-14T14:27:07.1260508Z [submariner]$ [cluster3] run_subm_clusters prepare_cluster submariner-operator
2020-05-14T14:27:07.1271037Z [submariner]$ [cluster3] run_subm_clusters prepare_cluster submariner-operator
2020-05-14T14:27:07.1281553Z [submariner]$ [cluster3] declare -a subm_clusters
2020-05-14T14:27:07.1323106Z [submariner]$ [cluster3] run_parallel cluster1 cluster2 cluster3 prepare_cluster submariner-operator
2020-05-14T14:27:07.1333194Z [submariner]$ [cluster3] run_parallel cluster1 cluster2 cluster3 cluster1 cluster2 cluster3 prepare_cluster submariner-operator
2020-05-14T14:27:07.1344195Z [submariner]$ [cluster3] local cmnd=prepare_cluster
2020-05-14T14:27:07.1358498Z [submariner]$ [cluster3] declare -A pids
2020-05-14T14:27:07.1373375Z [submariner]$ [cluster3] eval echo cluster1 cluster2 cluster3
2020-05-14T14:27:07.1392486Z [submariner]$ [cluster1] pids[cluster1]=5016
2020-05-14T14:27:07.1414090Z [submariner]$ [cluster2] pids[cluster2]=5018
2020-05-14T14:27:07.1420250Z [submariner]$ [cluster2] set -o pipefail
2020-05-14T14:27:07.1430051Z [submariner]$ [cluster1] set -o pipefail
2020-05-14T14:27:07.1439464Z [submariner]$ [cluster3] pids[cluster3]=5022
2020-05-14T14:27:07.1451733Z [submariner]$ [cluster2] prepare_cluster submariner-operator
2020-05-14T14:27:07.1465095Z [submariner]$ [cluster1] prepare_cluster submariner-operator
2020-05-14T14:27:07.1473282Z [submariner]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2020-05-14T14:27:07.1480398Z [submariner]$ [cluster3] set -o pipefail
2020-05-14T14:27:07.1488496Z [submariner]$ [cluster3] wait 5022
2020-05-14T14:27:07.1495829Z [submariner]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2020-05-14T14:27:07.1506894Z [submariner]$ [cluster3] prepare_cluster submariner-operator
2020-05-14T14:27:07.1535547Z [submariner]$ [cluster3] sed /\[cluster3]/!s/^/[cluster3] /
2020-05-14T14:27:12.4991207Z [submariner]$ [cluster2] prepare_cluster
2020-05-14T14:27:12.4991504Z [submariner]$ [cluster2] local namespace=submariner-operator
2020-05-14T14:27:12.4991721Z [cluster2] 
2020-05-14T14:27:12.4991919Z [cluster2] 
2020-05-14T14:27:12.4992108Z [cluster2] 
2020-05-14T14:27:12.4992350Z [submariner]$ [cluster2] add_subm_gateway_label
2020-05-14T14:27:12.4992767Z [submariner]$ [cluster2] add_subm_gateway_label
2020-05-14T14:27:12.4993055Z [submariner]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.4993357Z [submariner]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.4993677Z [submariner]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.4994004Z [submariner]$ [cluster2] kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.4994231Z [cluster2] node/cluster2-worker labeled
2020-05-14T14:27:12.7321613Z [submariner]$ [cluster3] prepare_cluster
2020-05-14T14:27:12.7321943Z [submariner]$ [cluster3] local namespace=submariner-operator
2020-05-14T14:27:12.7322558Z [cluster3] 
2020-05-14T14:27:12.7322828Z [cluster3] 
2020-05-14T14:27:12.7323034Z [cluster3] 
2020-05-14T14:27:12.7323260Z [submariner]$ [cluster3] add_subm_gateway_label
2020-05-14T14:27:12.7323505Z [submariner]$ [cluster3] add_subm_gateway_label
2020-05-14T14:27:12.7323799Z [submariner]$ [cluster3] kubectl label node cluster3-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.7324269Z [submariner]$ [cluster3] kubectl label node cluster3-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.7324988Z [submariner]$ [cluster3] command kubectl --context=cluster3 label node cluster3-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.7325824Z [submariner]$ [cluster3] kubectl --context=cluster3 label node cluster3-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.7326087Z [cluster3] node/cluster3-worker labeled
2020-05-14T14:27:12.7366380Z [submariner]$ [cluster3] wait 5018
2020-05-14T14:27:12.7424030Z [submariner]$ [cluster3] wait 5016
2020-05-14T14:27:12.8648775Z [submariner]$ [cluster1] prepare_cluster
2020-05-14T14:27:12.8649314Z [submariner]$ [cluster1] local namespace=submariner-operator
2020-05-14T14:27:12.8649744Z [cluster1] 
2020-05-14T14:27:12.8649955Z [cluster1] 
2020-05-14T14:27:12.8650161Z [cluster1] 
2020-05-14T14:27:12.8650563Z [submariner]$ [cluster1] add_subm_gateway_label
2020-05-14T14:27:12.8650822Z [submariner]$ [cluster1] add_subm_gateway_label
2020-05-14T14:27:12.8651287Z [submariner]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.8651624Z [submariner]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.8652143Z [submariner]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.8652635Z [submariner]$ [cluster1] kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2020-05-14T14:27:12.8653039Z [cluster1] node/cluster1-worker labeled
2020-05-14T14:27:12.8672565Z [submariner]$ [cluster3] with_context cluster1 setup_broker
2020-05-14T14:27:12.8682197Z [submariner]$ [cluster3] with_context cluster1 setup_broker
2020-05-14T14:27:12.8694090Z [submariner]$ [cluster3] local cluster=cluster1
2020-05-14T14:27:12.8709539Z [submariner]$ [cluster1] local cmnd=setup_broker
2020-05-14T14:27:12.8720401Z [submariner]$ [cluster1] setup_broker
2020-05-14T14:27:12.8732059Z [submariner]$ [cluster1] setup_broker
2020-05-14T14:27:12.8740864Z [submariner]$ [cluster1] local gn
2020-05-14T14:27:12.8753001Z [submariner]$ [cluster1] gn=--globalnet
2020-05-14T14:27:12.8757776Z Installing broker...
2020-05-14T14:27:12.8774054Z [submariner]$ [cluster1] cd /go/src/github.com/submariner-io/submariner/output
2020-05-14T14:27:12.8789258Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1 --no-dataplane --globalnet
2020-05-14T14:27:13.0987102Z  • Deploying broker  ...
2020-05-14T14:27:13.2242768Z  ✓ Deploying broker
2020-05-14T14:27:13.2243114Z  • Creating broker-info.subm file  ...
2020-05-14T14:27:13.2281192Z  ✓ Creating broker-info.subm file
2020-05-14T14:27:13.2281506Z  ✓ A new IPSEC PSK will be generated for broker-info.subm
2020-05-14T14:27:13.2309928Z [submariner]$ [cluster3] install_subm_all_clusters
2020-05-14T14:27:13.2323561Z [submariner]$ [cluster3] install_subm_all_clusters
2020-05-14T14:27:13.2334893Z [submariner]$ [cluster3] run_subm_clusters subctl_install_subm
2020-05-14T14:27:13.2347802Z [submariner]$ [cluster3] run_subm_clusters subctl_install_subm
2020-05-14T14:27:13.2360130Z [submariner]$ [cluster3] declare -a subm_clusters
2020-05-14T14:27:13.2400476Z [submariner]$ [cluster3] run_parallel cluster1 cluster2 cluster3 subctl_install_subm
2020-05-14T14:27:13.2410907Z [submariner]$ [cluster3] run_parallel cluster1 cluster2 cluster3 cluster1 cluster2 cluster3 subctl_install_subm
2020-05-14T14:27:13.2420998Z [submariner]$ [cluster3] local cmnd=subctl_install_subm
2020-05-14T14:27:13.2431526Z [submariner]$ [cluster3] declare -A pids
2020-05-14T14:27:13.2447270Z [submariner]$ [cluster3] eval echo cluster1 cluster2 cluster3
2020-05-14T14:27:13.2469317Z [submariner]$ [cluster1] pids[cluster1]=5229
2020-05-14T14:27:13.2469825Z [submariner]$ [cluster1] set -o pipefail
2020-05-14T14:27:13.2481674Z [submariner]$ [cluster1] subctl_install_subm
2020-05-14T14:27:13.2487331Z [submariner]$ [cluster2] pids[cluster2]=5232
2020-05-14T14:27:13.2503289Z [submariner]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2020-05-14T14:27:13.2518867Z [submariner]$ [cluster3] pids[cluster3]=5236
2020-05-14T14:27:13.2533545Z [submariner]$ [cluster2] set -o pipefail
2020-05-14T14:27:13.2554357Z [submariner]$ [cluster3] wait 5236
2020-05-14T14:27:13.2558199Z [submariner]$ [cluster2] subctl_install_subm
2020-05-14T14:27:13.2573238Z [submariner]$ [cluster3] set -o pipefail
2020-05-14T14:27:13.2590745Z [submariner]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2020-05-14T14:27:13.2598642Z [submariner]$ [cluster3] subctl_install_subm
2020-05-14T14:27:13.2631024Z [submariner]$ [cluster3] sed /\[cluster3]/!s/^/[cluster3] /
2020-05-14T14:27:29.1821189Z [submariner]$ [cluster3] subctl_install_subm
2020-05-14T14:27:29.1822477Z [submariner]$ [cluster3] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3 --clusterid cluster3 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 169.254.3.0/24 --disable-nat /go/src/github.com/submariner-io/submariner/output/broker-info.subm
2020-05-14T14:27:29.1823151Z [cluster3] * /go/src/github.com/submariner-io/submariner/output/broker-info.subm says broker is at: https://172.17.0.6:6443
2020-05-14T14:27:29.1823447Z [cluster3] * There are 1 labeled nodes in the cluster:
2020-05-14T14:27:29.1823832Z [cluster3]   - cluster3-worker
2020-05-14T14:27:29.1824268Z [cluster3]  • Deploying the Submariner operator  ...
2020-05-14T14:27:29.1824685Z [cluster3]  ✓ Deploying the Submariner operator
2020-05-14T14:27:29.1825089Z [cluster3]  ✓ Created operator CRDs
2020-05-14T14:27:29.1826301Z [cluster3]  ✓ Created operator namespace: submariner-operator
2020-05-14T14:27:29.1826713Z [cluster3]  ✓ Created operator service account and role
2020-05-14T14:27:29.1827133Z [cluster3]  ✓ Created lighthouse CRDs
2020-05-14T14:27:29.1827716Z [cluster3]  ✓ Created lighthouse service account and role
2020-05-14T14:27:29.1828193Z [cluster3]  ✓ Created Lighthouse service accounts and roles
2020-05-14T14:27:29.1828818Z [cluster3]  ✓ Deployed the operator successfully
2020-05-14T14:27:29.1829059Z [cluster3] * Discovering network details
2020-05-14T14:27:29.1829283Z [cluster3]     Discovered network details:
2020-05-14T14:27:29.1829975Z [cluster3]         Network plugin:  weave-net
2020-05-14T14:27:29.1830219Z [cluster3]         Service CIDRs: [100.90.0.0/16]
2020-05-14T14:27:29.1830451Z [cluster3]         Cluster CIDRs: [10.240.0.0/16]
2020-05-14T14:27:29.1830992Z [cluster3]  • Discovering multi cluster details  ...
2020-05-14T14:27:29.1831369Z [cluster3]  ✓ Discovering multi cluster details
2020-05-14T14:27:29.1832145Z [cluster3]  ✓ GlobalCIDR is: 169.254.3.0/24
2020-05-14T14:27:29.1832533Z [cluster3]  • Creating SA for cluster  ...
2020-05-14T14:27:29.1832912Z [cluster3]  ✓ Creating SA for cluster
2020-05-14T14:27:29.1833297Z [cluster3]  • Deploying Submariner  ...
2020-05-14T14:27:29.1833516Z [cluster3] * Submariner is up and running
2020-05-14T14:27:29.1834110Z [cluster3]  ✓ Deploying Submariner
2020-05-14T14:27:29.1862183Z [submariner]$ [cluster3] wait 5232
2020-05-14T14:27:29.2832882Z [submariner]$ [cluster1] subctl_install_subm
2020-05-14T14:27:29.2834135Z [submariner]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 169.254.1.0/24 --disable-nat /go/src/github.com/submariner-io/submariner/output/broker-info.subm
2020-05-14T14:27:29.2834821Z [cluster1] * /go/src/github.com/submariner-io/submariner/output/broker-info.subm says broker is at: https://172.17.0.6:6443
2020-05-14T14:27:29.2835523Z [cluster1] * There are 1 labeled nodes in the cluster:
2020-05-14T14:27:29.2835948Z [cluster1]   - cluster1-worker
2020-05-14T14:27:29.2836371Z [cluster1]  • Deploying the Submariner operator  ...
2020-05-14T14:27:29.2837314Z [cluster1]  ✓ Deploying the Submariner operator
2020-05-14T14:27:29.2837774Z [cluster1]  ✓ Created operator CRDs
2020-05-14T14:27:29.2838455Z [cluster1]  ✓ Created operator namespace: submariner-operator
2020-05-14T14:27:29.2838935Z [cluster1]  ✓ Created operator service account and role
2020-05-14T14:27:29.2839339Z [cluster1]  ✓ Created lighthouse CRDs
2020-05-14T14:27:29.2839745Z [cluster1]  ✓ Created lighthouse service account and role
2020-05-14T14:27:29.2840189Z [cluster1]  ✓ Created Lighthouse service accounts and roles
2020-05-14T14:27:29.2840582Z [cluster1]  ✓ Deployed the operator successfully
2020-05-14T14:27:29.2840808Z [cluster1] * Discovering network details
2020-05-14T14:27:29.2841079Z [cluster1]     Discovered network details:
2020-05-14T14:27:29.2841282Z [cluster1]         Network plugin:  generic
2020-05-14T14:27:29.2841470Z [cluster1]         Service CIDRs: [100.90.0.0/16]
2020-05-14T14:27:29.2841681Z [cluster1]         Cluster CIDRs: [10.240.0.0/16]
2020-05-14T14:27:29.2842078Z [cluster1]  • Discovering multi cluster details  ...
2020-05-14T14:27:29.2842504Z [cluster1]  ✓ Discovering multi cluster details
2020-05-14T14:27:29.2842954Z [cluster1]  ✓ GlobalCIDR is: 169.254.1.0/24
2020-05-14T14:27:29.2843338Z [cluster1]  • Creating SA for cluster  ...
2020-05-14T14:27:29.2843897Z [cluster1]  ✓ Creating SA for cluster
2020-05-14T14:27:29.2844285Z [cluster1]  • Deploying Submariner  ...
2020-05-14T14:27:29.2844518Z [cluster1] * Submariner is up and running
2020-05-14T14:27:29.2844854Z [cluster1]  ✓ Deploying Submariner
2020-05-14T14:27:29.5032375Z [submariner]$ [cluster2] subctl_install_subm
2020-05-14T14:27:29.5033508Z [submariner]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 169.254.2.0/24 --disable-nat /go/src/github.com/submariner-io/submariner/output/broker-info.subm
2020-05-14T14:27:29.5038279Z [cluster2] * /go/src/github.com/submariner-io/submariner/output/broker-info.subm says broker is at: https://172.17.0.6:6443
2020-05-14T14:27:29.5038715Z [cluster2] * There are 1 labeled nodes in the cluster:
2020-05-14T14:27:29.5039182Z [cluster2]   - cluster2-worker
2020-05-14T14:27:29.5039662Z [cluster2]  • Deploying the Submariner operator  ...
2020-05-14T14:27:29.5040461Z [cluster2]  ✓ Deploying the Submariner operator
2020-05-14T14:27:29.5041420Z [cluster2]  ✓ Created operator CRDs
2020-05-14T14:27:29.5041874Z [cluster2]  ✓ Created operator namespace: submariner-operator
2020-05-14T14:27:29.5042458Z [cluster2]  ✓ Created operator service account and role
2020-05-14T14:27:29.5042878Z [cluster2]  ✓ Created lighthouse CRDs
2020-05-14T14:27:29.5043455Z [cluster2]  ✓ Created lighthouse service account and role
2020-05-14T14:27:29.5043846Z [cluster2]  ✓ Created Lighthouse service accounts and roles
2020-05-14T14:27:29.5044395Z [cluster2]  ✓ Deployed the operator successfully
2020-05-14T14:27:29.5044854Z [cluster2] * Discovering network details
2020-05-14T14:27:29.5045105Z [cluster2]     Discovered network details:
2020-05-14T14:27:29.5045712Z [cluster2]         Network plugin:  weave-net
2020-05-14T14:27:29.5045937Z [cluster2]         Service CIDRs: [100.90.0.0/16]
2020-05-14T14:27:29.5046137Z [cluster2]         Cluster CIDRs: [10.240.0.0/16]
2020-05-14T14:27:29.5046512Z [cluster2]  • Discovering multi cluster details  ...
2020-05-14T14:27:29.5046914Z [cluster2]  ✓ Discovering multi cluster details
2020-05-14T14:27:29.5047310Z [cluster2]  ✓ GlobalCIDR is: 169.254.2.0/24
2020-05-14T14:27:29.5047673Z [cluster2]  • Creating SA for cluster  ...
2020-05-14T14:27:29.5048245Z [cluster2]  ✓ Creating SA for cluster
2020-05-14T14:27:29.5048783Z [cluster2]  • Deploying Submariner  ...
2020-05-14T14:27:29.5049003Z [cluster2] * Submariner is up and running
2020-05-14T14:27:29.5049345Z [cluster2]  ✓ Deploying Submariner
2020-05-14T14:27:29.5101382Z [submariner]$ [cluster3] wait 5229
2020-05-14T14:27:29.5130635Z [submariner]$ [cluster3] deploytool_postreqs
2020-05-14T14:27:29.5182175Z [submariner]$ [cluster3] deploytool_postreqs
2020-05-14T14:27:29.5223193Z [submariner]$ [cluster3] with_context cluster1 del_subm_gateway_label
2020-05-14T14:27:29.5264483Z [submariner]$ [cluster3] with_context cluster1 del_subm_gateway_label
2020-05-14T14:27:29.5291122Z [submariner]$ [cluster3] local cluster=cluster1
2020-05-14T14:27:29.5328110Z [submariner]$ [cluster1] local cmnd=del_subm_gateway_label
2020-05-14T14:27:29.5358142Z [submariner]$ [cluster1] del_subm_gateway_label
2020-05-14T14:27:29.5422936Z [submariner]$ [cluster1] del_subm_gateway_label
2020-05-14T14:27:29.5531435Z [submariner]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway- --overwrite
2020-05-14T14:27:29.5558936Z [submariner]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway- --overwrite
2020-05-14T14:27:29.5622714Z [submariner]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway- --overwrite
2020-05-14T14:27:29.5640735Z [submariner]$ [cluster1] kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway- --overwrite
2020-05-14T14:27:32.6750569Z node/cluster1-worker labeled
2020-05-14T14:27:32.7110458Z [submariner]$ [cluster3] with_context cluster2 connectivity_tests
2020-05-14T14:27:32.7128140Z [submariner]$ [cluster3] with_context cluster2 connectivity_tests
2020-05-14T14:27:32.7180204Z [submariner]$ [cluster3] local cluster=cluster2
2020-05-14T14:27:32.7194123Z [submariner]$ [cluster2] local cmnd=connectivity_tests
2020-05-14T14:27:32.7207547Z [submariner]$ [cluster2] connectivity_tests
2020-05-14T14:27:32.7227548Z [submariner]$ [cluster2] connectivity_tests
2020-05-14T14:27:32.7247200Z [submariner]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:32.7325006Z [submariner]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:32.7468234Z [submariner]$ [cluster2] local resource_file=/opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:32.7476867Z [submariner]$ [cluster2] local resource_name
2020-05-14T14:27:32.7625872Z [submariner]$ [cluster2] resource_name=netshoot
2020-05-14T14:27:32.7679000Z [submariner]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2020-05-14T14:27:32.7700527Z [submariner]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:32.7711889Z [submariner]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:32.7733631Z [submariner]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:32.7771267Z [submariner]$ [cluster2] kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:27:35.1507766Z deployment.apps/netshoot created
2020-05-14T14:27:35.2223476Z Waiting for netshoot pods to be ready.
2020-05-14T14:27:35.2298224Z [submariner]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2020-05-14T14:27:35.2363244Z [submariner]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2020-05-14T14:27:35.2363598Z [submariner]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2020-05-14T14:27:35.2363913Z [submariner]$ [cluster2] kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2020-05-14T14:27:36.8818493Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2020-05-14T14:28:14.0349061Z deployment "netshoot" successfully rolled out
2020-05-14T14:28:14.0715905Z [submariner]$ [cluster2] with_context cluster3 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.0718983Z [submariner]$ [cluster2] with_context cluster3 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.0772954Z [submariner]$ [cluster2] local cluster=cluster3
2020-05-14T14:28:14.0792827Z [submariner]$ [cluster3] local cmnd=deploy_resource
2020-05-14T14:28:14.0816324Z [submariner]$ [cluster3] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.0836338Z [submariner]$ [cluster3] deploy_resource
2020-05-14T14:28:14.0851842Z [submariner]$ [cluster3] local resource_file=/opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.0897709Z [submariner]$ [cluster3] local resource_name
2020-05-14T14:28:14.1232032Z [submariner]$ [cluster3] resource_name=nginx-demo
2020-05-14T14:28:14.1247527Z [submariner]$ [cluster3] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2020-05-14T14:28:14.1277372Z [submariner]$ [cluster3] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.1289760Z [submariner]$ [cluster3] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.1365991Z [submariner]$ [cluster3] command kubectl --context=cluster3 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:14.1387768Z [submariner]$ [cluster3] kubectl --context=cluster3 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:18.4615191Z deployment.apps/nginx-demo created
2020-05-14T14:28:19.2113428Z service/nginx-demo created
2020-05-14T14:28:19.2371536Z Waiting for nginx-demo pods to be ready.
2020-05-14T14:28:19.2387124Z [submariner]$ [cluster3] kubectl rollout status deploy/nginx-demo --timeout=5m
2020-05-14T14:28:19.2402359Z [submariner]$ [cluster3] kubectl rollout status deploy/nginx-demo --timeout=5m
2020-05-14T14:28:19.2420775Z [submariner]$ [cluster3] command kubectl --context=cluster3 rollout status deploy/nginx-demo --timeout=5m
2020-05-14T14:28:19.2433829Z [submariner]$ [cluster3] kubectl --context=cluster3 rollout status deploy/nginx-demo --timeout=5m
2020-05-14T14:28:21.5361503Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2020-05-14T14:28:30.6745896Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2020-05-14T14:28:33.3199389Z deployment "nginx-demo" successfully rolled out
2020-05-14T14:28:33.3372589Z [submariner]$ [cluster2] local netshoot_pod nginx_svc_ip
2020-05-14T14:28:34.3328059Z [submariner]$ [cluster2] netshoot_pod=netshoot-54468bbbbd-tctbp
2020-05-14T14:28:34.3341497Z [submariner]$ [cluster2] kubectl get pods -l app=netshoot
2020-05-14T14:28:34.3356220Z [submariner]$ [cluster2] awk FNR == 2 {print $1}
2020-05-14T14:28:34.3357236Z [submariner]$ [cluster2] kubectl get pods -l app=netshoot
2020-05-14T14:28:34.3372552Z [submariner]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2020-05-14T14:28:34.3381430Z [submariner]$ [cluster2] kubectl --context=cluster2 get pods -l app=netshoot
2020-05-14T14:28:35.9135614Z [submariner]$ [cluster2] nginx_svc_ip=169.254.3.24
2020-05-14T14:28:35.9149521Z [submariner]$ [cluster2] with_context cluster3 get_svc_ip nginx-demo
2020-05-14T14:28:35.9161286Z [submariner]$ [cluster2] with_context cluster3 get_svc_ip nginx-demo
2020-05-14T14:28:35.9171128Z [submariner]$ [cluster2] local cluster=cluster3
2020-05-14T14:28:35.9181354Z [submariner]$ [cluster3] local cmnd=get_svc_ip
2020-05-14T14:28:35.9192605Z [submariner]$ [cluster3] get_svc_ip nginx-demo
2020-05-14T14:28:35.9203626Z [submariner]$ [cluster3] get_svc_ip
2020-05-14T14:28:35.9212672Z [submariner]$ [cluster3] local svc_name=nginx-demo
2020-05-14T14:28:35.9222192Z [submariner]$ [cluster3] local svc_ip
2020-05-14T14:28:36.6664486Z [submariner]$ [cluster3] svc_ip=169.254.3.24
2020-05-14T14:28:36.6682640Z [submariner]$ [cluster3] with_retries 30 get_globalip nginx-demo
2020-05-14T14:28:36.6695190Z [submariner]$ [cluster3] with_retries 30 get_globalip nginx-demo
2020-05-14T14:28:36.6706701Z [submariner]$ [cluster3] local retries
2020-05-14T14:28:36.6728205Z [submariner]$ [cluster3] retries=1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
2020-05-14T14:28:36.6745132Z [submariner]$ [cluster3] eval echo {1..30}
2020-05-14T14:28:36.6762538Z [submariner]$ [cluster3] local cmnd=get_globalip
2020-05-14T14:28:36.6776570Z [submariner]$ [cluster3] wait 5459
2020-05-14T14:28:36.6780081Z [submariner]$ [cluster3] get_globalip nginx-demo
2020-05-14T14:28:36.6790275Z [submariner]$ [cluster3] get_globalip
2020-05-14T14:28:36.6803107Z [submariner]$ [cluster3] local svc_name=nginx-demo
2020-05-14T14:28:36.6815603Z [submariner]$ [cluster3] local gip
2020-05-14T14:28:37.5182782Z [submariner]$ [cluster3] gip=169.254.3.24
2020-05-14T14:28:37.5201265Z [submariner]$ [cluster3] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2020-05-14T14:28:37.5213871Z [submariner]$ [cluster3] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2020-05-14T14:28:37.5225255Z [submariner]$ [cluster3] command kubectl --context=cluster3 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2020-05-14T14:28:37.5235489Z [submariner]$ [cluster3] kubectl --context=cluster3 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner.io/globalIp}
2020-05-14T14:28:38.3129092Z [submariner]$ [cluster3] return 0
2020-05-14T14:28:38.3148586Z [submariner]$ [cluster2] with_retries 5 test_connection netshoot-54468bbbbd-tctbp 169.254.3.24
2020-05-14T14:28:38.3160583Z [submariner]$ [cluster2] with_retries 5 test_connection netshoot-54468bbbbd-tctbp 169.254.3.24
2020-05-14T14:28:38.3176007Z [submariner]$ [cluster2] local retries
2020-05-14T14:28:38.3202059Z [submariner]$ [cluster2] retries=1 2 3 4 5
2020-05-14T14:28:38.3218173Z [submariner]$ [cluster2] eval echo {1..5}
2020-05-14T14:28:38.3234291Z [submariner]$ [cluster2] local cmnd=test_connection
2020-05-14T14:28:38.3249051Z [submariner]$ [cluster2] wait 5497
2020-05-14T14:28:38.3254911Z [submariner]$ [cluster2] test_connection netshoot-54468bbbbd-tctbp 169.254.3.24
2020-05-14T14:28:38.3265366Z [submariner]$ [cluster2] test_connection
2020-05-14T14:28:38.3283800Z [submariner]$ [cluster2] local source_pod=netshoot-54468bbbbd-tctbp
2020-05-14T14:28:38.3293921Z [submariner]$ [cluster2] local target_address=169.254.3.24
2020-05-14T14:28:38.3300698Z Attempting connectivity between clusters - netshoot-54468bbbbd-tctbp (cluster2) --> 169.254.3.24 (service on cluster3)
2020-05-14T14:28:38.3312147Z [submariner]$ [cluster2] kubectl exec netshoot-54468bbbbd-tctbp -- curl --output /dev/null -m 30 --silent --head --fail 169.254.3.24
2020-05-14T14:28:38.3325767Z [submariner]$ [cluster2] kubectl exec netshoot-54468bbbbd-tctbp -- curl --output /dev/null -m 30 --silent --head --fail 169.254.3.24
2020-05-14T14:28:38.3338557Z [submariner]$ [cluster2] command kubectl --context=cluster2 exec netshoot-54468bbbbd-tctbp -- curl --output /dev/null -m 30 --silent --head --fail 169.254.3.24
2020-05-14T14:28:38.3348360Z [submariner]$ [cluster2] kubectl --context=cluster2 exec netshoot-54468bbbbd-tctbp -- curl --output /dev/null -m 30 --silent --head --fail 169.254.3.24
2020-05-14T14:28:39.3593608Z Connection test was successful!
2020-05-14T14:28:39.3609863Z [submariner]$ [cluster2] return 0
2020-05-14T14:28:39.3621754Z [submariner]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:39.3708247Z [submariner]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:39.3729103Z [submariner]$ [cluster2] local resource_file=/opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:39.3749552Z [submariner]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:39.3763937Z [submariner]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:39.3777413Z [submariner]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:39.3793039Z [submariner]$ [cluster2] kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2020-05-14T14:28:40.1102810Z deployment.apps "netshoot" deleted
2020-05-14T14:28:40.1247352Z [submariner]$ [cluster2] with_context cluster3 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1261208Z [submariner]$ [cluster2] with_context cluster3 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1275618Z [submariner]$ [cluster2] local cluster=cluster3
2020-05-14T14:28:40.1287072Z [submariner]$ [cluster3] local cmnd=remove_resource
2020-05-14T14:28:40.1303094Z [submariner]$ [cluster3] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1317133Z [submariner]$ [cluster3] remove_resource
2020-05-14T14:28:40.1330817Z [submariner]$ [cluster3] local resource_file=/opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1346298Z [submariner]$ [cluster3] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1361859Z [submariner]$ [cluster3] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1375822Z [submariner]$ [cluster3] command kubectl --context=cluster3 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.1389476Z [submariner]$ [cluster3] kubectl --context=cluster3 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2020-05-14T14:28:40.8845422Z deployment.apps "nginx-demo" deleted
2020-05-14T14:28:40.9487665Z service "nginx-demo" deleted
2020-05-14T14:28:40.9735334Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner'
2020-05-14T14:28:40.9808587Z [submariner]$ declare_kubeconfig
2020-05-14T14:28:40.9818887Z [submariner]$ declare_kubeconfig
2020-05-14T14:28:40.9854632Z [submariner]$ source /opt/shipyard/scripts/lib/kubecfg
2020-05-14T14:28:40.9897608Z [submariner]$ export KUBECONFIG
2020-05-14T14:28:40.9990411Z [submariner]$ KUBECONFIG=/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2:/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1:/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3:
2020-05-14T14:28:41.0014033Z [submariner]$ find /go/src/github.com/submariner-io/submariner/output/kubeconfigs -type f -printf %p:
2020-05-14T14:28:41.0061749Z [submariner]$ test_with_e2e_tests
2020-05-14T14:28:41.0073146Z [submariner]$ test_with_e2e_tests
2020-05-14T14:28:41.0085425Z [submariner]$ cd /go/src/github.com/submariner-io/submariner/test/e2e
2020-05-14T14:28:41.0103701Z [e2e]$ go test -v -args -ginkgo.v -ginkgo.randomizeAllSpecs -submariner-namespace submariner-operator -dp-context cluster2 -dp-context cluster3 -dp-context cluster1 -ginkgo.reportPassed -ginkgo.focus \[.*\] -ginkgo.reportFile /go/src/github.com/submariner-io/submariner/output/e2e-junit.xml
2020-05-14T14:28:41.0128210Z [e2e]$ tee /go/src/github.com/submariner-io/submariner/output/e2e-tests.log
2020-05-14T14:28:41.0152515Z [e2e]$ generate_context_flags
2020-05-14T14:28:41.0166655Z [e2e]$ generate_context_flags
2020-05-14T14:28:41.0182351Z [e2e]$ [cluster2] printf  -dp-context cluster2
2020-05-14T14:28:41.0221167Z [e2e]$ [cluster3] printf  -dp-context cluster3
2020-05-14T14:28:41.0232498Z [e2e]$ [cluster1] printf  -dp-context cluster1
2020-05-14T14:29:33.4129946Z === RUN   TestE2E
2020-05-14T14:29:33.4136057Z Running Suite: Submariner E2E suite
2020-05-14T14:29:33.4137172Z ===================================
2020-05-14T14:29:33.4139285Z Random Seed: 1589466573 - Will randomize all specs
2020-05-14T14:29:33.4140233Z Will run 19 of 20 specs
2020-05-14T14:29:33.4140293Z
2020-05-14T14:29:33.4150284Z STEP: Creating kubernetes clients
2020-05-14T14:29:33.4227638Z STEP: Creating submariner clients
2020-05-14T14:29:33.4324910Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote pod when the pod is not on a gateway and the remote pod is not on a gateway
2020-05-14T14:29:33.4325182Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:29:33.4325469Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:29:33.4325715Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:29:33.4539505Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-b9gcw" in cluster "cluster2" to execute the tests in
2020-05-14T14:29:33.4539880Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-b9gcw" in cluster "cluster3"
2020-05-14T14:29:33.4649236Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-b9gcw" in cluster "cluster1"
2020-05-14T14:29:33.5698424Z May 14 14:29:33.517: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:29:33.5699326Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-b9gcw" on cluster "cluster2"
2020-05-14T14:29:33.6450914Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-b9gcw" on cluster "cluster3"
2020-05-14T14:29:33.6511388Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-b9gcw" on cluster "cluster1"
2020-05-14T14:29:33.6669548Z
2020-05-14T14:29:33.6669978Z S [SKIPPING] [0.235 seconds]
2020-05-14T14:29:33.6671271Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:29:33.6676151Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:29:33.6676283Z   when a pod connects via TCP to a remote pod
2020-05-14T14:29:33.6678052Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:32
2020-05-14T14:29:33.6678163Z     when the pod is not on a gateway and the remote pod is not on a gateway
2020-05-14T14:29:33.6679142Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:38
2020-05-14T14:29:33.6682026Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:29:33.6684503Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:29:33.6687987Z
2020-05-14T14:29:33.6689190Z       May 14 14:29:33.568: Globalnet enabled, skipping the test...
2020-05-14T14:29:33.6693140Z
2020-05-14T14:29:33.6694488Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:29:33.6698051Z ------------------------------
2020-05-14T14:29:33.6704493Z [redundancy] Gateway fail-over tests when any gateway node is configured
2020-05-14T14:29:33.6711851Z   should be reported to the Gateway API
2020-05-14T14:29:33.6719114Z   /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:24
2020-05-14T14:29:33.6719430Z STEP: Creating namespace objects with basename "gateway-redundancy"
2020-05-14T14:29:33.6788175Z STEP: Generated namespace "e2e-tests-gateway-redundancy-8nt4g" in cluster "cluster2" to execute the tests in
2020-05-14T14:29:33.6788552Z STEP: Creating namespace "e2e-tests-gateway-redundancy-8nt4g" in cluster "cluster3"
2020-05-14T14:29:33.6928255Z STEP: Creating namespace "e2e-tests-gateway-redundancy-8nt4g" in cluster "cluster1"
2020-05-14T14:29:33.7461565Z STEP: Ensuring that only one gateway reports as active "cluster2"
2020-05-14T14:29:33.7531407Z STEP: Ensuring that the gateway "cluster2-worker" is reporting connections
2020-05-14T14:29:33.7681877Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-8nt4g" on cluster "cluster2"
2020-05-14T14:29:33.7760612Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-8nt4g" on cluster "cluster3"
2020-05-14T14:29:33.7952519Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-8nt4g" on cluster "cluster1"
2020-05-14T14:29:33.8084821Z •
2020-05-14T14:29:33.8086090Z ------------------------------
2020-05-14T14:29:33.8099258Z STEP: Creating namespace objects with basename "gateway-redundancy"
2020-05-14T14:29:33.8100298Z STEP: Generated namespace "e2e-tests-gateway-redundancy-8nt4g" in cluster "cluster2" to execute the tests in
2020-05-14T14:29:33.8116021Z STEP: Creating namespace "e2e-tests-gateway-redundancy-8nt4g" in cluster "cluster3"
2020-05-14T14:29:33.8119942Z STEP: Creating namespace "e2e-tests-gateway-redundancy-8nt4g" in cluster "cluster1"
2020-05-14T14:29:33.8120263Z STEP: Ensuring that only one gateway reports as active "cluster2"
2020-05-14T14:29:33.8120516Z STEP: Ensuring that the gateway "cluster2-worker" is reporting connections
2020-05-14T14:29:33.8120776Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-8nt4g" on cluster "cluster2"
2020-05-14T14:29:33.8121228Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-8nt4g" on cluster "cluster3"
2020-05-14T14:29:33.8121451Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-8nt4g" on cluster "cluster1"
2020-05-14T14:29:33.8121517Z
2020-05-14T14:29:33.8121551Z
2020-05-14T14:29:33.8121812Z [redundancy] Gateway fail-over tests when one gateway node is configured and the submariner engine pod fails
2020-05-14T14:29:33.8122063Z   should start a new submariner engine pod and be able to connect from another cluster
2020-05-14T14:29:33.8122307Z   /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:30
2020-05-14T14:29:33.8122515Z STEP: Creating namespace objects with basename "gateway-redundancy"
2020-05-14T14:29:33.8144369Z STEP: Generated namespace "e2e-tests-gateway-redundancy-hcrp7" in cluster "cluster2" to execute the tests in
2020-05-14T14:29:33.8147162Z STEP: Creating namespace "e2e-tests-gateway-redundancy-hcrp7" in cluster "cluster3"
2020-05-14T14:29:33.8198467Z STEP: Creating namespace "e2e-tests-gateway-redundancy-hcrp7" in cluster "cluster1"
2020-05-14T14:29:33.8455311Z STEP: Sanity check - ensuring there's only one gateway node on "cluster2"
2020-05-14T14:29:33.9153989Z STEP: Found submariner engine pod "submariner-gateway-ts9lq" on "cluster2"
2020-05-14T14:29:33.9154407Z STEP: Ensuring that the gateway reports as active on "cluster2"
2020-05-14T14:29:33.9446343Z STEP: Deleting submariner engine pod and gateway entries "submariner-gateway-ts9lq"
2020-05-14T14:29:39.0281732Z STEP: Found new submariner engine pod "submariner-gateway-dq7nf"
2020-05-14T14:29:39.0282157Z STEP: Waiting for the gateway to be up and connected "submariner-gateway-dq7nf"
2020-05-14T14:29:44.0450694Z STEP: Verifying TCP connectivity from gateway node on "cluster3" to gateway node on "cluster2"
2020-05-14T14:29:44.0454792Z STEP: Creating a listener pod in cluster "cluster2", which will wait for a handshake over TCP
2020-05-14T14:29:49.0822976Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster2"
2020-05-14T14:29:54.1007594Z May 14 14:29:54.100: INFO: Will send traffic to IP: 169.254.2.30
2020-05-14T14:29:54.1009251Z STEP: Creating a connector pod in cluster "cluster3", which will attempt the specific UUID handshake over TCP
2020-05-14T14:29:54.1095207Z STEP: Waiting for the listener pod "tcp-check-listenerpsxcj" to exit, returning what listener sent
2020-05-14T14:30:14.1147212Z May 14 14:30:14.114: INFO: Pod "tcp-check-listenerpsxcj" output:
2020-05-14T14:30:14.1147887Z listening on 0.0.0.0:1234 ...
2020-05-14T14:30:14.1148272Z connect to 10.240.0.4:1234 from 169.254.3.68:45941 (169.254.3.68:45941)
2020-05-14T14:30:14.1149124Z [dataplane] connector says 60bdf13a-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:30:14.1149330Z
2020-05-14T14:30:14.1149767Z STEP: Waiting for the connector pod "tcp-check-podxfdhk" to exit, returning what connector sent
2020-05-14T14:30:14.1172615Z May 14 14:30:14.116: INFO: Pod "tcp-check-podxfdhk" output:
2020-05-14T14:30:14.1173170Z nc: 169.254.2.30 (169.254.2.30:1234): Connection timed out
2020-05-14T14:30:14.1173371Z 169.254.2.30 (169.254.2.30:1234) open
2020-05-14T14:30:14.1173761Z [dataplane] listener says 5abf950d-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:30:14.1173928Z
2020-05-14T14:30:14.1174108Z May 14 14:30:14.117: INFO: Connector pod has IP: 10.240.96.2
2020-05-14T14:30:14.1177288Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:30:14.1177859Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:30:14.1178640Z STEP: Verifying TCP connectivity from non-gateway node on "cluster3" to non-gateway node on "cluster2"
2020-05-14T14:30:14.1179312Z STEP: Creating a listener pod in cluster "cluster2", which will wait for a handshake over TCP
2020-05-14T14:30:19.1304684Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster2"
2020-05-14T14:30:24.1838342Z May 14 14:30:24.183: INFO: Will send traffic to IP: 169.254.2.6
2020-05-14T14:30:24.1839372Z STEP: Creating a connector pod in cluster "cluster3", which will attempt the specific UUID handshake over TCP
2020-05-14T14:30:24.1963214Z STEP: Waiting for the listener pod "tcp-check-listenerh9vb4" to exit, returning what listener sent
2020-05-14T14:30:44.2019171Z May 14 14:30:44.201: INFO: Pod "tcp-check-listenerh9vb4" output:
2020-05-14T14:30:44.2019354Z listening on 0.0.0.0:1234 ...
2020-05-14T14:30:44.2019458Z connect to 10.240.128.2:1234 from 169.254.3.225:44421 (169.254.3.225:44421)
2020-05-14T14:30:44.2043132Z [dataplane] connector says 72ac3e87-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:30:44.2043224Z
2020-05-14T14:30:44.2043615Z STEP: Waiting for the connector pod "tcp-check-pod82ls4" to exit, returning what connector sent
2020-05-14T14:30:44.2046649Z May 14 14:30:44.204: INFO: Pod "tcp-check-pod82ls4" output:
2020-05-14T14:30:44.2048799Z nc: 169.254.2.6 (169.254.2.6:1234): Connection timed out
2020-05-14T14:30:44.2051025Z 169.254.2.6 (169.254.2.6:1234) open
2020-05-14T14:30:44.2052961Z [dataplane] listener says 6cac3a45-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:30:44.2055532Z
2020-05-14T14:30:44.2055825Z May 14 14:30:44.204: INFO: Connector pod has IP: 10.240.128.3
2020-05-14T14:30:44.2056677Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:30:44.2061480Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:30:44.2062028Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-hcrp7" on cluster "cluster2"
2020-05-14T14:30:44.2142919Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-hcrp7" on cluster "cluster3"
2020-05-14T14:30:44.2213759Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-hcrp7" on cluster "cluster1"
2020-05-14T14:30:44.2351912Z
2020-05-14T14:30:44.2357556Z • [SLOW TEST:70.425 seconds]
2020-05-14T14:30:44.2358417Z [redundancy] Gateway fail-over tests
2020-05-14T14:30:44.2360550Z /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:17
2020-05-14T14:30:44.2361342Z   when one gateway node is configured and the submariner engine pod fails
2020-05-14T14:30:44.2364246Z   /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:29
2020-05-14T14:30:44.2365155Z     should start a new submariner engine pod and be able to connect from another cluster
2020-05-14T14:30:44.2367312Z     /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:30
2020-05-14T14:30:44.2387105Z ------------------------------
2020-05-14T14:30:44.2392562Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery when a pod connects via TCP to the globalIP of a remote service when the pod is not on a gateway and the remote service is on a gateway
2020-05-14T14:30:44.2395723Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:30:44.2402574Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:30:44.2403638Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:30:44.2538696Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" in cluster "cluster2" to execute the tests in
2020-05-14T14:30:44.2558388Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" in cluster "cluster3"
2020-05-14T14:30:44.2669171Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" in cluster "cluster1"
2020-05-14T14:30:44.2721304Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:30:50.6496280Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:30:55.3979130Z May 14 14:30:55.397: INFO: Will send traffic to IP: 169.254.3.204
2020-05-14T14:30:55.3981238Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:30:55.4054530Z STEP: Waiting for the listener pod "tcp-check-listener6wlm8" to exit, returning what listener sent
2020-05-14T14:31:20.4138023Z May 14 14:31:20.410: INFO: Pod "tcp-check-listener6wlm8" output:
2020-05-14T14:31:20.4138758Z listening on 0.0.0.0:1234 ...
2020-05-14T14:31:20.4139296Z connect to 10.240.96.2:1234 from 169.254.2.6:35451 (169.254.2.6:35451)
2020-05-14T14:31:20.4140290Z [dataplane] connector says 85472168-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:20.4140410Z
2020-05-14T14:31:20.4140948Z STEP: Waiting for the connector pod "tcp-check-podgwvmj" to exit, returning what connector sent
2020-05-14T14:31:20.4144583Z May 14 14:31:20.414: INFO: Pod "tcp-check-podgwvmj" output:
2020-05-14T14:31:20.4145073Z nc: 169.254.3.204 (169.254.3.204:1234): Connection timed out
2020-05-14T14:31:20.4145326Z 169.254.3.204 (169.254.3.204:1234) open
2020-05-14T14:31:20.4146348Z [dataplane] listener says 7ea58459-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:20.4147867Z
2020-05-14T14:31:20.4149813Z May 14 14:31:20.414: INFO: Connector pod has IP: 10.240.128.2
2020-05-14T14:31:20.4150870Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:31:20.4162007Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:31:20.4163852Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" on cluster "cluster2"
2020-05-14T14:31:20.4216049Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" on cluster "cluster3"
2020-05-14T14:31:20.4251193Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" on cluster "cluster1"
2020-05-14T14:31:20.4290720Z •
2020-05-14T14:31:20.4291413Z ------------------------------
2020-05-14T14:31:20.4291715Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:31:20.4292090Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" in cluster "cluster2" to execute the tests in
2020-05-14T14:31:20.4292364Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" in cluster "cluster3"
2020-05-14T14:31:20.4292768Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" in cluster "cluster1"
2020-05-14T14:31:20.4293196Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:31:20.4293435Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:31:20.4293546Z May 14 14:30:55.397: INFO: Will send traffic to IP: 169.254.3.204
2020-05-14T14:31:20.4293809Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:31:20.4294049Z STEP: Waiting for the listener pod "tcp-check-listener6wlm8" to exit, returning what listener sent
2020-05-14T14:31:20.4294458Z May 14 14:31:20.410: INFO: Pod "tcp-check-listener6wlm8" output:
2020-05-14T14:31:20.4294549Z listening on 0.0.0.0:1234 ...
2020-05-14T14:31:20.4294638Z connect to 10.240.96.2:1234 from 169.254.2.6:35451 (169.254.2.6:35451)
2020-05-14T14:31:20.4294869Z [dataplane] connector says 85472168-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:20.4294917Z
2020-05-14T14:31:20.4295161Z STEP: Waiting for the connector pod "tcp-check-podgwvmj" to exit, returning what connector sent
2020-05-14T14:31:20.4295391Z May 14 14:31:20.414: INFO: Pod "tcp-check-podgwvmj" output:
2020-05-14T14:31:20.4295472Z nc: 169.254.3.204 (169.254.3.204:1234): Connection timed out
2020-05-14T14:31:20.4295564Z 169.254.3.204 (169.254.3.204:1234) open
2020-05-14T14:31:20.4295787Z [dataplane] listener says 7ea58459-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:20.4295833Z
2020-05-14T14:31:20.4295921Z May 14 14:31:20.414: INFO: Connector pod has IP: 10.240.128.2
2020-05-14T14:31:20.4296184Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:31:20.4296441Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:31:20.4296675Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" on cluster "cluster2"
2020-05-14T14:31:20.4297338Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" on cluster "cluster3"
2020-05-14T14:31:20.4298129Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-9twx9" on cluster "cluster1"
2020-05-14T14:31:20.4298182Z
2020-05-14T14:31:20.4298405Z
2020-05-14T14:31:20.4299501Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote pod when the pod is not on a gateway and the remote pod is on a gateway
2020-05-14T14:31:20.4300361Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:31:20.4301148Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:31:20.4301479Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:31:20.4327411Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-pc4s2" in cluster "cluster2" to execute the tests in
2020-05-14T14:31:20.4345129Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-pc4s2" in cluster "cluster3"
2020-05-14T14:31:20.4394538Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-pc4s2" in cluster "cluster1"
2020-05-14T14:31:20.4522197Z May 14 14:31:20.451: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:31:20.4526940Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-pc4s2" on cluster "cluster2"
2020-05-14T14:31:20.5021757Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-pc4s2" on cluster "cluster3"
2020-05-14T14:31:20.5269524Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-pc4s2" on cluster "cluster1"
2020-05-14T14:31:20.5335807Z
2020-05-14T14:31:20.5336284Z S [SKIPPING] [0.104 seconds]
2020-05-14T14:31:20.5336418Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:31:20.5347663Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:31:20.5347813Z   when a pod connects via TCP to a remote pod
2020-05-14T14:31:20.5348133Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:32
2020-05-14T14:31:20.5348252Z     when the pod is not on a gateway and the remote pod is on a gateway
2020-05-14T14:31:20.5348562Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:42
2020-05-14T14:31:20.5348849Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:31:20.5349150Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:31:20.5349218Z
2020-05-14T14:31:20.5349487Z       May 14 14:31:20.451: Globalnet enabled, skipping the test...
2020-05-14T14:31:20.5349562Z
2020-05-14T14:31:20.5349852Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:31:20.5350095Z ------------------------------
2020-05-14T14:31:20.5350507Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote service when the pod is not on a gateway and the remote service is on a gateway
2020-05-14T14:31:20.5350806Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:31:20.5351100Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:31:20.5351373Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:31:20.5659698Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-5j5bh" in cluster "cluster2" to execute the tests in
2020-05-14T14:31:20.5660049Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-5j5bh" in cluster "cluster3"
2020-05-14T14:31:20.5751861Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-5j5bh" in cluster "cluster1"
2020-05-14T14:31:20.5781318Z May 14 14:31:20.577: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:31:20.5781752Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-5j5bh" on cluster "cluster2"
2020-05-14T14:31:20.6172005Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-5j5bh" on cluster "cluster3"
2020-05-14T14:31:20.6469712Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-5j5bh" on cluster "cluster1"
2020-05-14T14:31:20.6508271Z
2020-05-14T14:31:20.6522126Z S [SKIPPING] [0.117 seconds]
2020-05-14T14:31:20.6522257Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:31:20.6522740Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:31:20.6522862Z   when a pod connects via TCP to a remote service
2020-05-14T14:31:20.6523175Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:55
2020-05-14T14:31:20.6523269Z     when the pod is not on a gateway and the remote service is on a gateway
2020-05-14T14:31:20.6523547Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:65
2020-05-14T14:31:20.6523823Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:31:20.6524425Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:31:20.6524481Z
2020-05-14T14:31:20.6524713Z       May 14 14:31:20.577: Globalnet enabled, skipping the test...
2020-05-14T14:31:20.6524764Z
2020-05-14T14:31:20.6525063Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:31:20.6525290Z ------------------------------
2020-05-14T14:31:20.6525679Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery when a pod connects via TCP to the globalIP of a remote service when the pod is on a gateway and the remote service is not on a gateway
2020-05-14T14:31:20.6525950Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:31:20.6526233Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:31:20.6526470Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:31:20.6570935Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" in cluster "cluster2" to execute the tests in
2020-05-14T14:31:20.6571274Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" in cluster "cluster3"
2020-05-14T14:31:20.6806173Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" in cluster "cluster1"
2020-05-14T14:31:20.6965242Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:31:25.8467954Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:31:31.1585724Z May 14 14:31:30.940: INFO: Will send traffic to IP: 169.254.3.124
2020-05-14T14:31:31.1587150Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:31:31.1587717Z STEP: Waiting for the listener pod "tcp-check-listenerdd9gd" to exit, returning what listener sent
2020-05-14T14:31:55.9538848Z May 14 14:31:55.953: INFO: Pod "tcp-check-listenerdd9gd" output:
2020-05-14T14:31:55.9538999Z listening on 0.0.0.0:1234 ...
2020-05-14T14:31:55.9539087Z connect to 10.240.128.3:1234 from 169.254.2.45:38777 (169.254.2.45:38777)
2020-05-14T14:31:55.9539399Z [dataplane] connector says 9a768fa5-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:55.9539473Z
2020-05-14T14:31:55.9539917Z STEP: Waiting for the connector pod "tcp-check-podrdwwg" to exit, returning what connector sent
2020-05-14T14:31:55.9578005Z May 14 14:31:55.957: INFO: Pod "tcp-check-podrdwwg" output:
2020-05-14T14:31:55.9578134Z nc: 169.254.3.124 (169.254.3.124:1234): Connection timed out
2020-05-14T14:31:55.9578226Z 169.254.3.124 (169.254.3.124:1234) open
2020-05-14T14:31:55.9578475Z [dataplane] listener says 945b82b2-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:55.9578524Z
2020-05-14T14:31:55.9578624Z May 14 14:31:55.957: INFO: Connector pod has IP: 10.240.0.4
2020-05-14T14:31:55.9584386Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:31:55.9584831Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:31:55.9585457Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" on cluster "cluster2"
2020-05-14T14:31:55.9643885Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" on cluster "cluster3"
2020-05-14T14:31:55.9691526Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" on cluster "cluster1"
2020-05-14T14:31:55.9737702Z •
2020-05-14T14:31:55.9737935Z ------------------------------
2020-05-14T14:31:55.9738462Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:31:55.9738766Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" in cluster "cluster2" to execute the tests in
2020-05-14T14:31:55.9739406Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" in cluster "cluster3"
2020-05-14T14:31:55.9739823Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" in cluster "cluster1"
2020-05-14T14:31:55.9740248Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:31:55.9740499Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:31:55.9740606Z May 14 14:31:30.940: INFO: Will send traffic to IP: 169.254.3.124
2020-05-14T14:31:55.9740881Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:31:55.9741149Z STEP: Waiting for the listener pod "tcp-check-listenerdd9gd" to exit, returning what listener sent
2020-05-14T14:31:55.9741372Z May 14 14:31:55.953: INFO: Pod "tcp-check-listenerdd9gd" output:
2020-05-14T14:31:55.9741472Z listening on 0.0.0.0:1234 ...
2020-05-14T14:31:55.9741563Z connect to 10.240.128.3:1234 from 169.254.2.45:38777 (169.254.2.45:38777)
2020-05-14T14:31:55.9741986Z [dataplane] connector says 9a768fa5-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:55.9742039Z
2020-05-14T14:31:55.9742471Z STEP: Waiting for the connector pod "tcp-check-podrdwwg" to exit, returning what connector sent
2020-05-14T14:31:55.9742718Z May 14 14:31:55.957: INFO: Pod "tcp-check-podrdwwg" output:
2020-05-14T14:31:55.9742822Z nc: 169.254.3.124 (169.254.3.124:1234): Connection timed out
2020-05-14T14:31:55.9742903Z 169.254.3.124 (169.254.3.124:1234) open
2020-05-14T14:31:55.9743141Z [dataplane] listener says 945b82b2-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:31:55.9743191Z
2020-05-14T14:31:55.9743477Z May 14 14:31:55.957: INFO: Connector pod has IP: 10.240.0.4
2020-05-14T14:31:55.9743901Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:31:55.9744170Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:31:55.9744422Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" on cluster "cluster2"
2020-05-14T14:31:55.9744656Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" on cluster "cluster3"
2020-05-14T14:31:55.9744910Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-qkz9n" on cluster "cluster1"
2020-05-14T14:31:55.9744978Z
2020-05-14T14:31:55.9749367Z
2020-05-14T14:31:55.9750304Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery when a pod with HostNetworking connects via TCP to the globalIP of a remote service when the pod is not on a gateway and the remote service is not on a gateway
2020-05-14T14:31:55.9750759Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:31:55.9751181Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:31:55.9751436Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:31:56.0007275Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-lmhhl" in cluster "cluster2" to execute the tests in
2020-05-14T14:31:56.0007766Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-lmhhl" in cluster "cluster3"
2020-05-14T14:31:56.0055034Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-lmhhl" in cluster "cluster1"
2020-05-14T14:31:56.0098023Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:32:01.2176394Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:32:46.3179429Z May 14 14:32:46.317: INFO: Will send traffic to IP: 169.254.3.55
2020-05-14T14:32:46.3180394Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:32:46.3360566Z STEP: Waiting for the listener pod "tcp-check-listenerk6zzt" to exit, returning what listener sent
2020-05-14T14:32:51.3418690Z May 14 14:32:51.341: INFO: Pod "tcp-check-listenerk6zzt" output:
2020-05-14T14:32:51.3419253Z listening on 0.0.0.0:1234 ...
2020-05-14T14:32:51.3419494Z connect to 10.240.128.3:1234 from 169.254.2.94:43565 (169.254.2.94:43565)
2020-05-14T14:32:51.3419906Z [dataplane] connector says c76426c4-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:32:51.3420083Z
2020-05-14T14:32:51.3420636Z STEP: Waiting for the connector pod "tcp-check-podnsjx8" to exit, returning what connector sent
2020-05-14T14:32:51.3442757Z May 14 14:32:51.343: INFO: Pod "tcp-check-podnsjx8" output:
2020-05-14T14:32:51.3442861Z 169.254.3.55 (169.254.3.55:1234) open
2020-05-14T14:32:51.3443132Z [dataplane] listener says a967ca8f-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:32:51.3443204Z
2020-05-14T14:32:51.3443281Z May 14 14:32:51.343: INFO: Connector pod has IP: 172.17.0.5
2020-05-14T14:32:51.3443587Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:32:51.3443853Z STEP: Verifying that globalIP annotation does not exist on the connector POD
2020-05-14T14:32:51.3444126Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-lmhhl" on cluster "cluster2"
2020-05-14T14:32:51.3516124Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-lmhhl" on cluster "cluster3"
2020-05-14T14:32:51.3552342Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-lmhhl" on cluster "cluster1"
2020-05-14T14:32:51.3599922Z
2020-05-14T14:32:51.3600332Z • [SLOW TEST:55.385 seconds]
2020-05-14T14:32:51.3601118Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery
2020-05-14T14:32:51.3601388Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:9
2020-05-14T14:32:51.3601526Z   when a pod with HostNetworking connects via TCP to the globalIP of a remote service
2020-05-14T14:32:51.3601811Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:56
2020-05-14T14:32:51.3601922Z     when the pod is not on a gateway and the remote service is not on a gateway
2020-05-14T14:32:51.3602192Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:62
2020-05-14T14:32:51.3602301Z       should have sent the expected data from the pod to the other pod
2020-05-14T14:32:51.3602581Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:32:51.3602802Z ------------------------------
2020-05-14T14:32:51.3603183Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote service when the pod is not on a gateway and the remote service is not on a gateway
2020-05-14T14:32:51.3603459Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:32:51.3603716Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:32:51.3604110Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:32:51.3675199Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-2lqxm" in cluster "cluster2" to execute the tests in
2020-05-14T14:32:51.3675551Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-2lqxm" in cluster "cluster3"
2020-05-14T14:32:51.3752848Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-2lqxm" in cluster "cluster1"
2020-05-14T14:32:51.3841451Z May 14 14:32:51.383: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:32:51.3848659Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-2lqxm" on cluster "cluster2"
2020-05-14T14:32:51.4125677Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-2lqxm" on cluster "cluster3"
2020-05-14T14:32:51.4368456Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-2lqxm" on cluster "cluster1"
2020-05-14T14:32:51.4443447Z
2020-05-14T14:32:51.4444105Z S [SKIPPING] [0.084 seconds]
2020-05-14T14:32:51.4444224Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:32:51.4444545Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:32:51.4444659Z   when a pod connects via TCP to a remote service
2020-05-14T14:32:51.4444929Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:55
2020-05-14T14:32:51.4445044Z     when the pod is not on a gateway and the remote service is not on a gateway
2020-05-14T14:32:51.4445334Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:61
2020-05-14T14:32:51.4445608Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:32:51.4445912Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:32:51.4445971Z
2020-05-14T14:32:51.4446226Z       May 14 14:32:51.383: Globalnet enabled, skipping the test...
2020-05-14T14:32:51.4446285Z
2020-05-14T14:32:51.4446580Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:32:51.4446809Z ------------------------------
2020-05-14T14:32:51.4447197Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote service when the pod is on a gateway and the remote service is on a gateway
2020-05-14T14:32:51.4447457Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:32:51.4447737Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:32:51.4448005Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:32:51.4613745Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-vkqt6" in cluster "cluster2" to execute the tests in
2020-05-14T14:32:51.4614055Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-vkqt6" in cluster "cluster3"
2020-05-14T14:32:51.4642050Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-vkqt6" in cluster "cluster1"
2020-05-14T14:32:51.4712275Z May 14 14:32:51.470: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:32:51.4720871Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-vkqt6" on cluster "cluster2"
2020-05-14T14:32:51.5298943Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-vkqt6" on cluster "cluster3"
2020-05-14T14:32:51.5421180Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-vkqt6" on cluster "cluster1"
2020-05-14T14:32:51.5591805Z
2020-05-14T14:32:51.5592307Z S [SKIPPING] [0.114 seconds]
2020-05-14T14:32:51.5592446Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:32:51.5592731Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:32:51.5592823Z   when a pod connects via TCP to a remote service
2020-05-14T14:32:51.5593272Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:55
2020-05-14T14:32:51.5593396Z     when the pod is on a gateway and the remote service is on a gateway
2020-05-14T14:32:51.5594061Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:73
2020-05-14T14:32:51.5594499Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:32:51.5594767Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:32:51.5598363Z
2020-05-14T14:32:51.5598743Z       May 14 14:32:51.471: Globalnet enabled, skipping the test...
2020-05-14T14:32:51.5598941Z
2020-05-14T14:32:51.5599245Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:32:51.5599460Z ------------------------------
2020-05-14T14:32:51.5599806Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote service when the pod is on a gateway and the remote service is not on a gateway
2020-05-14T14:32:51.5600071Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:32:51.5600333Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:32:51.5600566Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:32:51.5664705Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-n2msd" in cluster "cluster2" to execute the tests in
2020-05-14T14:32:51.5665120Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-n2msd" in cluster "cluster3"
2020-05-14T14:32:51.5780663Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-n2msd" in cluster "cluster1"
2020-05-14T14:32:51.6146858Z May 14 14:32:51.614: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:32:51.6154593Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-n2msd" on cluster "cluster2"
2020-05-14T14:32:51.6553920Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-n2msd" on cluster "cluster3"
2020-05-14T14:32:51.6681740Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-n2msd" on cluster "cluster1"
2020-05-14T14:32:51.6738130Z
2020-05-14T14:32:51.6749025Z S [SKIPPING] [0.115 seconds]
2020-05-14T14:32:51.6749130Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:32:51.6749809Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:32:51.6749944Z   when a pod connects via TCP to a remote service
2020-05-14T14:32:51.6750226Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:55
2020-05-14T14:32:51.6750322Z     when the pod is on a gateway and the remote service is not on a gateway
2020-05-14T14:32:51.6750888Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:69
2020-05-14T14:32:51.6751167Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:32:51.6751456Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:32:51.6751518Z
2020-05-14T14:32:51.6751782Z       May 14 14:32:51.614: Globalnet enabled, skipping the test...
2020-05-14T14:32:51.6751840Z
2020-05-14T14:32:51.6752266Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:32:51.6752550Z ------------------------------
2020-05-14T14:32:51.6753047Z [redundancy] Gateway fail-over tests when a new node is labeled as a gateway node and the label on the existing gateway node is removed
2020-05-14T14:32:51.6753848Z   should start a submariner engine on the new gateway node and be able to connect from another cluster
2020-05-14T14:32:51.6754162Z   /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:36
2020-05-14T14:32:51.6754386Z STEP: Creating namespace objects with basename "gateway-redundancy"
2020-05-14T14:32:51.6825680Z STEP: Generated namespace "e2e-tests-gateway-redundancy-n86qt" in cluster "cluster2" to execute the tests in
2020-05-14T14:32:51.6826212Z STEP: Creating namespace "e2e-tests-gateway-redundancy-n86qt" in cluster "cluster3"
2020-05-14T14:32:51.6887974Z STEP: Creating namespace "e2e-tests-gateway-redundancy-n86qt" in cluster "cluster1"
2020-05-14T14:32:51.7472472Z STEP: Found gateway node "cluster2-worker" on "cluster2"
2020-05-14T14:32:51.7686834Z STEP: Found non-gateway node "cluster2-worker2" on "cluster2"
2020-05-14T14:32:51.7839411Z STEP: Found submariner engine pod "submariner-gateway-dq7nf" on "cluster2"
2020-05-14T14:32:51.7902037Z STEP: Found submariner endpoint for "cluster2": &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"Endpoint", APIVersion:"submariner.io/v1"}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-17-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-17-0-9", UID:"5567bec0-95ef-11ea-a624-0242ac110008", ResourceVersion:"1192", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63725063375, loc:(*time.Location)(0x1d21440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-17-0-9", Hostname:"cluster2-worker", Subnets:[]string{"169.254.2.0/24"}, PrivateIP:"172.17.0.9", PublicIP:"", NATEnabled:false, Backend:"strongswan", BackendConfig:map[string]string(nil)}}
2020-05-14T14:32:51.7903722Z STEP: Setting the gateway label for node "cluster2-worker2" to true
2020-05-14T14:32:51.8021585Z STEP: Ensuring that two Gateways become available in cluster "cluster2"
2020-05-14T14:33:12.1882641Z STEP: Setting the gateway label for node "cluster2-worker" to false
2020-05-14T14:33:12.1884018Z STEP: Verifying that the gateway "cluster2-worker" was deleted
2020-05-14T14:33:12.1884367Z STEP: Found new submariner engine pod "submariner-gateway-9hbsr"
2020-05-14T14:33:12.1884807Z STEP: Waiting for the new pod "submariner-gateway-9hbsr" to report as active and fully connected
2020-05-14T14:33:42.0607727Z STEP: Found new submariner endpoint for "cluster2": &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"Endpoint", APIVersion:"submariner.io/v1"}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-17-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-17-0-5", UID:"ddbcd2c2-95ef-11ea-a624-0242ac110008", ResourceVersion:"1904", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63725063603, loc:(*time.Location)(0x1d21440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-17-0-5", Hostname:"cluster2-worker2", Subnets:[]string{"169.254.2.0/24"}, PrivateIP:"172.17.0.5", PublicIP:"", NATEnabled:false, Backend:"strongswan", BackendConfig:map[string]string(nil)}}
2020-05-14T14:33:42.0608292Z STEP: Verifying TCP connectivity from gateway node on "cluster3" to gateway node on "cluster2"
2020-05-14T14:33:42.0608813Z STEP: Creating a listener pod in cluster "cluster2", which will wait for a handshake over TCP
2020-05-14T14:33:47.0753303Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster2"
2020-05-14T14:33:52.0994905Z May 14 14:33:52.099: INFO: Will send traffic to IP: 169.254.2.202
2020-05-14T14:33:52.0995861Z STEP: Creating a connector pod in cluster "cluster3", which will attempt the specific UUID handshake over TCP
2020-05-14T14:33:52.1121503Z STEP: Waiting for the listener pod "tcp-check-listenerjqqcf" to exit, returning what listener sent
2020-05-14T14:34:17.1187052Z May 14 14:34:17.118: INFO: Pod "tcp-check-listenerjqqcf" output:
2020-05-14T14:34:17.1187565Z listening on 0.0.0.0:1234 ...
2020-05-14T14:34:17.1187663Z connect to 10.240.128.2:1234 from 169.254.3.24:37423 (169.254.3.24:37423)
2020-05-14T14:34:17.1187961Z [dataplane] connector says ee99a54f-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:34:17.1188012Z
2020-05-14T14:34:17.1188282Z STEP: Waiting for the connector pod "tcp-check-podzl7ts" to exit, returning what connector sent
2020-05-14T14:34:17.1222585Z May 14 14:34:17.122: INFO: Pod "tcp-check-podzl7ts" output:
2020-05-14T14:34:17.1223358Z nc: 169.254.2.202 (169.254.2.202:1234): Connection timed out
2020-05-14T14:34:17.1223441Z 169.254.2.202 (169.254.2.202:1234) open
2020-05-14T14:34:17.1223766Z [dataplane] listener says e89dd7cf-95ef-11ea-b5b2-0242ac110002
2020-05-14T14:34:17.1223861Z
2020-05-14T14:34:17.1223937Z May 14 14:34:17.122: INFO: Connector pod has IP: 10.240.96.2
2020-05-14T14:34:17.1224211Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:34:17.1224494Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:34:17.1224958Z STEP: Verifying TCP connectivity from non-gateway node on "cluster3" to non-gateway node on "cluster2"
2020-05-14T14:34:17.1225390Z STEP: Creating a listener pod in cluster "cluster2", which will wait for a handshake over TCP
2020-05-14T14:34:22.1362978Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster2"
2020-05-14T14:34:27.1986999Z May 14 14:34:27.197: INFO: Will send traffic to IP: 169.254.2.184
2020-05-14T14:34:27.1987741Z STEP: Creating a connector pod in cluster "cluster3", which will attempt the specific UUID handshake over TCP
2020-05-14T14:34:27.2081639Z STEP: Waiting for the listener pod "tcp-check-listenertf5qv" to exit, returning what listener sent
2020-05-14T14:36:27.2141178Z May 14 14:36:27.213: INFO: Pod "tcp-check-listenertf5qv" output:
2020-05-14T14:36:27.2142239Z listening on 0.0.0.0:1234 ...
2020-05-14T14:36:27.2142589Z nc: timeout
2020-05-14T14:36:27.2142718Z
2020-05-14T14:36:27.2143580Z STEP: Waiting for the connector pod "tcp-check-podkk55x" to exit, returning what connector sent
2020-05-14T14:36:37.2207030Z May 14 14:36:37.220: INFO: Pod "tcp-check-podkk55x" output:
2020-05-14T14:36:37.2207269Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2207384Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2207482Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2207598Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2207709Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2207868Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2207980Z nc: 169.254.2.184 (169.254.2.184:1234): Connection timed out
2020-05-14T14:36:37.2208037Z
2020-05-14T14:36:37.2208149Z May 14 14:36:37.220: INFO: Connector pod has IP: 10.240.128.3
2020-05-14T14:36:37.2216368Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-n86qt" on cluster "cluster2"
2020-05-14T14:36:37.2295000Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-n86qt" on cluster "cluster3"
2020-05-14T14:36:37.2361338Z STEP: Deleting namespace "e2e-tests-gateway-redundancy-n86qt" on cluster "cluster1"
2020-05-14T14:36:37.2539770Z
2020-05-14T14:36:37.2547013Z • Failure [225.579 seconds]
2020-05-14T14:36:37.2552073Z [redundancy] Gateway fail-over tests
2020-05-14T14:36:37.2568044Z /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:17
2020-05-14T14:36:37.2568197Z   when a new node is labeled as a gateway node and the label on the existing gateway node is removed
2020-05-14T14:36:37.2568517Z   /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:35
2020-05-14T14:36:37.2568842Z     should start a submariner engine on the new gateway node and be able to connect from another cluster [It]
2020-05-14T14:36:37.2577034Z     /go/src/github.com/submariner-io/submariner/test/e2e/redundancy/gateway_failover.go:36
2020-05-14T14:36:37.2577138Z
2020-05-14T14:36:37.2577353Z     Expected
2020-05-14T14:36:37.2577435Z         <int32>: 1
2020-05-14T14:36:37.2577540Z     to equal
2020-05-14T14:36:37.2577751Z         <int32>: 0
2020-05-14T14:36:37.2577798Z
2020-05-14T14:36:37.2578109Z     /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/network_pods.go:139
2020-05-14T14:36:37.2578348Z ------------------------------
2020-05-14T14:36:37.2578760Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod with HostNetworking connects via TCP to a remote pod when the pod is on a gateway and the remote pod is not on a gateway
2020-05-14T14:36:37.2579056Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:36:37.2579348Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:36:37.2579618Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:36:37.2625069Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-jp6lq" in cluster "cluster2" to execute the tests in
2020-05-14T14:36:37.2625390Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-jp6lq" in cluster "cluster3"
2020-05-14T14:36:37.2858751Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-jp6lq" in cluster "cluster1"
2020-05-14T14:36:37.2919931Z May 14 14:36:37.291: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:36:37.2932029Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-jp6lq" on cluster "cluster2"
2020-05-14T14:36:37.3605317Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-jp6lq" on cluster "cluster3"
2020-05-14T14:36:37.3659124Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-jp6lq" on cluster "cluster1"
2020-05-14T14:36:37.3810989Z
2020-05-14T14:36:37.3811433Z S [SKIPPING] [0.123 seconds]
2020-05-14T14:36:37.3811523Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:36:37.3811816Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:36:37.3811926Z   when a pod with HostNetworking connects via TCP to a remote pod
2020-05-14T14:36:37.3812188Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:78
2020-05-14T14:36:37.3812292Z     when the pod is on a gateway and the remote pod is not on a gateway
2020-05-14T14:36:37.3812550Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:88
2020-05-14T14:36:37.3812782Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:36:37.3813050Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:36:37.3813118Z
2020-05-14T14:36:37.3813325Z       May 14 14:36:37.291: Globalnet enabled, skipping the test...
2020-05-14T14:36:37.3813392Z
2020-05-14T14:36:37.3814462Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:36:37.3814722Z ------------------------------
2020-05-14T14:36:37.3815091Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote pod when the pod is on a gateway and the remote pod is not on a gateway
2020-05-14T14:36:37.3815355Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:36:37.3815625Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:36:37.3815872Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:36:37.3878242Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-c67wf" in cluster "cluster2" to execute the tests in
2020-05-14T14:36:37.3878526Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-c67wf" in cluster "cluster3"
2020-05-14T14:36:37.3915649Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-c67wf" in cluster "cluster1"
2020-05-14T14:36:37.3948562Z May 14 14:36:37.394: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:36:37.3958056Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-c67wf" on cluster "cluster2"
2020-05-14T14:36:37.4888354Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-c67wf" on cluster "cluster3"
2020-05-14T14:36:37.4931300Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-c67wf" on cluster "cluster1"
2020-05-14T14:36:37.4978139Z
2020-05-14T14:36:37.4978531Z S [SKIPPING] [0.117 seconds]
2020-05-14T14:36:37.4978665Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:36:37.4978937Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:36:37.4979214Z   when a pod connects via TCP to a remote pod
2020-05-14T14:36:37.4979642Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:32
2020-05-14T14:36:37.4979745Z     when the pod is on a gateway and the remote pod is not on a gateway
2020-05-14T14:36:37.4980005Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:46
2020-05-14T14:36:37.4980251Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:36:37.4980508Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:36:37.4980560Z
2020-05-14T14:36:37.4980786Z       May 14 14:36:37.394: Globalnet enabled, skipping the test...
2020-05-14T14:36:37.4980844Z
2020-05-14T14:36:37.4981108Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:36:37.4981316Z ------------------------------
2020-05-14T14:36:37.4981653Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod connects via TCP to a remote pod when the pod is on a gateway and the remote pod is on a gateway
2020-05-14T14:36:37.4981893Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:36:37.4982152Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:36:37.4982383Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:36:37.5130174Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-2fdzp" in cluster "cluster2" to execute the tests in
2020-05-14T14:36:37.5130500Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-2fdzp" in cluster "cluster3"
2020-05-14T14:36:37.5333449Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-2fdzp" in cluster "cluster1"
2020-05-14T14:36:37.5410798Z May 14 14:36:37.540: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:36:37.5418379Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-2fdzp" on cluster "cluster2"
2020-05-14T14:36:37.6173673Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-2fdzp" on cluster "cluster3"
2020-05-14T14:36:37.6240032Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-2fdzp" on cluster "cluster1"
2020-05-14T14:36:37.6314298Z
2020-05-14T14:36:37.6315134Z S [SKIPPING] [0.133 seconds]
2020-05-14T14:36:37.6315238Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:36:37.6315560Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:36:37.6322007Z   when a pod connects via TCP to a remote pod
2020-05-14T14:36:37.6322645Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:32
2020-05-14T14:36:37.6328465Z     when the pod is on a gateway and the remote pod is on a gateway
2020-05-14T14:36:37.6328865Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:50
2020-05-14T14:36:37.6334723Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:36:37.6341795Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:36:37.6341867Z
2020-05-14T14:36:37.6342133Z       May 14 14:36:37.540: Globalnet enabled, skipping the test...
2020-05-14T14:36:37.6342207Z
2020-05-14T14:36:37.6342477Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:36:37.6342704Z ------------------------------
2020-05-14T14:36:37.6346558Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery when a pod with HostNetworking connects via TCP to the globalIP of a remote service when the pod is on a gateway and the remote service is not on a gateway
2020-05-14T14:36:37.6351463Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:36:37.6358824Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:36:37.6359159Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:36:37.6447768Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" in cluster "cluster2" to execute the tests in
2020-05-14T14:36:37.6448119Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" in cluster "cluster3"
2020-05-14T14:36:37.6478056Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" in cluster "cluster1"
2020-05-14T14:36:37.6617954Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:36:42.9624769Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:36:48.1685174Z May 14 14:36:48.167: INFO: Will send traffic to IP: 169.254.3.2
2020-05-14T14:36:48.1686050Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:36:48.1767123Z STEP: Waiting for the listener pod "tcp-check-listenerz25t6" to exit, returning what listener sent
2020-05-14T14:36:53.1820653Z May 14 14:36:53.181: INFO: Pod "tcp-check-listenerz25t6" output:
2020-05-14T14:36:53.1820834Z listening on 0.0.0.0:1234 ...
2020-05-14T14:36:53.1820928Z connect to 10.240.128.3:1234 from 10.240.96.0:36249 (10.240.96.0:36249)
2020-05-14T14:36:53.1821170Z [dataplane] connector says 578ba1c7-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:36:53.1821270Z
2020-05-14T14:36:53.1821518Z STEP: Waiting for the connector pod "tcp-check-podxsvcv" to exit, returning what connector sent
2020-05-14T14:36:53.1852903Z May 14 14:36:53.184: INFO: Pod "tcp-check-podxsvcv" output:
2020-05-14T14:36:53.1853004Z 169.254.3.2 (169.254.3.2:1234) open
2020-05-14T14:36:53.1853889Z [dataplane] listener says 51487d9c-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:36:53.1854425Z
2020-05-14T14:36:53.1854522Z May 14 14:36:53.184: INFO: Connector pod has IP: 172.17.0.5
2020-05-14T14:36:53.1854847Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:36:53.1855118Z STEP: Verifying that globalIP annotation does not exist on the connector POD
2020-05-14T14:36:53.1860533Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" on cluster "cluster2"
2020-05-14T14:36:53.1898812Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" on cluster "cluster3"
2020-05-14T14:36:53.1936762Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" on cluster "cluster1"
2020-05-14T14:36:53.7495222Z •
2020-05-14T14:36:53.7501528Z ------------------------------
2020-05-14T14:36:53.7502344Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:36:53.7502745Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" in cluster "cluster2" to execute the tests in
2020-05-14T14:36:53.7503019Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" in cluster "cluster3"
2020-05-14T14:36:53.7503256Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" in cluster "cluster1"
2020-05-14T14:36:53.7503512Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:36:53.7503938Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:36:53.7504149Z May 14 14:36:48.167: INFO: Will send traffic to IP: 169.254.3.2
2020-05-14T14:36:53.7504441Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:36:53.7504703Z STEP: Waiting for the listener pod "tcp-check-listenerz25t6" to exit, returning what listener sent
2020-05-14T14:36:53.7504949Z May 14 14:36:53.181: INFO: Pod "tcp-check-listenerz25t6" output:
2020-05-14T14:36:53.7505042Z listening on 0.0.0.0:1234 ...
2020-05-14T14:36:53.7505133Z connect to 10.240.128.3:1234 from 10.240.96.0:36249 (10.240.96.0:36249)
2020-05-14T14:36:53.7505356Z [dataplane] connector says 578ba1c7-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:36:53.7505424Z
2020-05-14T14:36:53.7505673Z STEP: Waiting for the connector pod "tcp-check-podxsvcv" to exit, returning what connector sent
2020-05-14T14:36:53.7505892Z May 14 14:36:53.184: INFO: Pod "tcp-check-podxsvcv" output:
2020-05-14T14:36:53.7505985Z 169.254.3.2 (169.254.3.2:1234) open
2020-05-14T14:36:53.7506212Z [dataplane] listener says 51487d9c-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:36:53.7506267Z
2020-05-14T14:36:53.7506355Z May 14 14:36:53.184: INFO: Connector pod has IP: 172.17.0.5
2020-05-14T14:36:53.7506625Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:36:53.7506880Z STEP: Verifying that globalIP annotation does not exist on the connector POD
2020-05-14T14:36:53.7507305Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" on cluster "cluster2"
2020-05-14T14:36:53.7507540Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" on cluster "cluster3"
2020-05-14T14:36:53.7507787Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-jq4pz" on cluster "cluster1"
2020-05-14T14:36:53.7507891Z
2020-05-14T14:36:53.7507927Z
2020-05-14T14:36:53.7508307Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery when a pod connects via TCP to the globalIP of a remote service when the pod is on a gateway and the remote service is on a gateway
2020-05-14T14:36:53.7508565Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:36:53.7508830Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:36:53.7509374Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:36:53.7509705Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" in cluster "cluster2" to execute the tests in
2020-05-14T14:36:53.7509955Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" in cluster "cluster3"
2020-05-14T14:36:53.7510211Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" in cluster "cluster1"
2020-05-14T14:36:53.7510471Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:36:59.2831964Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:37:04.3008567Z May 14 14:37:04.300: INFO: Will send traffic to IP: 169.254.3.158
2020-05-14T14:37:04.3009360Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:37:04.3153941Z STEP: Waiting for the listener pod "tcp-check-listenerxfc7l" to exit, returning what listener sent
2020-05-14T14:37:24.3347293Z May 14 14:37:24.328: INFO: Pod "tcp-check-listenerxfc7l" output:
2020-05-14T14:37:24.3347460Z listening on 0.0.0.0:1234 ...
2020-05-14T14:37:24.3347923Z connect to 10.240.96.2:1234 from 169.254.2.81:36817 (169.254.2.81:36817)
2020-05-14T14:37:24.3348244Z [dataplane] connector says 61293ae2-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:24.3348488Z
2020-05-14T14:37:24.3348796Z STEP: Waiting for the connector pod "tcp-check-podvgh77" to exit, returning what connector sent
2020-05-14T14:37:24.3373995Z May 14 14:37:24.331: INFO: Pod "tcp-check-podvgh77" output:
2020-05-14T14:37:24.3374610Z nc: 169.254.3.158 (169.254.3.158:1234): Connection timed out
2020-05-14T14:37:24.3374706Z 169.254.3.158 (169.254.3.158:1234) open
2020-05-14T14:37:24.3375314Z [dataplane] listener says 5a8dd286-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:24.3375371Z
2020-05-14T14:37:24.3375465Z May 14 14:37:24.331: INFO: Connector pod has IP: 10.240.128.2
2020-05-14T14:37:24.3376011Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:37:24.3376345Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:37:24.3376905Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" on cluster "cluster2"
2020-05-14T14:37:24.3464410Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" on cluster "cluster3"
2020-05-14T14:37:24.3523096Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" on cluster "cluster1"
2020-05-14T14:37:24.3554029Z •
2020-05-14T14:37:24.3554714Z ------------------------------
2020-05-14T14:37:24.3555215Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:37:24.3555536Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" in cluster "cluster2" to execute the tests in
2020-05-14T14:37:24.3555854Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" in cluster "cluster3"
2020-05-14T14:37:24.3556141Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" in cluster "cluster1"
2020-05-14T14:37:24.3556440Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:37:24.3557237Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:37:24.3557363Z May 14 14:37:04.300: INFO: Will send traffic to IP: 169.254.3.158
2020-05-14T14:37:24.3557832Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:37:24.3558302Z STEP: Waiting for the listener pod "tcp-check-listenerxfc7l" to exit, returning what listener sent
2020-05-14T14:37:24.3558552Z May 14 14:37:24.328: INFO: Pod "tcp-check-listenerxfc7l" output:
2020-05-14T14:37:24.3558635Z listening on 0.0.0.0:1234 ...
2020-05-14T14:37:24.3559098Z connect to 10.240.96.2:1234 from 169.254.2.81:36817 (169.254.2.81:36817)
2020-05-14T14:37:24.3559393Z [dataplane] connector says 61293ae2-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:24.3559444Z
2020-05-14T14:37:24.3559699Z STEP: Waiting for the connector pod "tcp-check-podvgh77" to exit, returning what connector sent
2020-05-14T14:37:24.3559938Z May 14 14:37:24.331: INFO: Pod "tcp-check-podvgh77" output:
2020-05-14T14:37:24.3560038Z nc: 169.254.3.158 (169.254.3.158:1234): Connection timed out
2020-05-14T14:37:24.3560115Z 169.254.3.158 (169.254.3.158:1234) open
2020-05-14T14:37:24.3560351Z [dataplane] listener says 5a8dd286-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:24.3560514Z
2020-05-14T14:37:24.3560589Z May 14 14:37:24.331: INFO: Connector pod has IP: 10.240.128.2
2020-05-14T14:37:24.3560884Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:37:24.3561387Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:37:24.3561690Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" on cluster "cluster2"
2020-05-14T14:37:24.3561950Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" on cluster "cluster3"
2020-05-14T14:37:24.3562193Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c2pxs" on cluster "cluster1"
2020-05-14T14:37:24.3562264Z
2020-05-14T14:37:24.3562303Z
2020-05-14T14:37:24.3562685Z [dataplane] Basic TCP connectivity tests across clusters without discovery when a pod with HostNetworking connects via TCP to a remote pod when the pod is not on a gateway and the remote pod is not on a gateway
2020-05-14T14:37:24.3562965Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:37:24.3563239Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:37:24.3563486Z STEP: Creating namespace objects with basename "dataplane-conn-nd"
2020-05-14T14:37:24.3576490Z STEP: Generated namespace "e2e-tests-dataplane-conn-nd-gsd8t" in cluster "cluster2" to execute the tests in
2020-05-14T14:37:24.3577036Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-gsd8t" in cluster "cluster3"
2020-05-14T14:37:24.3680170Z STEP: Creating namespace "e2e-tests-dataplane-conn-nd-gsd8t" in cluster "cluster1"
2020-05-14T14:37:24.3779657Z May 14 14:37:24.377: INFO: Globalnet enabled, skipping the test...
2020-05-14T14:37:24.3787538Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-gsd8t" on cluster "cluster2"
2020-05-14T14:37:24.4262818Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-gsd8t" on cluster "cluster3"
2020-05-14T14:37:24.4353479Z STEP: Deleting namespace "e2e-tests-dataplane-conn-nd-gsd8t" on cluster "cluster1"
2020-05-14T14:37:24.4418794Z
2020-05-14T14:37:24.4419288Z S [SKIPPING] [0.088 seconds]
2020-05-14T14:37:24.4419422Z [dataplane] Basic TCP connectivity tests across clusters without discovery
2020-05-14T14:37:24.4419994Z /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:9
2020-05-14T14:37:24.4421033Z   when a pod with HostNetworking connects via TCP to a remote pod
2020-05-14T14:37:24.4422754Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:78
2020-05-14T14:37:24.4422908Z     when the pod is not on a gateway and the remote pod is not on a gateway
2020-05-14T14:37:24.4423257Z     /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:84
2020-05-14T14:37:24.4423842Z       should have sent the expected data from the pod to the other pod [It]
2020-05-14T14:37:24.4424381Z       /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_pod_connectivity.go:15
2020-05-14T14:37:24.4424445Z
2020-05-14T14:37:24.4425219Z       May 14 14:37:24.377: Globalnet enabled, skipping the test...
2020-05-14T14:37:24.4425429Z
2020-05-14T14:37:24.4425829Z       /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/logging.go:42
2020-05-14T14:37:24.4426068Z ------------------------------
2020-05-14T14:37:24.4426548Z P [PENDING]
2020-05-14T14:37:24.4426760Z [expansion] Test expanding/shrinking an existing cluster fleet
2020-05-14T14:37:24.4427092Z /go/src/github.com/submariner-io/submariner/test/e2e/cluster/add_remove_cluster.go:12
2020-05-14T14:37:24.4427184Z   Should be able to add and remove third cluster
2020-05-14T14:37:24.4427762Z   /go/src/github.com/submariner-io/submariner/test/e2e/cluster/add_remove_cluster.go:15
2020-05-14T14:37:24.4428157Z ------------------------------
2020-05-14T14:37:24.4428639Z [dataplane-globalnet] Basic TCP connectivity tests across overlapping clusters without discovery when a pod connects via TCP to the globalIP of a remote service when the pod is not on a gateway and the remote service is not on a gateway
2020-05-14T14:37:24.4429072Z   should have sent the expected data from the pod to the other pod
2020-05-14T14:37:24.4429549Z   /go/src/github.com/submariner-io/submariner/test/e2e/dataplane/tcp_gn_pod_connectivity.go:15
2020-05-14T14:37:24.4430107Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:37:24.4493562Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" in cluster "cluster2" to execute the tests in
2020-05-14T14:37:24.4494042Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" in cluster "cluster3"
2020-05-14T14:37:24.4709300Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" in cluster "cluster1"
2020-05-14T14:37:24.4752831Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:37:29.7111341Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:37:34.7628630Z May 14 14:37:34.762: INFO: Will send traffic to IP: 169.254.3.165
2020-05-14T14:37:34.7629647Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:37:34.7704736Z STEP: Waiting for the listener pod "tcp-check-listenerx62t8" to exit, returning what listener sent
2020-05-14T14:37:54.7794792Z May 14 14:37:54.778: INFO: Pod "tcp-check-listenerx62t8" output:
2020-05-14T14:37:54.7794981Z listening on 0.0.0.0:1234 ...
2020-05-14T14:37:54.7795081Z connect to 10.240.128.3:1234 from 169.254.2.35:36889 (169.254.2.35:36889)
2020-05-14T14:37:54.7795526Z [dataplane] connector says 735164a6-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:54.7795605Z
2020-05-14T14:37:54.7796028Z STEP: Waiting for the connector pod "tcp-check-podxvds8" to exit, returning what connector sent
2020-05-14T14:37:55.7800906Z make: *** [/opt/shipyard/Makefile.inc:19: e2e] Error 1
2020-05-14T14:37:55.7801816Z [submariner]$ make e2e
2020-05-14T14:37:55.7802066Z May 14 14:37:54.785: INFO: Pod "tcp-check-podxvds8" output:
2020-05-14T14:37:55.7802173Z nc: 169.254.3.165 (169.254.3.165:1234): Connection timed out
2020-05-14T14:37:55.7802272Z 169.254.3.165 (169.254.3.165:1234) open
2020-05-14T14:37:55.7802683Z [dataplane] listener says 6d2fa735-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:55.7802731Z
2020-05-14T14:37:55.7802819Z May 14 14:37:54.785: INFO: Connector pod has IP: 10.240.0.4
2020-05-14T14:37:55.7803152Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:37:55.7803427Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:37:55.7803687Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" on cluster "cluster2"
2020-05-14T14:37:55.7803945Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" on cluster "cluster3"
2020-05-14T14:37:55.7804625Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" on cluster "cluster1"
2020-05-14T14:37:55.7807380Z •
2020-05-14T14:37:55.7807720Z ------------------------------
2020-05-14T14:37:55.7807975Z STEP: Creating namespace objects with basename "dataplane-gn-conn-nd"
2020-05-14T14:37:55.7808422Z STEP: Generated namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" in cluster "cluster2" to execute the tests in
2020-05-14T14:37:55.7810541Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" in cluster "cluster3"
2020-05-14T14:37:55.7811434Z STEP: Creating namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" in cluster "cluster1"
2020-05-14T14:37:55.7815912Z STEP: Creating a listener pod in cluster "cluster3", which will wait for a handshake over TCP
2020-05-14T14:37:55.7816278Z STEP: Pointing a service ClusterIP to the listener pod in cluster "cluster3"
2020-05-14T14:37:55.7816404Z May 14 14:37:34.762: INFO: Will send traffic to IP: 169.254.3.165
2020-05-14T14:37:55.7836062Z STEP: Creating a connector pod in cluster "cluster2", which will attempt the specific UUID handshake over TCP
2020-05-14T14:37:55.7837542Z STEP: Waiting for the listener pod "tcp-check-listenerx62t8" to exit, returning what listener sent
2020-05-14T14:37:55.7837811Z May 14 14:37:54.778: INFO: Pod "tcp-check-listenerx62t8" output:
2020-05-14T14:37:55.7837908Z listening on 0.0.0.0:1234 ...
2020-05-14T14:37:55.7838287Z connect to 10.240.128.3:1234 from 169.254.2.35:36889 (169.254.2.35:36889)
2020-05-14T14:37:55.7838552Z [dataplane] connector says 735164a6-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:55.7838614Z
2020-05-14T14:37:55.7838866Z STEP: Waiting for the connector pod "tcp-check-podxvds8" to exit, returning what connector sent
2020-05-14T14:37:55.7839387Z May 14 14:37:54.785: INFO: Pod "tcp-check-podxvds8" output:
2020-05-14T14:37:55.7839479Z nc: 169.254.3.165 (169.254.3.165:1234): Connection timed out
2020-05-14T14:37:55.7839575Z 169.254.3.165 (169.254.3.165:1234) open
2020-05-14T14:37:55.7840580Z [dataplane] listener says 6d2fa735-95f0-11ea-b5b2-0242ac110002
2020-05-14T14:37:55.7840654Z
2020-05-14T14:37:55.7844177Z May 14 14:37:54.785: INFO: Connector pod has IP: 10.240.0.4
2020-05-14T14:37:55.7844904Z STEP: Verifying that the listener got the connector's data and the connector got the listener's data
2020-05-14T14:37:55.7845187Z STEP: Verifying the output of listener pod which must contain the globalIP of the connector POD
2020-05-14T14:37:55.7845431Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" on cluster "cluster2"
2020-05-14T14:37:55.7845705Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" on cluster "cluster3"
2020-05-14T14:37:55.7846137Z STEP: Deleting namespace "e2e-tests-dataplane-gn-conn-nd-c26lp" on cluster "cluster1"
2020-05-14T14:37:55.7860990Z
2020-05-14T14:37:55.7861233Z
2020-05-14T14:37:55.7861753Z JUnit path was configured: /go/src/github.com/submariner-io/submariner/output/e2e-junit.xml
2020-05-14T14:37:55.7861829Z
2020-05-14T14:37:55.7862140Z JUnit report was created: /go/src/github.com/submariner-io/submariner/output/e2e-junit.xml
2020-05-14T14:37:55.7862212Z
2020-05-14T14:37:55.7862274Z
2020-05-14T14:37:55.7862654Z Summarizing 1 Failure:
2020-05-14T14:37:55.7862716Z
2020-05-14T14:37:55.7863785Z [Fail] [redundancy] Gateway fail-over tests when a new node is labeled as a gateway node and the label on the existing gateway node is removed [It] should start a submariner engine on the new gateway node and be able to connect from another cluster 
2020-05-14T14:37:55.7864480Z /go/src/github.com/submariner-io/submariner/vendor/github.com/submariner-io/shipyard/test/e2e/framework/network_pods.go:139
2020-05-14T14:37:55.7864542Z
2020-05-14T14:37:55.7864920Z Ran 9 of 20 Specs in 501.402 seconds
2020-05-14T14:37:55.7865354Z FAIL! -- 8 Passed | 1 Failed | 1 Pending | 10 Skipped
2020-05-14T14:37:55.7865603Z --- FAIL: TestE2E (501.40s)
2020-05-14T14:37:55.7865698Z FAIL
2020-05-14T14:37:55.7865782Z exit status 1
2020-05-14T14:37:55.7866006Z FAIL	github.com/submariner-io/submariner/test/e2e	501.419s
2020-05-14T14:37:57.2391891Z time="2020-05-14T14:37:57Z" level=fatal msg="exit status 2"
2020-05-14T14:37:57.2407100Z make: *** [e2e] Error 1
2020-05-14T14:37:57.2409046Z Makefile.dapper:14: recipe for target 'e2e' failed
2020-05-14T14:37:57.2464596Z ##[error]Process completed with exit code 2.
2020-05-14T14:37:57.2607579Z ##[group]Run make post-mortem
2020-05-14T14:37:57.2607796Z make post-mortem
2020-05-14T14:37:57.3825675Z shell: /bin/bash -e {0}
2020-05-14T14:37:57.3825764Z ##[endgroup]
2020-05-14T14:37:57.4058154Z ./.dapper -m bind make post-mortem
2020-05-14T14:38:00.7360416Z Sending build context to Docker daemon  86.34MB
2020-05-14T14:38:00.7361092Z
2020-05-14T14:38:00.7428581Z Step 1/6 : FROM quay.io/submariner/shipyard-dapper-base
2020-05-14T14:38:00.7461874Z  ---> dca8fb2c3920
2020-05-14T14:38:00.7464105Z Step 2/6 : ENV DAPPER_ENV="REPO TAG QUAY_USERNAME QUAY_PASSWORD TRAVIS_COMMIT CLUSTERS_ARGS DEPLOY_ARGS"     DAPPER_SOURCE=/go/src/github.com/submariner-io/submariner DAPPER_DOCKER_SOCKET=true
2020-05-14T14:38:00.7480093Z  ---> Using cache
2020-05-14T14:38:00.7481053Z  ---> 63c111abead4
2020-05-14T14:38:00.7482518Z Step 3/6 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2020-05-14T14:38:00.7502027Z  ---> Using cache
2020-05-14T14:38:00.7503002Z  ---> 752538f50c80
2020-05-14T14:38:00.7505511Z Step 4/6 : WORKDIR ${DAPPER_SOURCE}
2020-05-14T14:38:00.7533100Z  ---> Using cache
2020-05-14T14:38:00.7533383Z  ---> 7c4c5ee2082e
2020-05-14T14:38:00.7535576Z Step 5/6 : ENTRYPOINT ["./scripts/entry"]
2020-05-14T14:38:00.7551859Z  ---> Using cache
2020-05-14T14:38:00.7554797Z  ---> a7627ac4ff19
2020-05-14T14:38:00.7557311Z Step 6/6 : CMD ["ci"]
2020-05-14T14:38:00.7581090Z  ---> Using cache
2020-05-14T14:38:00.7583088Z  ---> 3b9740910acd
2020-05-14T14:38:00.8886234Z Successfully built 3b9740910acd
2020-05-14T14:38:00.8949201Z Successfully tagged submariner:HEAD
2020-05-14T14:38:01.6372607Z [submariner]$ trap chown -R 1001:116 . exit
2020-05-14T14:38:01.6382042Z [submariner]$ mkdir -p bin dist output
2020-05-14T14:38:01.6672329Z [submariner]$ make post-mortem
2020-05-14T14:38:01.7113301Z Makefile:27: warning: overriding recipe for target 'vendor/modules.txt'
2020-05-14T14:38:01.7113935Z /opt/shipyard/Makefile.inc:30: warning: ignoring old recipe for target 'vendor/modules.txt'
2020-05-14T14:38:01.7120562Z /opt/shipyard/scripts/post_mortem.sh
2020-05-14T14:38:01.7184937Z [submariner]$ source /opt/shipyard/scripts/lib/utils
2020-05-14T14:38:01.7198383Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:38:01.7212639Z [submariner]$ script_name=utils
2020-05-14T14:38:01.7221924Z [submariner]$ exec_name=post_mortem.sh
2020-05-14T14:38:01.7240163Z [submariner]$ source /opt/shipyard/scripts/lib/cluster_settings
2020-05-14T14:38:01.7254202Z [submariner]$ . /opt/shipyard/scripts/lib/source_only
2020-05-14T14:38:01.7267943Z [submariner]$ script_name=cluster_settings
2020-05-14T14:38:01.7282441Z [submariner]$ exec_name=post_mortem.sh
2020-05-14T14:38:01.7302321Z [submariner]$ broker=cluster1
2020-05-14T14:38:01.7312210Z [submariner]$ declare -gA cluster_nodes
2020-05-14T14:38:01.7326786Z [submariner]$ cluster_nodes[cluster1]=control-plane worker
2020-05-14T14:38:01.7336124Z [submariner]$ cluster_nodes[cluster2]=control-plane worker
2020-05-14T14:38:01.7347398Z [submariner]$ cluster_nodes[cluster3]=control-plane worker worker
2020-05-14T14:38:01.7355413Z [submariner]$ declare -gA cluster_subm
2020-05-14T14:38:01.7369129Z [submariner]$ cluster_subm[cluster1]=true
2020-05-14T14:38:01.7382710Z [submariner]$ cluster_subm[cluster2]=true
2020-05-14T14:38:01.7406379Z [submariner]$ cluster_subm[cluster3]=true
2020-05-14T14:38:01.7406853Z [submariner]$ declare -gA cluster_cni
2020-05-14T14:38:01.7415827Z [submariner]$ cluster_cni[cluster2]=weave
2020-05-14T14:38:01.7425313Z [submariner]$ cluster_cni[cluster3]=weave
2020-05-14T14:38:01.7437609Z [submariner]$ declare_kubeconfig
2020-05-14T14:38:01.7446794Z [submariner]$ declare_kubeconfig
2020-05-14T14:38:01.7455674Z [submariner]$ source /opt/shipyard/scripts/lib/kubecfg
2020-05-14T14:38:01.7470001Z [submariner]$ export KUBECONFIG
2020-05-14T14:38:01.7519642Z [submariner]$ KUBECONFIG=/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster2:/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster1:/go/src/github.com/submariner-io/submariner/output/kubeconfigs/kind-config-cluster3:
2020-05-14T14:38:01.7544102Z [submariner]$ find /go/src/github.com/submariner-io/submariner/output/kubeconfigs -type f -printf %p:
2020-05-14T14:38:01.7573402Z [submariner]$ run_sequential cluster1 cluster2 cluster3 post_analyze
2020-05-14T14:38:01.7583025Z [submariner]$ run_sequential cluster1 cluster2 cluster3 post_analyze
2020-05-14T14:38:01.7594619Z [submariner]$ local cmnd=post_analyze
2020-05-14T14:38:01.7606938Z [submariner]$ eval echo cluster1 cluster2 cluster3
2020-05-14T14:38:01.7622647Z [submariner]$ [cluster1] post_analyze
2020-05-14T14:38:01.7635244Z [submariner]$ [cluster1] sed s/^/[cluster1] /
2020-05-14T14:38:01.7648322Z [submariner]$ [cluster1] post_analyze
2020-05-14T14:38:01.7660678Z [submariner]$ [cluster1] kubectl get all -A
2020-05-14T14:38:01.7673891Z [submariner]$ [cluster1] kubectl get all -A
2020-05-14T14:38:01.7688834Z [submariner]$ [cluster1] command kubectl --context=cluster1 get all -A
2020-05-14T14:38:01.7699153Z [submariner]$ [cluster1] kubectl --context=cluster1 get all -A
2020-05-14T14:38:02.7196339Z
2020-05-14T14:38:02.7201286Z
2020-05-14T14:38:02.7208305Z
2020-05-14T14:38:02.7223875Z
2020-05-14T14:38:02.7228249Z
2020-05-14T14:38:02.7235440Z
2020-05-14T14:38:02.7238862Z
2020-05-14T14:38:02.7241874Z
2020-05-14T14:38:02.7244490Z
2020-05-14T14:38:02.7400347Z [submariner]$ [cluster1] kubectl get pods -A
2020-05-14T14:38:02.7411340Z [submariner]$ [cluster1] tail -n +2
2020-05-14T14:38:02.7424054Z [submariner]$ [cluster1] grep -v Running
2020-05-14T14:38:02.7436452Z [submariner]$ [cluster1] kubectl get pods -A
2020-05-14T14:38:02.7448841Z [submariner]$ [cluster1] sed s/  */;/g
2020-05-14T14:38:02.7463480Z [submariner]$ [cluster1] command kubectl --context=cluster1 get pods -A
2020-05-14T14:38:02.7474796Z [submariner]$ [cluster1] kubectl --context=cluster1 get pods -A
2020-05-14T14:38:03.5103003Z [cluster1] ======================= Post mortem cluster1 =======================
2020-05-14T14:38:03.5103433Z [cluster1] NAMESPACE             NAME                                                 READY   STATUS    RESTARTS   AGE
2020-05-14T14:38:03.5104188Z [cluster1] kube-system           pod/coredns-584795fc57-77jjs                         1/1     Running   0          12m
2020-05-14T14:38:03.5104504Z [cluster1] kube-system           pod/coredns-584795fc57-nttrh                         1/1     Running   0          12m
2020-05-14T14:38:03.5105072Z [cluster1] kube-system           pod/etcd-cluster1-control-plane                      1/1     Running   0          12m
2020-05-14T14:38:03.5105398Z [cluster1] kube-system           pod/kindnet-2xp7z                                    1/1     Running   1          12m
2020-05-14T14:38:03.5105877Z [cluster1] kube-system           pod/kindnet-sb9gc                                    1/1     Running   1          12m
2020-05-14T14:38:03.5106189Z [cluster1] kube-system           pod/kube-apiserver-cluster1-control-plane            1/1     Running   0          12m
2020-05-14T14:38:03.5106646Z [cluster1] kube-system           pod/kube-controller-manager-cluster1-control-plane   1/1     Running   0          12m
2020-05-14T14:38:03.5106937Z [cluster1] kube-system           pod/kube-proxy-6rp5w                                 1/1     Running   0          12m
2020-05-14T14:38:03.5107231Z [cluster1] kube-system           pod/kube-proxy-7mnn4                                 1/1     Running   0          12m
2020-05-14T14:38:03.5107505Z [cluster1] kube-system           pod/kube-scheduler-cluster1-control-plane            1/1     Running   0          12m
2020-05-14T14:38:03.5108367Z [cluster1] submariner-operator   pod/submariner-operator-bb77879b9-dzmrq              1/1     Running   0          10m
2020-05-14T14:38:03.5109111Z [cluster1] submariner-operator   pod/submariner-routeagent-rl4cm                      1/1     Running   0          10m
2020-05-14T14:38:03.5109420Z [cluster1] NAMESPACE             NAME                                  TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)                  AGE
2020-05-14T14:38:03.5109541Z [cluster1] default               service/kubernetes                    ClusterIP   100.90.0.1     <none>        443/TCP                  13m
2020-05-14T14:38:03.5109852Z [cluster1] kube-system           service/kube-dns                      ClusterIP   100.90.0.10    <none>        53/UDP,53/TCP,9153/TCP   13m
2020-05-14T14:38:03.5110148Z [cluster1] submariner-operator   service/submariner-operator-metrics   ClusterIP   100.90.46.84   <none>        8383/TCP,8686/TCP        10m
2020-05-14T14:38:03.5110472Z [cluster1] NAMESPACE             NAME                                   DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR                AGE
2020-05-14T14:38:03.5110803Z [cluster1] kube-system           daemonset.apps/kindnet                 2         2         2       2            2           <none>                       13m
2020-05-14T14:38:03.5111120Z [cluster1] kube-system           daemonset.apps/kube-proxy              2         2         2       2            2           <none>                       13m
2020-05-14T14:38:03.5111438Z [cluster1] submariner-operator   daemonset.apps/submariner-gateway      0         0         0       0            0           submariner.io/gateway=true   10m
2020-05-14T14:38:03.5111751Z [cluster1] submariner-operator   daemonset.apps/submariner-globalnet    0         0         0       0            0           submariner.io/gateway=true   10m
2020-05-14T14:38:03.5112072Z [cluster1] submariner-operator   daemonset.apps/submariner-routeagent   1         1         1       1            1           <none>                       10m
2020-05-14T14:38:03.5112503Z [cluster1] NAMESPACE             NAME                                  READY   UP-TO-DATE   AVAILABLE   AGE
2020-05-14T14:38:03.5112948Z [cluster1] kube-system           deployment.apps/coredns               2/2     2            2           13m
2020-05-14T14:38:03.5113369Z [cluster1] submariner-operator   deployment.apps/submariner-operator   1/1     1            1           10m
2020-05-14T14:38:03.5113479Z [cluster1] NAMESPACE             NAME                                            DESIRED   CURRENT   READY   AGE
2020-05-14T14:38:03.5113751Z [cluster1] kube-system           replicaset.apps/coredns-584795fc57              2         2         2       12m
2020-05-14T14:38:03.5114005Z [cluster1] submariner-operator   replicaset.apps/submariner-operator-bb77879b9   1         1         1       10m
2020-05-14T14:38:03.5114104Z [cluster1] ===================== END Post mortem cluster1 =====================
2020-05-14T14:38:03.5130653Z [submariner]$ [cluster2] post_analyze
2020-05-14T14:38:03.5142676Z [submariner]$ [cluster2] sed s/^/[cluster2] /
2020-05-14T14:38:03.5146607Z [submariner]$ [cluster2] post_analyze
2020-05-14T14:38:03.5159175Z [submariner]$ [cluster2] kubectl get all -A
2020-05-14T14:38:03.5174337Z [submariner]$ [cluster2] kubectl get all -A
2020-05-14T14:38:03.5185391Z [submariner]$ [cluster2] command kubectl --context=cluster2 get all -A
2020-05-14T14:38:03.5199212Z [submariner]$ [cluster2] kubectl --context=cluster2 get all -A
2020-05-14T14:38:04.3779339Z
2020-05-14T14:38:04.3779939Z
2020-05-14T14:38:04.3784399Z
2020-05-14T14:38:04.3794214Z
2020-05-14T14:38:04.3801584Z
2020-05-14T14:38:04.3805434Z
2020-05-14T14:38:04.3807425Z
2020-05-14T14:38:04.3810555Z
2020-05-14T14:38:04.3813242Z
2020-05-14T14:38:04.3824123Z [cluster2] ======================= Post mortem cluster2 =======================
2020-05-14T14:38:04.3824677Z [cluster2] NAMESPACE             NAME                                                 READY   STATUS    RESTARTS   AGE
2020-05-14T14:38:04.3826127Z [cluster2] kube-system           pod/coredns-584795fc57-2wn4r                         1/1     Running   0          13m
2020-05-14T14:38:04.3826574Z [cluster2] kube-system           pod/coredns-584795fc57-8kcdr                         1/1     Running   0          13m
2020-05-14T14:38:04.3826918Z [cluster2] kube-system           pod/etcd-cluster2-control-plane                      1/1     Running   0          12m
2020-05-14T14:38:04.3827252Z [cluster2] kube-system           pod/kube-apiserver-cluster2-control-plane            1/1     Running   0          13m
2020-05-14T14:38:04.3827732Z [cluster2] kube-system           pod/kube-controller-manager-cluster2-control-plane   1/1     Running   0          12m
2020-05-14T14:38:04.3828400Z [cluster2] kube-system           pod/kube-proxy-4256p                                 1/1     Running   0          13m
2020-05-14T14:38:04.3829046Z [cluster2] kube-system           pod/kube-proxy-5f4fg                                 1/1     Running   0          13m
2020-05-14T14:38:04.3829338Z [cluster2] kube-system           pod/kube-proxy-w5dbg                                 1/1     Running   0          13m
2020-05-14T14:38:04.3829637Z [cluster2] kube-system           pod/kube-scheduler-cluster2-control-plane            1/1     Running   0          12m
2020-05-14T14:38:04.3829931Z [cluster2] kube-system           pod/weave-net-jj8td                                  2/2     Running   0          12m
2020-05-14T14:38:04.3830219Z [cluster2] kube-system           pod/weave-net-l6rkq                                  2/2     Running   0          12m
2020-05-14T14:38:04.3830509Z [cluster2] kube-system           pod/weave-net-z2ctm                                  2/2     Running   0          12m
2020-05-14T14:38:04.3830791Z [cluster2] submariner-operator   pod/submariner-gateway-9hbsr                         1/1     Running   0          5m13s
2020-05-14T14:38:04.3831103Z [cluster2] submariner-operator   pod/submariner-globalnet-8tbv9                       1/1     Running   0          5m13s
2020-05-14T14:38:04.3831414Z [cluster2] submariner-operator   pod/submariner-operator-bb77879b9-7f8vx              1/1     Running   0          10m
2020-05-14T14:38:04.3831708Z [cluster2] submariner-operator   pod/submariner-routeagent-pjdsb                      1/1     Running   0          10m
2020-05-14T14:38:04.3831996Z [cluster2] submariner-operator   pod/submariner-routeagent-vpgkx                      1/1     Running   0          10m
2020-05-14T14:38:04.3832314Z [cluster2] NAMESPACE             NAME                                  TYPE        CLUSTER-IP     EXTERNAL-IP   PORT(S)                  AGE
2020-05-14T14:38:04.3832426Z [cluster2] default               service/kubernetes                    ClusterIP   100.90.0.1     <none>        443/TCP                  13m
2020-05-14T14:38:04.3832756Z [cluster2] kube-system           service/kube-dns                      ClusterIP   100.90.0.10    <none>        53/UDP,53/TCP,9153/TCP   13m
2020-05-14T14:38:04.3833091Z [cluster2] submariner-operator   service/submariner-operator-metrics   ClusterIP   100.90.47.72   <none>        8383/TCP,8686/TCP        10m
2020-05-14T14:38:04.3833429Z [cluster2] NAMESPACE             NAME                                   DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR                AGE
2020-05-14T14:38:04.3833886Z [cluster2] kube-system           daemonset.apps/kube-proxy              3         3         3       3            3           <none>                       13m
2020-05-14T14:38:04.3834226Z [cluster2] kube-system           daemonset.apps/weave-net               3         3         3       3            1           <none>                       12m
2020-05-14T14:38:04.3834623Z [cluster2] submariner-operator   daemonset.apps/submariner-gateway      1         1         1       1            1           submariner.io/gateway=true   10m
2020-05-14T14:38:04.3835119Z [cluster2] submariner-operator   daemonset.apps/submariner-globalnet    1         1         1       1            1           submariner.io/gateway=true   10m
2020-05-14T14:38:04.3835575Z [cluster2] submariner-operator   daemonset.apps/submariner-routeagent   2         2         2       2            2           <none>                       10m
2020-05-14T14:38:04.3836105Z [cluster2] NAMESPACE             NAME                                  READY   UP-TO-DATE   AVAILABLE   AGE
2020-05-14T14:38:04.3836397Z [cluster2] kube-system           deployment.apps/coredns               2/2     2            2           13m
2020-05-14T14:38:04.3837160Z [cluster2] submariner-operator   deployment.apps/submariner-operator   1/1     1            1           10m
2020-05-14T14:38:04.3939215Z [submariner]$ [cluster2] kubectl get pods -A
2020-05-14T14:38:04.3953607Z [submariner]$ [cluster2] tail -n +2
2020-05-14T14:38:04.3953927Z [submariner]$ [cluster2] kubectl get pods -A
2020-05-14T14:38:04.3964938Z [submariner]$ [cluster2] command kubectl --context=cluster2 get pods -A
2020-05-14T14:38:04.3971069Z [submariner]$ [cluster2] grep -v Running
2020-05-14T14:38:04.3974298Z [submariner]$ [cluster2] kubectl --context=cluster2 get pods -A
2020-05-14T14:38:04.3996889Z [submariner]$ [cluster2] sed s/  */;/g
2020-05-14T14:38:05.1296430Z [cluster2] NAMESPACE             NAME                                            DESIRED   CURRENT   READY   AGE
2020-05-14T14:38:05.1297945Z [cluster2] kube-system           replicaset.apps/coredns-584795fc57              2         2         2       13m
2020-05-14T14:38:05.1298734Z [cluster2] submariner-operator   replicaset.apps/submariner-operator-bb77879b9   1         1         1       10m
2020-05-14T14:38:05.1299191Z [cluster2] ===================== END Post mortem cluster2 =====================
2020-05-14T14:38:05.1312330Z [submariner]$ [cluster3] post_analyze
2020-05-14T14:38:05.1323491Z [submariner]$ [cluster3] sed s/^/[cluster3] /
2020-05-14T14:38:05.1336232Z [submariner]$ [cluster3] post_analyze
2020-05-14T14:38:05.1350053Z [submariner]$ [cluster3] kubectl get all -A
2020-05-14T14:38:05.1359661Z [submariner]$ [cluster3] kubectl get all -A
2020-05-14T14:38:05.1369277Z [submariner]$ [cluster3] command kubectl --context=cluster3 get all -A
2020-05-14T14:38:05.1377945Z [submariner]$ [cluster3] kubectl --context=cluster3 get all -A
2020-05-14T14:38:05.9564527Z
2020-05-14T14:38:05.9570288Z
2020-05-14T14:38:05.9570360Z
2020-05-14T14:38:05.9589253Z
2020-05-14T14:38:05.9589356Z
2020-05-14T14:38:05.9589397Z
2020-05-14T14:38:05.9589455Z
2020-05-14T14:38:05.9589493Z
2020-05-14T14:38:05.9589531Z
2020-05-14T14:38:05.9596039Z [cluster3] ======================= Post mortem cluster3 =======================
2020-05-14T14:38:05.9596338Z [cluster3] NAMESPACE             NAME                                                 READY   STATUS    RESTARTS   AGE
2020-05-14T14:38:05.9599008Z [cluster3] kube-system           pod/coredns-584795fc57-pxbtx                         1/1     Running   0          12m
2020-05-14T14:38:05.9599530Z [cluster3] kube-system           pod/coredns-584795fc57-qnftb                         1/1     Running   0          12m
2020-05-14T14:38:05.9599981Z [cluster3] kube-system           pod/etcd-cluster3-control-plane                      1/1     Running   0          12m
2020-05-14T14:38:05.9600253Z [cluster3] kube-system           pod/kube-apiserver-cluster3-control-plane            1/1     Running   0          12m
2020-05-14T14:38:05.9600545Z [cluster3] kube-system           pod/kube-controller-manager-cluster3-control-plane   1/1     Running   0          12m
2020-05-14T14:38:05.9600993Z [cluster3] kube-system           pod/kube-proxy-9qv5d                                 1/1     Running   0          12m
2020-05-14T14:38:05.9601270Z [cluster3] kube-system           pod/kube-proxy-h26g7                                 1/1     Running   0          12m
2020-05-14T14:38:05.9601730Z [cluster3] kube-system           pod/kube-proxy-j6pm6                                 1/1     Running   0          12m
2020-05-14T14:38:05.9602129Z [cluster3] kube-system           pod/kube-scheduler-cluster3-control-plane            1/1     Running   0          12m
2020-05-14T14:38:05.9602408Z [cluster3] kube-system           pod/weave-net-4d26q                                  2/2     Running   0          12m
2020-05-14T14:38:05.9602688Z [cluster3] kube-system           pod/weave-net-8jpct                                  2/2     Running   0          12m
2020-05-14T14:38:05.9602962Z [cluster3] kube-system           pod/weave-net-zcdms                                  2/2     Running   0          12m
2020-05-14T14:38:05.9603237Z [cluster3] submariner-operator   pod/submariner-gateway-rwgdj                         1/1     Running   1          10m
2020-05-14T14:38:05.9603518Z [cluster3] submariner-operator   pod/submariner-globalnet-krmbg                       1/1     Running   0          10m
2020-05-14T14:38:05.9603793Z [cluster3] submariner-operator   pod/submariner-operator-bb77879b9-6mflk              1/1     Running   0          10m
2020-05-14T14:38:05.9604084Z [cluster3] submariner-operator   pod/submariner-routeagent-jdwkw                      1/1     Running   0          10m
2020-05-14T14:38:05.9604360Z [cluster3] submariner-operator   pod/submariner-routeagent-kjqxm                      1/1     Running   0          10m
2020-05-14T14:38:05.9604659Z [cluster3] NAMESPACE             NAME                                  TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                  AGE
2020-05-14T14:38:05.9604779Z [cluster3] default               service/kubernetes                    ClusterIP   100.90.0.1       <none>        443/TCP                  13m
2020-05-14T14:38:05.9605073Z [cluster3] kube-system           service/kube-dns                      ClusterIP   100.90.0.10      <none>        53/UDP,53/TCP,9153/TCP   13m
2020-05-14T14:38:05.9605575Z [cluster3] submariner-operator   service/submariner-operator-metrics   ClusterIP   100.90.204.212   <none>        8383/TCP,8686/TCP        10m
2020-05-14T14:38:05.9605910Z [cluster3] NAMESPACE             NAME                                   DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR                AGE
2020-05-14T14:38:05.9606239Z [cluster3] kube-system           daemonset.apps/kube-proxy              3         3         3       3            3           <none>                       13m
2020-05-14T14:38:05.9606575Z [cluster3] kube-system           daemonset.apps/weave-net               3         3         3       3            3           <none>                       12m
2020-05-14T14:38:05.9606906Z [cluster3] submariner-operator   daemonset.apps/submariner-gateway      1         1         1       1            1           submariner.io/gateway=true   10m
2020-05-14T14:38:05.9607631Z [cluster3] submariner-operator   daemonset.apps/submariner-globalnet    1         1         1       1            1           submariner.io/gateway=true   10m
2020-05-14T14:38:05.9607950Z [cluster3] submariner-operator   daemonset.apps/submariner-routeagent   2         2         2       2            2           <none>                       10m
2020-05-14T14:38:05.9608249Z [cluster3] NAMESPACE             NAME                                  READY   UP-TO-DATE   AVAILABLE   AGE
2020-05-14T14:38:05.9608528Z [cluster3] kube-system           deployment.apps/coredns               2/2     2            2           13m
2020-05-14T14:38:05.9608805Z [cluster3] submariner-operator   deployment.apps/submariner-operator   1/1     1            1           10m
2020-05-14T14:38:05.9714778Z [submariner]$ [cluster3] kubectl get pods -A
2020-05-14T14:38:06.7757443Z [submariner]$ [cluster3] tail -n +2
2020-05-14T14:38:06.7757790Z [cluster3] NAMESPACE             NAME                                            DESIRED   CURRENT   READY   AGE
2020-05-14T14:38:06.7763229Z [submariner]$ [cluster3] kubectl get pods -A
2020-05-14T14:38:06.7763847Z [cluster3] kube-system           replicaset.apps/coredns-584795fc57              2         2         2       12m
2020-05-14T14:38:06.7764674Z [submariner]$ [cluster3] command kubectl --context=cluster3 get pods -A
2020-05-14T14:38:06.7765082Z [cluster3] submariner-operator   replicaset.apps/submariner-operator-bb77879b9   1         1         1       10m
2020-05-14T14:38:06.7765679Z [submariner]$ [cluster3] grep -v Running
2020-05-14T14:38:06.7765778Z [cluster3] ===================== END Post mortem cluster3 =====================
2020-05-14T14:38:06.7766188Z [submariner]$ [cluster3] sed s/  */;/g
2020-05-14T14:38:06.7766506Z [submariner]$ [cluster3] kubectl --context=cluster3 get pods -A
2020-05-14T14:38:06.7766738Z [submariner]$ make post-mortem
2020-05-14T14:38:07.0247027Z Post job cleanup.
2020-05-14T14:38:07.4872334Z [command]/usr/bin/git version
2020-05-14T14:38:07.4939191Z git version 2.26.2
2020-05-14T14:38:07.4998805Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2020-05-14T14:38:07.5084841Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2020-05-14T14:38:07.5514643Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2020-05-14T14:38:07.5550565Z http.https://github.com/.extraheader
2020-05-14T14:38:07.5559513Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
2020-05-14T14:38:07.5596175Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2020-05-14T14:38:07.6041383Z Cleaning up orphan processes