Created
August 6, 2014 06:46
-
-
Save david-resnick/aa65e8f6ef992edfb72d to your computer and use it in GitHub Desktop.
Fleet log file
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Aug 06 06:42:53 node-02 fleet[668]: I0806 06:42:53.361752 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49972: 307 Temporary Redirect | |
| Aug 06 06:42:53 node-02 fleet[668]: I0806 06:42:53.361787 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49972 | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.352794 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:54 node-02 fleet[668]: E0806 06:42:54.359734 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.360324 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.360680 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.361382 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.362009 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.363590 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.368581 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.368925 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.369430 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.370200 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:42:54 node-02 fleet[668]: I0806 06:42:54.370253 00668 reconcile.go:109] AgentReconciler completed reconciliation in 17.533145ms | |
| Aug 06 06:42:55 node-02 fleet[668]: I0806 06:42:55.352702 00668 engine.go:84] Engine tick | |
| Aug 06 06:42:55 node-02 fleet[668]: I0806 06:42:55.353284 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:55 node-02 fleet[668]: I0806 06:42:55.359544 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:42:55 node-02 fleet[668]: I0806 06:42:55.359998 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:56 node-02 fleet[668]: E0806 06:42:56.358713 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:42:56 node-02 fleet[668]: I0806 06:42:56.358899 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:42:56 node-02 fleet[668]: I0806 06:42:56.359800 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.351806 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49972: 200 OK | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.352138 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.352181 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49973 | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.352196 00668 event.go:60] Received {Action: expire, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49967, ModifiedIndex: 49972}, PrevNode: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49967, ModifiedIndex: 49967}} from etcd watch | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.352215 00668 event.go:67] Translated {Action: expire, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49967, ModifiedIndex: 49972}, PrevNode: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49967, ModifiedIndex: 49967}} to Event(Type=%!s(*event.Event=0xc21307f7b0)) | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.352442 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.352537 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.353185 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.353253 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.353471 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49973: 307 Temporary Redirect | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.353502 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49973 | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355051 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49973: 200 OK | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355134 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355161 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49974 | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355173 00668 event.go:60] Received {Action: create, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49973, ModifiedIndex: 49973}, PrevNode: <nil>} from etcd watch | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355201 00668 event.go:67] Translated {Action: create, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49973, ModifiedIndex: 49973}, PrevNode: <nil>} to Event(Type=%!s(*event.Event=0xc214422520)) | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355528 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49974: 307 Temporary Redirect | |
| Aug 06 06:42:57 node-02 fleet[668]: I0806 06:42:57.355573 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49974 | |
| Aug 06 06:42:58 node-02 fleet[668]: E0806 06:42:58.352609 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:42:58 node-02 fleet[668]: I0806 06:42:58.353231 00668 engine.go:84] Engine tick | |
| Aug 06 06:42:58 node-02 fleet[668]: I0806 06:42:58.353575 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:42:58 node-02 fleet[668]: I0806 06:42:58.354238 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:42:58 node-02 fleet[668]: I0806 06:42:58.354607 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:58 node-02 fleet[668]: I0806 06:42:58.355757 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:42:58 node-02 fleet[668]: I0806 06:42:58.356218 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.352844 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.353035 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.353122 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.353134 00668 engine.go:84] Engine tick | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.353167 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.353769 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.353806 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.354020 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.354053 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.359534 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.364657 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.364997 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.365129 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.365870 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:42:59 node-02 fleet[668]: I0806 06:42:59.365952 00668 reconcile.go:109] AgentReconciler completed reconciliation in 13.222587ms | |
| Aug 06 06:43:00 node-02 fleet[668]: E0806 06:43:00.358581 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:00 node-02 fleet[668]: I0806 06:43:00.358668 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:00 node-02 fleet[668]: I0806 06:43:00.358694 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.352718 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.353082 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.353478 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49974: 200 OK | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.353560 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.353592 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49975 | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.353604 00668 event.go:60] Received {Action: create, Node: {Key: /_coreos.com/fleet/machines/89a0ecfdf5ce4b4fb024e37b38cad4a9/object, CreatedIndex: 49974, ModifiedIndex: 49974}, PrevNode: <nil>} from etcd watch | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.353631 00668 event.go:67] Translated {Action: create, Node: {Key: /_coreos.com/fleet/machines/89a0ecfdf5ce4b4fb024e37b38cad4a9/object, CreatedIndex: 49974, ModifiedIndex: 49974}, PrevNode: <nil>} to Event(Type=%!s(*event.Event=0xc21178c320)) | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.354190 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49975: 307 Temporary Redirect | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.354227 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49975 | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.354438 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:01 node-02 fleet[668]: I0806 06:43:01.354478 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:02 node-02 fleet[668]: E0806 06:43:02.353156 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:02 node-02 fleet[668]: I0806 06:43:02.353225 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:02 node-02 fleet[668]: I0806 06:43:02.353241 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:03 node-02 fleet[668]: I0806 06:43:03.352710 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:03 node-02 fleet[668]: I0806 06:43:03.353425 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:03 node-02 fleet[668]: I0806 06:43:03.354487 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:03 node-02 fleet[668]: I0806 06:43:03.354851 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.352766 00668 agent.go:74] HeartbeatJobs tick | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.353016 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.353517 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:04 node-02 fleet[668]: E0806 06:43:04.353582 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.353601 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.360195 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.355451 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.360324 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.361627 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.362504 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.363425 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.367588 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.368332 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.368381 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.369416 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:04 node-02 fleet[668]: I0806 06:43:04.369468 00668 reconcile.go:109] AgentReconciler completed reconciliation in 16.557946ms | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.352161 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49975: 200 OK | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.352853 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.353274 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49976 | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.353619 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49975}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49970}} from etcd watch | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.354006 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49975}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49970}} to Event(Type=%!s(*event.Event=0xc210442450)) | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.354492 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.354866 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.356151 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: cancelled | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.357450 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.356628 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.533774 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.533886 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.533978 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.534009 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.534024 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49976: 307 Temporary Redirect | |
| Aug 06 06:43:05 node-02 fleet[668]: I0806 06:43:05.534068 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49976 | |
| Aug 06 06:43:06 node-02 fleet[668]: E0806 06:43:06.358595 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359283 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359687 00668 monitor.go:54] Monitor heartbeat function returned err, retrying in 2.5s: timeout reached | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359726 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359741 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359783 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359806 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: cancelled | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.359816 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.360492 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:06 node-02 fleet[668]: I0806 06:43:06.360561 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:07 node-02 fleet[668]: I0806 06:43:07.353357 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:07 node-02 fleet[668]: I0806 06:43:07.353437 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:43:07 node-02 fleet[668]: I0806 06:43:07.353449 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:07 node-02 fleet[668]: I0806 06:43:07.353492 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:07 node-02 fleet[668]: I0806 06:43:07.353887 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:07 node-02 fleet[668]: I0806 06:43:07.353945 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:08 node-02 fleet[668]: E0806 06:43:08.358853 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:08 node-02 fleet[668]: I0806 06:43:08.358959 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:08 node-02 fleet[668]: I0806 06:43:08.358977 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:08 node-02 fleet[668]: I0806 06:43:08.860013 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:08 node-02 fleet[668]: I0806 06:43:08.860639 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:08 node-02 fleet[668]: I0806 06:43:08.860693 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352248 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49976: 200 OK | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352557 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352596 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49977 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352613 00668 event.go:60] Received {Action: expire, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49973, ModifiedIndex: 49976}, PrevNode: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49973, ModifiedIndex: 49973}} from etcd watch | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352632 00668 event.go:67] Translated {Action: expire, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49973, ModifiedIndex: 49976}, PrevNode: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49973, ModifiedIndex: 49973}} to Event(Type=%!s(*event.Event=0xc21cea0ae0)) | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352871 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.352960 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.353263 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.353340 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.353508 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49977: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.353537 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49977 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.354017 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.354406 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.354436 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.361617 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 200 OK | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.361781 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49977: 200 OK | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.361821 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.361843 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49978 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.361853 00668 event.go:60] Received {Action: create, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49977, ModifiedIndex: 49977}, PrevNode: <nil>} from etcd watch | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.361879 00668 event.go:67] Translated {Action: create, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49977, ModifiedIndex: 49977}, PrevNode: <nil>} to Event(Type=%!s(*event.Event=0xc21c8f2320)) | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.362644 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.362867 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49978: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.362899 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49978 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.363748 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49978: 200 OK | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.363815 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.363836 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49979 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.363846 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49978}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49971}} from etcd watch | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.363960 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49978}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49971}} to Event(Type=%!s(*event.Event=0xc21c8f2960)) | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.368188 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.368413 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49979: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.368445 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49979 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.368742 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.368865 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369728 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369797 00668 reconcile.go:109] AgentReconciler completed reconciliation in 15.819341ms | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369843 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49979: 200 OK | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369947 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369972 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49980 | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369984 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49979}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49975}} from etcd watch | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.369999 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49979}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49975}} to Event(Type=%!s(*event.Event=0xc21c603cd0)) | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.370301 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49980: 307 Temporary Redirect | |
| Aug 06 06:43:09 node-02 fleet[668]: I0806 06:43:09.370334 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49980 | |
| Aug 06 06:43:10 node-02 fleet[668]: E0806 06:43:10.353827 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:10 node-02 fleet[668]: I0806 06:43:10.353928 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:10 node-02 fleet[668]: I0806 06:43:10.353960 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:10 node-02 fleet[668]: I0806 06:43:10.353980 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:10 node-02 fleet[668]: I0806 06:43:10.354029 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:10 node-02 fleet[668]: I0806 06:43:10.359452 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:10 node-02 fleet[668]: I0806 06:43:10.359502 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.354468 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.355030 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.355305 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.355641 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.360501 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49980: 200 OK | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.360585 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.360614 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49981 | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.361365 00668 event.go:60] Received {Action: create, Node: {Key: /_coreos.com/fleet/machines/ed0c6aaa2a654d5e969d5fefefffb782/object, CreatedIndex: 49980, ModifiedIndex: 49980}, PrevNode: <nil>} from etcd watch | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.361410 00668 event.go:67] Translated {Action: create, Node: {Key: /_coreos.com/fleet/machines/ed0c6aaa2a654d5e969d5fefefffb782/object, CreatedIndex: 49980, ModifiedIndex: 49980}, PrevNode: <nil>} to Event(Type=%!s(*event.Event=0xc21bd90d30)) | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.361603 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.361642 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.361818 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49981: 307 Temporary Redirect | |
| Aug 06 06:43:11 node-02 fleet[668]: I0806 06:43:11.361848 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49981 | |
| Aug 06 06:43:12 node-02 fleet[668]: E0806 06:43:12.358573 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:12 node-02 fleet[668]: I0806 06:43:12.358683 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:12 node-02 fleet[668]: I0806 06:43:12.358703 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353048 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49981: 200 OK | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353172 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353210 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49982 | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353223 00668 event.go:60] Received {Action: expire, Node: {Key: /_coreos.com/fleet/machines/d28240def1f642aaa5ce5591e6bac5f8/object, CreatedIndex: 49964, ModifiedIndex: 49981}, PrevNode: {Key: /_coreos.com/fleet/machines/d28240def1f642aaa5ce5591e6bac5f8/object, CreatedIndex: 49964, ModifiedIndex: 49964}} from etcd watch | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353242 00668 event.go:67] Translated {Action: expire, Node: {Key: /_coreos.com/fleet/machines/d28240def1f642aaa5ce5591e6bac5f8/object, CreatedIndex: 49964, ModifiedIndex: 49981}, PrevNode: {Key: /_coreos.com/fleet/machines/d28240def1f642aaa5ce5591e6bac5f8/object, CreatedIndex: 49964, ModifiedIndex: 49964}} to Event(Type=%!s(*event.Event=0xc21d142430)) | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353529 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353577 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.353968 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.354011 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.354181 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49982: 307 Temporary Redirect | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.354210 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49982 | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355371 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49982: 200 OK | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355440 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355462 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49983 | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355473 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49982}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49978}} from etcd watch | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355487 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49982}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49978}} to Event(Type=%!s(*event.Event=0xc21d142c40)) | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355780 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49983: 307 Temporary Redirect | |
| Aug 06 06:43:13 node-02 fleet[668]: I0806 06:43:13.355811 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49983 | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.352811 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:14 node-02 fleet[668]: E0806 06:43:14.360304 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.360337 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.360362 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.360391 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.360403 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.360412 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.360438 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.361245 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.361279 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.362321 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.368370 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.369046 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.369353 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.370299 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:14 node-02 fleet[668]: I0806 06:43:14.370350 00668 reconcile.go:109] AgentReconciler completed reconciliation in 17.627117ms | |
| Aug 06 06:43:15 node-02 fleet[668]: I0806 06:43:15.354100 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:15 node-02 fleet[668]: I0806 06:43:15.354586 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:43:15 node-02 fleet[668]: I0806 06:43:15.354867 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:15 node-02 fleet[668]: I0806 06:43:15.355260 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:15 node-02 fleet[668]: I0806 06:43:15.362184 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:15 node-02 fleet[668]: I0806 06:43:15.362586 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:16 node-02 fleet[668]: E0806 06:43:16.359941 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:16 node-02 fleet[668]: I0806 06:43:16.359996 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:16 node-02 fleet[668]: I0806 06:43:16.360015 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.352744 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49983: 200 OK | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.353524 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.353966 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49984 | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.354714 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49983}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49982}} from etcd watch | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.355154 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49983}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49982}} to Event(Type=%!s(*event.Event=0xc21add0270)) | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.355623 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.356095 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.358057 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49984: 307 Temporary Redirect | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.358113 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49984 | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.358882 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:17 node-02 fleet[668]: I0806 06:43:17.358942 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:18 node-02 fleet[668]: E0806 06:43:18.359696 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:18 node-02 fleet[668]: I0806 06:43:18.360324 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:18 node-02 fleet[668]: I0806 06:43:18.360696 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:18 node-02 fleet[668]: I0806 06:43:18.361067 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:18 node-02 fleet[668]: I0806 06:43:18.361448 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:18 node-02 fleet[668]: I0806 06:43:18.362661 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:18 node-02 fleet[668]: I0806 06:43:18.362718 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.352703 00668 agent.go:74] HeartbeatJobs tick | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.353191 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.354716 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49984: 200 OK | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.355293 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.355749 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49985 | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.355166 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.355712 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49984}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49983}} from etcd watch | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.362612 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49984}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49983}} to Event(Type=%!s(*event.Event=0xc21b62ac40)) | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.355211 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.357324 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.363709 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.357413 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49985: 307 Temporary Redirect | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.364410 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49985 | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.364744 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.362594 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.365490 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.366496 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.366632 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.367142 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.367178 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.367206 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.373399 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.373783 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.373813 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.374457 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:19 node-02 fleet[668]: I0806 06:43:19.374531 00668 reconcile.go:109] AgentReconciler completed reconciliation in 21.732108ms | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.359153 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: cancelled | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.359195 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.359244 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.360075 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.360122 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:20 node-02 fleet[668]: E0806 06:43:20.364241 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.364271 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:20 node-02 fleet[668]: I0806 06:43:20.364283 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.352636 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49985: 200 OK | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.354272 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.354707 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49986 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.355097 00668 event.go:60] Received {Action: expire, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49977, ModifiedIndex: 49985}, PrevNode: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49977, ModifiedIndex: 49977}} from etcd watch | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.355491 00668 event.go:67] Translated {Action: expire, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49977, ModifiedIndex: 49985}, PrevNode: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49977, ModifiedIndex: 49977}} to Event(Type=%!s(*event.Event=0xc21ceee9b0)) | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.356158 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.356625 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.360308 00668 monitor.go:54] Monitor heartbeat function returned err, retrying in 2.5s: timeout reached | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.360345 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: cancelled | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.360360 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.364454 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.364500 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.364696 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49986: 307 Temporary Redirect | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.364726 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49986 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.365629 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49986: 200 OK | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.365703 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.365726 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49987 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.365737 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49986}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49979}} from etcd watch | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.365753 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49986}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49979}} to Event(Type=%!s(*event.Event=0xc21b738750)) | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.366369 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49987: 307 Temporary Redirect | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.366426 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49987 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367003 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49987: 200 OK | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367062 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367084 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49988 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367095 00668 event.go:60] Received {Action: create, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49987, ModifiedIndex: 49987}, PrevNode: <nil>} from etcd watch | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367120 00668 event.go:67] Translated {Action: create, Node: {Key: /_coreos.com/fleet/lease/engine-leader, CreatedIndex: 49987, ModifiedIndex: 49987}, PrevNode: <nil>} to Event(Type=%!s(*event.Event=0xc21b738c00)) | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367539 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49988: 307 Temporary Redirect | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.367569 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49988 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368132 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49988: 200 OK | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368199 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368306 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49989 | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368323 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49988}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49984}} from etcd watch | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368338 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49988}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49984}} to Event(Type=%!s(*event.Event=0xc21a33c110)) | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368743 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49989: 307 Temporary Redirect | |
| Aug 06 06:43:21 node-02 fleet[668]: I0806 06:43:21.368774 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49989 | |
| Aug 06 06:43:22 node-02 fleet[668]: E0806 06:43:22.358800 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:22 node-02 fleet[668]: I0806 06:43:22.359391 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:22 node-02 fleet[668]: I0806 06:43:22.359709 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:22 node-02 fleet[668]: I0806 06:43:22.360044 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:22 node-02 fleet[668]: I0806 06:43:22.360370 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:22 node-02 fleet[668]: I0806 06:43:22.361381 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:22 node-02 fleet[668]: I0806 06:43:22.361843 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.357940 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.358664 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.359068 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.359478 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.362028 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.362085 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.860571 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.861123 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:23 node-02 fleet[668]: I0806 06:43:23.861178 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.352855 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.354010 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.354511 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:24 node-02 fleet[668]: E0806 06:43:24.360462 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.360541 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.360557 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.360737 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.365636 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.366116 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.366170 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.366832 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.366890 00668 reconcile.go:109] AgentReconciler completed reconciliation in 14.141945ms | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.860578 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: cancelled | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.860617 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.860657 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.861439 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:24 node-02 fleet[668]: I0806 06:43:24.861504 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.352725 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.353252 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.353785 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.354149 00668 monitor.go:54] Monitor heartbeat function returned err, retrying in 2.5s: 105: Key already exists (/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object) [49989] | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.355306 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49989: 200 OK | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.355719 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.356079 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49990 | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.356435 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49989}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49986}} from etcd watch | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.356850 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49989}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49986}} to Event(Type=%!s(*event.Event=0xc2196f9450)) | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.358438 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49990: 307 Temporary Redirect | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.358494 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49990 | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.362705 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:25 node-02 fleet[668]: I0806 06:43:25.363132 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:26 node-02 fleet[668]: E0806 06:43:26.353487 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:26 node-02 fleet[668]: I0806 06:43:26.353556 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:26 node-02 fleet[668]: I0806 06:43:26.353579 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.352705 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.353408 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.354253 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.358247 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.854698 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.855829 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:27 node-02 fleet[668]: I0806 06:43:27.856239 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:28 node-02 fleet[668]: E0806 06:43:28.353521 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.353691 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.359378 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.854757 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: cancelled | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.855188 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.855546 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.856718 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:28 node-02 fleet[668]: I0806 06:43:28.857378 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.352748 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.353477 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.354993 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.355054 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49990: 200 OK | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.356397 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.356461 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49991 | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.356485 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49990}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49989}} from etcd watch | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.356504 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49990}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49989}} to Event(Type=%!s(*event.Event=0xc219ea0b30)) | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361598 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361648 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361666 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361687 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361703 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361750 00668 monitor.go:54] Monitor heartbeat function returned err, retrying in 2.5s: 105: Key already exists (/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object) [49990] | |
| Aug 06 06:43:29 node-02 fleet[668]: E0806 06:43:29.361769 00668 server.go:212] Server monitor triggered: Monitor timed out before successful heartbeat | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.361777 00668 server.go:178] Establishing etcd connectivity | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.362065 00668 coreos.go:77] Halting CoreOSMachine.PeriodicRefresh | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.362083 00668 agent.go:71] HeartbeatJobs exiting due to stop signal | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.362093 00668 client.go:356] etcd: recv error response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49991: cancelled | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.362104 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:29 node-02 fleet[668]: E0806 06:43:29.362111 00668 event.go:97] etcd watcher {Watch /_coreos.com/fleet/} returned error: cancelled | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.362167 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.363375 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.363418 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.363458 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.370309 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.370631 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.370680 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.371688 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.371736 00668 reconcile.go:109] AgentReconciler completed reconciliation in 19.002677ms | |
| Aug 06 06:43:29 node-02 fleet[668]: I0806 06:43:29.371747 00668 reconcile.go:116] AgentReconciler exiting due to stop signal | |
| Aug 06 06:43:30 node-02 fleet[668]: E0806 06:43:30.354855 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.354949 00668 engine.go:81] Engine exiting due to stop signal | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.354964 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.354984 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.361999 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: cancelled | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.362034 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.362087 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.362637 00668 event.go:77] Gracefully closing etcd watch loop: key=/_coreos.com/fleet/ | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.362740 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:30 node-02 fleet[668]: I0806 06:43:30.362814 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false | |
| Aug 06 06:43:31 node-02 fleet[668]: I0806 06:43:31.354136 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:32 node-02 fleet[668]: I0806 06:43:32.355207 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:32 node-02 fleet[668]: I0806 06:43:32.357931 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 307 Temporary Redirect | |
| Aug 06 06:43:32 node-02 fleet[668]: I0806 06:43:32.357990 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.353038 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object?prevExist=true: 200 OK | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.353164 00668 server.go:190] Starting server components | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.353237 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.353280 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49995 | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.353676 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49995: 307 Temporary Redirect | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.353713 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49995 | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354499 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49995: 200 OK | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354571 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354600 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49996 | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354612 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49995}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49991}} from etcd watch | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354642 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49995}, PrevNode: {Key: /_coreos.com/fleet/machines/00b7e1bbb2464ed9a4ef4282b11f2161/object, CreatedIndex: 17802, ModifiedIndex: 49991}} to Event(Type=%!s(*event.Event=0xc217f4f1a0)) | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354707 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.354747 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.355142 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49996: 307 Temporary Redirect | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.355175 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49996 | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.355337 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:33 node-02 fleet[668]: I0806 06:43:33.355406 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:34 node-02 fleet[668]: E0806 06:43:34.359599 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:34 node-02 fleet[668]: I0806 06:43:34.360142 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:34 node-02 fleet[668]: I0806 06:43:34.360434 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:35 node-02 fleet[668]: I0806 06:43:35.353345 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:35 node-02 fleet[668]: I0806 06:43:35.353996 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:35 node-02 fleet[668]: I0806 06:43:35.360992 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:35 node-02 fleet[668]: I0806 06:43:35.361384 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:36 node-02 fleet[668]: E0806 06:43:36.362632 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:36 node-02 fleet[668]: I0806 06:43:36.362709 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:36 node-02 fleet[668]: I0806 06:43:36.362735 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.351999 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49996: 200 OK | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.352677 00668 event.go:86] Creating etcd watcher: {Watch /_coreos.com/fleet/} | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.353084 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49997 | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.353443 00668 event.go:60] Received {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49996}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49988}} from etcd watch | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.353817 00668 event.go:67] Translated {Action: update, Node: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49996}, PrevNode: {Key: /_coreos.com/fleet/machines/b256e74985e24bcf8b1de90b8be48132/object, CreatedIndex: 17766, ModifiedIndex: 49988}} to Event(Type=%!s(*event.Event=0xc217c83540)) | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.354557 00668 engine.go:87] Engine reconcilation triggered by job state change | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.354996 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.361880 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.361943 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.362237 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49997: 307 Temporary Redirect | |
| Aug 06 06:43:37 node-02 fleet[668]: I0806 06:43:37.362288 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet?consistent=true&recursive=true&wait=true&waitIndex=49997 | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.353404 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:38 node-02 fleet[668]: E0806 06:43:38.355409 00668 engine.go:119] Failed acquiring engine leadership: timeout reached | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.355703 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.355591 00668 client.go:356] etcd: recv error response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: cancelled | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.361554 00668 client.go:278] Failed getting response from http://localhost:4001/: cancelled | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.361599 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.361722 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.361751 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.362176 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.362210 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.363152 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/job?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.368039 00668 client.go:353] etcd: sending HTTP request GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.368324 00668 client.go:360] etcd: recv response from GET http://localhost:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 307 Temporary Redirect | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.368364 00668 client.go:353] etcd: sending HTTP request GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.369142 00668 client.go:360] etcd: recv response from GET http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/offer?consistent=true&recursive=true&sorted=true: 404 Not Found | |
| Aug 06 06:43:38 node-02 fleet[668]: I0806 06:43:38.369229 00668 reconcile.go:109] AgentReconciler completed reconciliation in 15.895731ms | |
| Aug 06 06:43:39 node-02 fleet[668]: I0806 06:43:39.354772 00668 client.go:360] etcd: recv response from PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 412 Precondition Failed | |
| Aug 06 06:43:39 node-02 fleet[668]: I0806 06:43:39.354876 00668 engine.go:121] Unable to acquire engine leadership | |
| Aug 06 06:43:39 node-02 fleet[668]: I0806 06:43:39.354889 00668 engine.go:84] Engine tick | |
| Aug 06 06:43:39 node-02 fleet[668]: I0806 06:43:39.354957 00668 client.go:353] etcd: sending HTTP request PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false | |
| Aug 06 06:43:39 node-02 fleet[668]: I0806 06:43:39.361374 00668 client.go:360] etcd: recv response from PUT http://localhost:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false: 307 Temporary Redirect | |
| Aug 06 06:43:39 node-02 fleet[668]: I0806 06:43:39.361425 00668 client.go:353] etcd: sending HTTP request PUT http://10.23.23.27:4001/v2/keys/_coreos.com/fleet/lease/engine-leader?prevExist=false |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment