Created
January 19, 2021 12:48
-
-
Save seuf/4b1fa125a921d361acc09e0da2d3bcd2 to your computer and use it in GitHub Desktop.
k3d server crash
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Client: | |
| Context: default | |
| Debug Mode: false | |
| Plugins: | |
| app: Docker App (Docker Inc., v0.9.1-beta3) | |
| buildx: Build with BuildKit (Docker Inc., v0.5.1-docker) | |
| Server: | |
| Containers: 2 | |
| Running: 1 | |
| Paused: 0 | |
| Stopped: 1 | |
| Images: 92 | |
| Server Version: 20.10.2 | |
| Storage Driver: overlay2 | |
| Backing Filesystem: extfs | |
| Supports d_type: true | |
| Native Overlay Diff: true | |
| Logging Driver: json-file | |
| Cgroup Driver: systemd | |
| Cgroup Version: 2 | |
| Plugins: | |
| Volume: local | |
| Network: bridge host ipvlan macvlan null overlay | |
| Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog | |
| Swarm: inactive | |
| Runtimes: io.containerd.runtime.v1.linux runc io.containerd.runc.v2 | |
| Default Runtime: runc | |
| Init Binary: docker-init | |
| containerd version: 269548fa27e0089a8b8278fc4fc781d7f65a939b | |
| runc version: ff819c7e9184c13b7c2607fe6c30ae19403a7aff | |
| init version: de40ad0 | |
| Security Options: | |
| apparmor | |
| seccomp | |
| Profile: default | |
| cgroupns | |
| Kernel Version: 5.10.0-1-amd64 | |
| Operating System: Debian GNU/Linux bullseye/sid | |
| OSType: linux | |
| Architecture: x86_64 | |
| CPUs: 8 | |
| Total Memory: 31.22GiB | |
| Name: laptop-thierry | |
| ID: XT2C:IG4S:EN2U:GEQG:C3XC:NUWX:5VMT:75SW:3W3C:CY6U:F4ZG:NGHG | |
| Docker Root Dir: /home/docker | |
| Debug Mode: false | |
| Username: seuf | |
| Registry: https://index.docker.io/v1/ | |
| Labels: | |
| Experimental: false | |
| Insecure Registries: | |
| 127.0.0.0/8 | |
| Live Restore Enabled: false | |
| WARNING: No kernel memory TCP limit support | |
| WARNING: No oom kill disable support | |
| WARNING: Support for cgroup v2 is experimental |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Client: Docker Engine - Community | |
| Version: 20.10.2 | |
| API version: 1.41 | |
| Go version: go1.13.15 | |
| Git commit: 2291f61 | |
| Built: Mon Dec 28 16:17:34 2020 | |
| OS/Arch: linux/amd64 | |
| Context: default | |
| Experimental: true | |
| Server: Docker Engine - Community | |
| Engine: | |
| Version: 20.10.2 | |
| API version: 1.41 (minimum version 1.12) | |
| Go version: go1.13.15 | |
| Git commit: 8891c58 | |
| Built: Mon Dec 28 16:15:28 2020 | |
| OS/Arch: linux/amd64 | |
| Experimental: false | |
| containerd: | |
| Version: 1.4.3 | |
| GitCommit: 269548fa27e0089a8b8278fc4fc781d7f65a939b | |
| runc: | |
| Version: 1.0.0-rc92 | |
| GitCommit: ff819c7e9184c13b7c2607fe6c30ae19403a7aff | |
| docker-init: | |
| Version: 0.19.0 | |
| GitCommit: de40ad0 |
This file has been truncated, but you can view the full file.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| time="2021-01-19T12:41:34.293305503Z" level=info msg="Starting k3s v1.20.0+k3s2 (2ea6b163)" | |
| time="2021-01-19T12:41:34.305272779Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s" | |
| time="2021-01-19T12:41:34.305325627Z" level=info msg="Configuring database table schema and indexes, this may take a moment..." | |
| time="2021-01-19T12:41:34.310708063Z" level=info msg="Database tables and indexes are up to date" | |
| time="2021-01-19T12:41:34.313927498Z" level=info msg="Kine listening on unix://kine.sock" | |
| time="2021-01-19T12:41:34.342744714Z" level=info msg="certificate CN=system:admin,O=system:masters signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.343601835Z" level=info msg="certificate CN=system:kube-controller-manager signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.344894657Z" level=info msg="certificate CN=system:kube-scheduler signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.345780930Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.346513973Z" level=info msg="certificate CN=system:kube-proxy signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.347112656Z" level=info msg="certificate CN=system:k3s-controller signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.347780989Z" level=info msg="certificate CN=cloud-controller-manager signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.348926604Z" level=info msg="certificate CN=kube-apiserver signed by CN=k3s-server-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.350024107Z" level=info msg="certificate CN=system:auth-proxy signed by CN=k3s-request-header-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.351083996Z" level=info msg="certificate CN=etcd-server signed by CN=etcd-server-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.351594843Z" level=info msg="certificate CN=etcd-client signed by CN=etcd-server-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.352463542Z" level=info msg="certificate CN=etcd-peer signed by CN=etcd-peer-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.857837759Z" level=info msg="certificate CN=k3s,O=k3s signed by CN=k3s-server-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:34 +0000 UTC" | |
| time="2021-01-19T12:41:34.858140315Z" level=info msg="Active TLS secret (ver=) (count 8): map[listener.cattle.io/cn-0.0.0.0:0.0.0.0 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-172.21.0.2:172.21.0.2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/fingerprint:SHA1=61806F3530AB6B3BCCA787A3769B2E9903BF4F02]" | |
| time="2021-01-19T12:41:34.860357281Z" level=info msg="Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=unknown --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --enable-admission-plugins=NodeRestriction --etcd-servers=unix://kine.sock --feature-gates=ServiceAccountIssuerDiscovery=false --insecure-port=0 --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=k3s --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=10.43.0.0/16 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key" | |
| Flag --insecure-port has been deprecated, This flag has no effect now and will be removed in v1.24. | |
| I0119 12:41:34.862294 7 server.go:659] external host was not specified, using 172.21.0.2 | |
| I0119 12:41:34.862910 7 server.go:196] Version: v1.20.0+k3s2 | |
| I0119 12:41:35.263801 7 shared_informer.go:240] Waiting for caches to sync for node_authorizer | |
| I0119 12:41:35.265866 7 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| I0119 12:41:35.265875 7 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| I0119 12:41:35.267606 7 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| I0119 12:41:35.267618 7 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| I0119 12:41:35.286730 7 instance.go:289] Using reconciler: lease | |
| I0119 12:41:35.337627 7 rest.go:131] the default service ipfamily for this cluster is: IPv4 | |
| W0119 12:41:35.595783 7 genericapiserver.go:419] Skipping API batch/v2alpha1 because it has no resources. | |
| W0119 12:41:35.604549 7 genericapiserver.go:419] Skipping API discovery.k8s.io/v1alpha1 because it has no resources. | |
| W0119 12:41:35.614215 7 genericapiserver.go:419] Skipping API node.k8s.io/v1alpha1 because it has no resources. | |
| W0119 12:41:35.622443 7 genericapiserver.go:419] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources. | |
| W0119 12:41:35.625188 7 genericapiserver.go:419] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources. | |
| W0119 12:41:35.629522 7 genericapiserver.go:419] Skipping API storage.k8s.io/v1alpha1 because it has no resources. | |
| W0119 12:41:35.631308 7 genericapiserver.go:419] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources. | |
| W0119 12:41:35.641028 7 genericapiserver.go:419] Skipping API apps/v1beta2 because it has no resources. | |
| W0119 12:41:35.641057 7 genericapiserver.go:419] Skipping API apps/v1beta1 because it has no resources. | |
| I0119 12:41:35.649417 7 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook. | |
| I0119 12:41:35.649429 7 plugins.go:161] Loaded 10 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota. | |
| time="2021-01-19T12:41:35.655419402Z" level=info msg="Running kube-scheduler --address=127.0.0.1 --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --port=10251 --profiling=false --secure-port=0" | |
| time="2021-01-19T12:41:35.655478126Z" level=info msg="Waiting for API server to become available" | |
| time="2021-01-19T12:41:35.655870897Z" level=info msg="Running kube-controller-manager --address=127.0.0.1 --allocate-node-cidrs=true --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --cluster-signing-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --configure-cloud-routes=false --controllers=*,-service,-route,-cloud-node-lifecycle --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --port=10252 --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=0 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --use-service-account-credentials=true" | |
| time="2021-01-19T12:41:35.661873953Z" level=info msg="Node token is available at /var/lib/rancher/k3s/server/token" | |
| time="2021-01-19T12:41:35.661956486Z" level=info msg="To join node to cluster: k3s agent -s https://172.21.0.2:6443 -t ${NODE_TOKEN}" | |
| time="2021-01-19T12:41:35.663070002Z" level=info msg="Wrote kubeconfig /output/kubeconfig.yaml" | |
| time="2021-01-19T12:41:35.663248473Z" level=info msg="Run: k3s kubectl" | |
| time="2021-01-19T12:41:35.663349529Z" level=info msg="Module overlay was already loaded" | |
| time="2021-01-19T12:41:35.663367083Z" level=info msg="Module nf_conntrack was already loaded" | |
| time="2021-01-19T12:41:35.663379385Z" level=info msg="Module br_netfilter was already loaded" | |
| time="2021-01-19T12:41:35.670034218Z" level=warning msg="Failed to start iptable_nat module" | |
| time="2021-01-19T12:41:35.683230917Z" level=info msg="Cluster-Http-Server 2021/01/19 12:41:35 http: TLS handshake error from 127.0.0.1:41374: remote error: tls: bad certificate" | |
| time="2021-01-19T12:41:35.686323815Z" level=info msg="Cluster-Http-Server 2021/01/19 12:41:35 http: TLS handshake error from 127.0.0.1:41380: remote error: tls: bad certificate" | |
| time="2021-01-19T12:41:35.693051520Z" level=error msg="runtime core not ready" | |
| time="2021-01-19T12:41:35.693139789Z" level=error msg="Failed to retrieve agent config: https://127.0.0.1:6443/v1-k3s/serving-kubelet.crt: 500 Internal Server Error" | |
| I0119 12:41:37.092461 7 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt | |
| I0119 12:41:37.092461 7 dynamic_cafile_content.go:167] Starting request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt | |
| I0119 12:41:37.092541 7 dynamic_serving_content.go:130] Starting serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key | |
| I0119 12:41:37.092868 7 secure_serving.go:197] Serving securely on 127.0.0.1:6444 | |
| I0119 12:41:37.092902 7 tlsconfig.go:240] Starting DynamicServingCertificateController | |
| I0119 12:41:37.092930 7 controller.go:83] Starting OpenAPI AggregationController | |
| I0119 12:41:37.092974 7 apf_controller.go:249] Starting API Priority and Fairness config controller | |
| I0119 12:41:37.092990 7 autoregister_controller.go:141] Starting autoregister controller | |
| I0119 12:41:37.092995 7 cache.go:32] Waiting for caches to sync for autoregister controller | |
| I0119 12:41:37.093002 7 dynamic_serving_content.go:130] Starting aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key | |
| I0119 12:41:37.093013 7 crdregistration_controller.go:111] Starting crd-autoregister controller | |
| I0119 12:41:37.093019 7 shared_informer.go:240] Waiting for caches to sync for crd-autoregister | |
| I0119 12:41:37.092938 7 customresource_discovery_controller.go:209] Starting DiscoveryController | |
| I0119 12:41:37.093266 7 apiservice_controller.go:97] Starting APIServiceRegistrationController | |
| I0119 12:41:37.093275 7 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller | |
| I0119 12:41:37.093289 7 available_controller.go:475] Starting AvailableConditionController | |
| I0119 12:41:37.093294 7 cache.go:32] Waiting for caches to sync for AvailableConditionController controller | |
| I0119 12:41:37.094142 7 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller | |
| I0119 12:41:37.094155 7 shared_informer.go:240] Waiting for caches to sync for cluster_authentication_trust_controller | |
| I0119 12:41:37.094183 7 dynamic_cafile_content.go:167] Starting client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt | |
| I0119 12:41:37.094203 7 dynamic_cafile_content.go:167] Starting request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt | |
| I0119 12:41:37.094510 7 controller.go:86] Starting OpenAPI controller | |
| I0119 12:41:37.094566 7 naming_controller.go:291] Starting NamingConditionController | |
| I0119 12:41:37.094595 7 establishing_controller.go:76] Starting EstablishingController | |
| I0119 12:41:37.094625 7 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController | |
| I0119 12:41:37.094674 7 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController | |
| I0119 12:41:37.094697 7 crd_finalizer.go:266] Starting CRDFinalizer | |
| time="2021-01-19T12:41:37.100998816Z" level=info msg="Waiting for cloudcontroller rbac role to be created" | |
| E0119 12:41:37.107060 7 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "cloud-controller-manager" cannot list resource "nodes" in API group "" at the cluster scope | |
| I0119 12:41:37.108380 7 controller.go:606] quota admission added evaluator for: namespaces | |
| E0119 12:41:37.117778 7 controller.go:151] Unable to perform initial Kubernetes service initialization: Service "kubernetes" is invalid: spec.clusterIPs: Invalid value: []string{"10.43.0.1"}: failed to allocated ip:10.43.0.1 with error:cannot allocate resources of type serviceipallocations at this time | |
| E0119 12:41:37.118245 7 controller.go:156] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/172.21.0.2, ResourceVersion: 0, AdditionalErrorMsg: | |
| I0119 12:41:37.164021 7 shared_informer.go:247] Caches are synced for node_authorizer | |
| I0119 12:41:37.193182 7 apf_controller.go:253] Running API Priority and Fairness config worker | |
| I0119 12:41:37.193205 7 cache.go:39] Caches are synced for autoregister controller | |
| I0119 12:41:37.193222 7 shared_informer.go:247] Caches are synced for crd-autoregister | |
| I0119 12:41:37.193431 7 cache.go:39] Caches are synced for APIServiceRegistrationController controller | |
| I0119 12:41:37.193439 7 cache.go:39] Caches are synced for AvailableConditionController controller | |
| I0119 12:41:37.194216 7 shared_informer.go:247] Caches are synced for cluster_authentication_trust_controller | |
| I0119 12:41:38.092394 7 controller.go:132] OpenAPI AggregationController: action for item : Nothing (removed from the queue). | |
| I0119 12:41:38.092413 7 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue). | |
| I0119 12:41:38.097631 7 storage_scheduling.go:132] created PriorityClass system-node-critical with value 2000001000 | |
| I0119 12:41:38.099832 7 storage_scheduling.go:132] created PriorityClass system-cluster-critical with value 2000000000 | |
| I0119 12:41:38.099848 7 storage_scheduling.go:148] all system priority classes are created successfully or already exist. | |
| time="2021-01-19T12:41:38.103687296Z" level=info msg="Waiting for cloudcontroller rbac role to be created" | |
| E0119 12:41:38.345880 7 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "cloud-controller-manager" cannot list resource "nodes" in API group "" at the cluster scope | |
| I0119 12:41:38.418197 7 controller.go:606] quota admission added evaluator for: roles.rbac.authorization.k8s.io | |
| I0119 12:41:38.442174 7 controller.go:606] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io | |
| W0119 12:41:38.540792 7 lease.go:233] Resetting endpoints for master service "kubernetes" to [172.21.0.2] | |
| I0119 12:41:38.541992 7 controller.go:606] quota admission added evaluator for: endpoints | |
| I0119 12:41:38.546624 7 controller.go:606] quota admission added evaluator for: endpointslices.discovery.k8s.io | |
| time="2021-01-19T12:41:39.105386287Z" level=info msg="Kube API server is now running" | |
| time="2021-01-19T12:41:39.105427907Z" level=info msg="k3s is up and running" | |
| Flag --address has been deprecated, see --bind-address instead. | |
| time="2021-01-19T12:41:39.109944434Z" level=info msg="Waiting for cloudcontroller rbac role to be created" | |
| I0119 12:41:39.115008 7 controllermanager.go:176] Version: v1.20.0+k3s2 | |
| I0119 12:41:39.115495 7 deprecated_insecure_serving.go:53] Serving insecurely on 127.0.0.1:10252 | |
| time="2021-01-19T12:41:39.118108782Z" level=info msg="Creating CRD addons.k3s.cattle.io" | |
| time="2021-01-19T12:41:39.125336897Z" level=info msg="Creating CRD helmcharts.helm.cattle.io" | |
| time="2021-01-19T12:41:39.129158000Z" level=info msg="Creating CRD helmchartconfigs.helm.cattle.io" | |
| W0119 12:41:39.132224 7 authorization.go:47] Authorization is disabled | |
| W0119 12:41:39.132246 7 authentication.go:40] Authentication is disabled | |
| I0119 12:41:39.132260 7 deprecated_insecure_serving.go:51] Serving healthz insecurely on 127.0.0.1:10251 | |
| time="2021-01-19T12:41:39.139646711Z" level=info msg="Waiting for CRD helmchartconfigs.helm.cattle.io to become available" | |
| time="2021-01-19T12:41:39.643346251Z" level=info msg="Done waiting for CRD helmchartconfigs.helm.cattle.io to become available" | |
| time="2021-01-19T12:41:39.643392457Z" level=info msg="Waiting for CRD addons.k3s.cattle.io to become available" | |
| I0119 12:41:39.697253 7 shared_informer.go:240] Waiting for caches to sync for tokens | |
| I0119 12:41:39.704016 7 controller.go:606] quota admission added evaluator for: serviceaccounts | |
| I0119 12:41:39.708832 7 garbagecollector.go:142] Starting garbage collector controller | |
| I0119 12:41:39.708845 7 shared_informer.go:240] Waiting for caches to sync for garbage collector | |
| I0119 12:41:39.708866 7 graph_builder.go:289] GraphBuilder running | |
| I0119 12:41:39.708953 7 controllermanager.go:554] Started "garbagecollector" | |
| I0119 12:41:39.715769 7 controllermanager.go:554] Started "deployment" | |
| I0119 12:41:39.715868 7 deployment_controller.go:153] Starting deployment controller | |
| I0119 12:41:39.715873 7 shared_informer.go:240] Waiting for caches to sync for deployment | |
| I0119 12:41:39.722087 7 certificate_controller.go:118] Starting certificate controller "csrsigning-kubelet-serving" | |
| I0119 12:41:39.722106 7 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kubelet-serving | |
| I0119 12:41:39.722124 7 dynamic_serving_content.go:130] Starting csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key | |
| I0119 12:41:39.722295 7 certificate_controller.go:118] Starting certificate controller "csrsigning-kubelet-client" | |
| I0119 12:41:39.722305 7 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kubelet-client | |
| I0119 12:41:39.722320 7 dynamic_serving_content.go:130] Starting csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key | |
| I0119 12:41:39.722532 7 certificate_controller.go:118] Starting certificate controller "csrsigning-kube-apiserver-client" | |
| I0119 12:41:39.722541 7 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kube-apiserver-client | |
| I0119 12:41:39.722559 7 dynamic_serving_content.go:130] Starting csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key | |
| I0119 12:41:39.722674 7 controllermanager.go:554] Started "csrsigning" | |
| I0119 12:41:39.722803 7 certificate_controller.go:118] Starting certificate controller "csrsigning-legacy-unknown" | |
| I0119 12:41:39.722811 7 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-legacy-unknown | |
| I0119 12:41:39.722825 7 dynamic_serving_content.go:130] Starting csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key | |
| I0119 12:41:39.727554 7 node_lifecycle_controller.go:380] Sending events to api server. | |
| I0119 12:41:39.727676 7 taint_manager.go:163] Sending events to api server. | |
| I0119 12:41:39.727729 7 node_lifecycle_controller.go:508] Controller will reconcile labels. | |
| I0119 12:41:39.727758 7 controllermanager.go:554] Started "nodelifecycle" | |
| I0119 12:41:39.727843 7 node_lifecycle_controller.go:542] Starting node controller | |
| I0119 12:41:39.727851 7 shared_informer.go:240] Waiting for caches to sync for taint | |
| I0119 12:41:39.732531 7 controllermanager.go:554] Started "replicaset" | |
| I0119 12:41:39.732633 7 replica_set.go:182] Starting replicaset controller | |
| I0119 12:41:39.732641 7 shared_informer.go:240] Waiting for caches to sync for ReplicaSet | |
| I0119 12:41:39.737818 7 controllermanager.go:554] Started "cronjob" | |
| W0119 12:41:39.737843 7 controllermanager.go:533] "service" is disabled | |
| I0119 12:41:39.737882 7 cronjob_controller.go:96] Starting CronJob Manager | |
| I0119 12:41:39.742941 7 controllermanager.go:554] Started "persistentvolume-expander" | |
| I0119 12:41:39.743030 7 expand_controller.go:310] Starting expand controller | |
| I0119 12:41:39.743041 7 shared_informer.go:240] Waiting for caches to sync for expand | |
| I0119 12:41:39.748970 7 controllermanager.go:554] Started "pvc-protection" | |
| W0119 12:41:39.748991 7 controllermanager.go:546] Skipping "ttl-after-finished" | |
| W0119 12:41:39.748994 7 controllermanager.go:533] "tokencleaner" is disabled | |
| I0119 12:41:39.749044 7 pvc_protection_controller.go:110] Starting PVC protection controller | |
| I0119 12:41:39.749056 7 shared_informer.go:240] Waiting for caches to sync for PVC protection | |
| I0119 12:41:39.797318 7 shared_informer.go:247] Caches are synced for tokens | |
| I0119 12:41:39.801807 7 controllermanager.go:554] Started "replicationcontroller" | |
| I0119 12:41:39.801846 7 replica_set.go:182] Starting replicationcontroller controller | |
| I0119 12:41:39.801853 7 shared_informer.go:240] Waiting for caches to sync for ReplicationController | |
| I0119 12:41:39.953023 7 controllermanager.go:554] Started "statefulset" | |
| W0119 12:41:39.953050 7 controllermanager.go:533] "bootstrapsigner" is disabled | |
| I0119 12:41:39.953136 7 stateful_set.go:146] Starting stateful set controller | |
| I0119 12:41:39.953151 7 shared_informer.go:240] Waiting for caches to sync for stateful set | |
| I0119 12:41:40.002252 7 node_ipam_controller.go:91] Sending events to api server. | |
| time="2021-01-19T12:41:40.116084801Z" level=info msg="Waiting for cloudcontroller rbac role to be created" | |
| time="2021-01-19T12:41:40.148134374Z" level=info msg="Done waiting for CRD addons.k3s.cattle.io to become available" | |
| time="2021-01-19T12:41:40.148154681Z" level=info msg="Waiting for CRD helmcharts.helm.cattle.io to become available" | |
| time="2021-01-19T12:41:40.651848916Z" level=info msg="Done waiting for CRD helmcharts.helm.cattle.io to become available" | |
| time="2021-01-19T12:41:40.661205485Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-1.81.0.tgz" | |
| time="2021-01-19T12:41:40.661486326Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml" | |
| time="2021-01-19T12:41:40.661577813Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml" | |
| time="2021-01-19T12:41:40.661688482Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml" | |
| time="2021-01-19T12:41:40.661756352Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml" | |
| time="2021-01-19T12:41:40.661827368Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml" | |
| time="2021-01-19T12:41:40.661893839Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/traefik.yaml" | |
| time="2021-01-19T12:41:40.661964721Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml" | |
| time="2021-01-19T12:41:40.662025830Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml" | |
| time="2021-01-19T12:41:40.662095041Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml" | |
| time="2021-01-19T12:41:40.662156895Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml" | |
| time="2021-01-19T12:41:40.662222195Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml" | |
| time="2021-01-19T12:41:40.662297448Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml" | |
| time="2021-01-19T12:41:40.694749430Z" level=info msg="Cluster-Http-Server 2021/01/19 12:41:40 http: TLS handshake error from 127.0.0.1:41460: remote error: tls: bad certificate" | |
| E0119 12:41:40.735996 7 reflector.go:138] k8s.io/client-go/informers/factory.go:134: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "cloud-controller-manager" cannot list resource "nodes" in API group "" at the cluster scope | |
| time="2021-01-19T12:41:40.762680210Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller" | |
| time="2021-01-19T12:41:40.762747290Z" level=info msg="Waiting for control-plane node agent startup" | |
| time="2021-01-19T12:41:40.777321038Z" level=info msg="Cluster dns configmap has been set successfully" | |
| I0119 12:41:40.784725 7 controller.go:606] quota admission added evaluator for: addons.k3s.cattle.io | |
| time="2021-01-19T12:41:40.821639874Z" level=info msg="certificate CN=k3d-test-server-0 signed by CN=k3s-server-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:40 +0000 UTC" | |
| I0119 12:41:40.822946 7 controller.go:606] quota admission added evaluator for: deployments.apps | |
| time="2021-01-19T12:41:40.863694395Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller" | |
| time="2021-01-19T12:41:40.863695890Z" level=info msg="Starting batch/v1, Kind=Job controller" | |
| time="2021-01-19T12:41:40.863696628Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller" | |
| time="2021-01-19T12:41:41.006786302Z" level=info msg="certificate CN=system:node:k3d-test-server-0,O=system:nodes signed by CN=k3s-client-ca@1611060094: notBefore=2021-01-19 12:41:34 +0000 UTC notAfter=2022-01-19 12:41:41 +0000 UTC" | |
| I0119 12:41:41.069376 7 controller.go:606] quota admission added evaluator for: helmcharts.helm.cattle.io | |
| I0119 12:41:41.089397 7 controller.go:606] quota admission added evaluator for: jobs.batch | |
| time="2021-01-19T12:41:41.119478843Z" level=info msg="Running cloud-controller-manager for provider k3s with args --profiling=false" | |
| I0119 12:41:41.119581 7 controllermanager.go:127] Version: v1.20.0+k3s2 | |
| time="2021-01-19T12:41:41.363921690Z" level=info msg="Starting /v1, Kind=Node controller" | |
| time="2021-01-19T12:41:41.363972969Z" level=info msg="Starting /v1, Kind=Service controller" | |
| time="2021-01-19T12:41:41.364000471Z" level=info msg="Starting /v1, Kind=Secret controller" | |
| time="2021-01-19T12:41:41.364008305Z" level=info msg="Starting /v1, Kind=Endpoints controller" | |
| time="2021-01-19T12:41:41.363949898Z" level=info msg="Starting /v1, Kind=Pod controller" | |
| time="2021-01-19T12:41:41.707952007Z" level=info msg="Active TLS secret k3s-serving (ver=305) (count 8): map[listener.cattle.io/cn-0.0.0.0:0.0.0.0 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-172.21.0.2:172.21.0.2 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/fingerprint:SHA1=61806F3530AB6B3BCCA787A3769B2E9903BF4F02]" | |
| time="2021-01-19T12:41:41.760006150Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log" | |
| time="2021-01-19T12:41:41.760125714Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd" | |
| time="2021-01-19T12:41:41.907034285Z" level=info msg="Waiting for control-plane node k3d-test-server-0 startup: nodes \"k3d-test-server-0\" not found" | |
| W0119 12:41:42.299150 7 handler_proxy.go:102] no RequestInfo found in the context | |
| E0119 12:41:42.299212 7 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable | |
| , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]] | |
| I0119 12:41:42.299228 7 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue. | |
| time="2021-01-19T12:41:42.762467512Z" level=info msg="Containerd is now running" | |
| time="2021-01-19T12:41:42.785066161Z" level=info msg="Connecting to proxy" url="wss://172.21.0.2:6443/v1-k3s/connect" | |
| time="2021-01-19T12:41:42.791007440Z" level=info msg="Handling backend connection request [k3d-test-server-0]" | |
| time="2021-01-19T12:41:42.791845669Z" level=warning msg="Disabling CPU quotas due to missing cpu.cfs_period_us" | |
| time="2021-01-19T12:41:42.791925935Z" level=warning msg="Disabling pod PIDs limit feature due to missing cgroup pids support" | |
| time="2021-01-19T12:41:42.792083641Z" level=info msg="Running kubelet --address=0.0.0.0 --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=cgroupfs --cgroups-per-qos=false --client-ca-file=/var/lib/rancher/k3s/agent/client-ca.crt --cloud-provider=external --cluster-dns=10.43.0.10 --cluster-domain=cluster.local --cni-bin-dir=/bin --cni-conf-dir=/var/lib/rancher/k3s/agent/etc/cni/net.d --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --container-runtime=remote --containerd=unix:///run/k3s/containerd/containerd.sock --cpu-cfs-quota=false --enforce-node-allocatable= --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --feature-gates=SupportPodPidsLimit=false --healthz-bind-address=127.0.0.1 --hostname-override=k3d-test-server-0 --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-labels= --pod-manifest-path=/var/lib/rancher/k3s/agent/pod-manifests --read-only-port=0 --resolv-conf=/tmp/k3s-resolv.conf --serialize-image-pulls=false --tls-cert-file=/var/lib/rancher/k3s/agent/serving-kubelet.crt --tls-private-key-file=/var/lib/rancher/k3s/agent/serving-kubelet.key" | |
| time="2021-01-19T12:41:42.795594179Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --healthz-bind-address=127.0.0.1 --hostname-override=k3d-test-server-0 --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables" | |
| Flag --cloud-provider has been deprecated, will be removed in 1.23, in favor of removing cloud provider code from Kubelet. | |
| Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed. | |
| W0119 12:41:42.799244 7 server.go:226] WARNING: all flags other than --config, --write-config-to, and --cleanup are deprecated. Please begin using a config file ASAP. | |
| F0119 12:41:42.800034 7 server.go:181] cannot set feature gate SupportPodPidsLimit to false, feature is locked to true | |
| goroutine 16698 [running]: | |
| github.com/rancher/k3s/vendor/k8s.io/klog/v2.stacks(0xc00012c001, 0xc00de38000, 0x7d, 0xdc) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:1026 +0xb9 | |
| github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).output(0x701b3e0, 0xc000000003, 0x0, 0x0, 0xc007817880, 0x6ccd412, 0x9, 0xb5, 0x40fb00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:975 +0x19b | |
| github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).printDepth(0x701b3e0, 0xc000000003, 0x0, 0x0, 0x0, 0x0, 0x1, 0xc018d2c5e0, 0x1, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:732 +0x16f | |
| github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).print(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:714 | |
| github.com/rancher/k3s/vendor/k8s.io/klog/v2.Fatal(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:1482 | |
| github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kubelet/app.NewKubeletCommand.func1(0xc018a7e000, 0xc00860ee00, 0x1f, 0x20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kubelet/app/server.go:181 +0x225 | |
| github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).execute(0xc018a7e000, 0xc00860ee00, 0x1f, 0x20, 0xc018a7e000, 0xc00860ee00) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:854 +0x2c2 | |
| github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc018a7e000, 0x1, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:958 +0x375 | |
| github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).Execute(...) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:895 | |
| github.com/rancher/k3s/pkg/daemons/executor.Embedded.Kubelet.func1(0xc018a7e000) | |
| /go/src/github.com/rancher/k3s/pkg/daemons/executor/embed.go:31 +0x2f | |
| created by github.com/rancher/k3s/pkg/daemons/executor.Embedded.Kubelet | |
| /go/src/github.com/rancher/k3s/pkg/daemons/executor/embed.go:30 +0x8d | |
| goroutine 1 [runnable]: | |
| os.(*File).Stat(0xc00a934038, 0x28, 0x0, 0x0, 0xc00a934038) | |
| /usr/local/go/src/os/stat_unix.go:15 +0x1a6 | |
| io/ioutil.ReadFile(0xc0190068a0, 0x28, 0x0, 0x0, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/io/ioutil/ioutil.go:62 +0xb3 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/transport.dataFromSliceOrFile(0x0, 0x0, 0x0, 0xc0190068a0, 0x28, 0x4d1323a, 0xc009d0ff15, 0xc0059bdb20, 0x5238fa, 0x4) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/transport/transport.go:168 +0x50 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/transport.loadTLSFiles(0xc00a0a6160, 0xc009d0ff08, 0xe) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/transport/transport.go:139 +0x57 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/transport.tlsConfigKey(0xc00a0a6160, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/transport/cache.go:132 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/transport.(*tlsTransportCache).get(0x7005fe0, 0xc00a0a6160, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/transport/cache.go:64 +0x85 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/transport.New(0xc00a0a6160, 0xc00a0a6160, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/transport/transport.go:49 +0x12c | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/rest.TransportFor(0xc0059be020, 0xc009601b90, 0xc009d02020, 0x1c, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/rest/transport.go:47 +0x6a | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/rest.RESTClientFor(0xc0059be020, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/rest/config.go:319 +0x9f | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/kubernetes/typed/storage/v1beta1.NewForConfig(0xc0059be290, 0xc018bd60a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/kubernetes/typed/storage/v1beta1/storage_client.go:62 +0xa6 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/kubernetes.NewForConfig(0xc00b4ac900, 0x0, 0xc011f16c00, 0x2d) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/kubernetes/clientset.go:564 +0xaa9 | |
| github.com/rancher/k3s/pkg/agent.coreClient(0xc011f16c00, 0x2d, 0x0, 0x4d5b360, 0xc008b1f220, 0x0) | |
| /go/src/github.com/rancher/k3s/pkg/agent/run.go:131 +0x7e | |
| github.com/rancher/k3s/pkg/agent.run(0x4d56da0, 0xc0012a7200, 0xc005670480, 0x5e, 0x0, 0x0, 0x0, 0x0, 0xc001d11740, 0x16, ...) | |
| /go/src/github.com/rancher/k3s/pkg/agent/run.go:101 +0x1c5 | |
| github.com/rancher/k3s/pkg/agent.Run(0x4d56da0, 0xc0012a7200, 0xc005670480, 0x5e, 0x0, 0x0, 0x0, 0x0, 0xc001d11740, 0x16, ...) | |
| /go/src/github.com/rancher/k3s/pkg/agent/run.go:172 +0x438 | |
| github.com/rancher/k3s/pkg/cli/server.run(0xc0010098c0, 0x701c2a0, 0xc00155eea8, 0x48) | |
| /go/src/github.com/rancher/k3s/pkg/cli/server/server.go:283 +0x1778 | |
| github.com/rancher/k3s/pkg/cli/server.Run(0xc0010098c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/pkg/cli/server/server.go:38 +0x65 | |
| github.com/rancher/k3s/vendor/github.com/urfave/cli.HandleAction(0x3e6e640, 0x47ba8e8, 0xc0010098c0, 0xc0010098c0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/urfave/cli/app.go:523 +0xfd | |
| github.com/rancher/k3s/vendor/github.com/urfave/cli.Command.Run(0x45b382b, 0x6, 0x0, 0x0, 0x0, 0x0, 0x0, 0x45e7adb, 0x15, 0xc0012944a0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/urfave/cli/command.go:174 +0x58e | |
| github.com/rancher/k3s/vendor/github.com/urfave/cli.(*App).Run(0xc000f068c0, 0xc0003b5040, 0x4, 0x4, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/urfave/cli/app.go:276 +0x7d4 | |
| main.main() | |
| /go/src/github.com/rancher/k3s/cmd/server/main.go:47 +0x61a | |
| goroutine 21 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/klog/v2.(*loggingT).flushDaemon(0x701b3e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:1169 +0x8b | |
| created by github.com/rancher/k3s/vendor/k8s.io/klog/v2.init.0 | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/v2/klog.go:417 +0xdf | |
| goroutine 6 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/klog.(*loggingT).flushDaemon(0x701b120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/klog.go:1010 +0x8b | |
| created by github.com/rancher/k3s/vendor/k8s.io/klog.init.0 | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/klog/klog.go:411 +0xd8 | |
| goroutine 576 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000d4c340, 0xc0013df980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 363 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000e030b0, 0x4c9d560, 0xc0011e2900, 0x1, 0xc00120cc00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000e030b0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00120cc00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 176 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000114550, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000249920, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000f44600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 110 [sleep]: | |
| time.Sleep(0x3b9aca00) | |
| /usr/local/go/src/runtime/time.go:188 +0xbf | |
| github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime.(*metricsRecorder).run(0xc00092b920) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime/metrics_recorder.go:88 +0x3f | |
| created by github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime.newMetricsRecorder | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/pkg/scheduler/framework/runtime/metrics_recorder.go:60 +0x108 | |
| goroutine 138 [chan receive]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000d7f400) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:173 +0x3b3 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.NewMergeLogger | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:91 +0x85 | |
| goroutine 208 [chan receive]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc00127f4c0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:173 +0x3b3 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.NewMergeLogger | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:91 +0x85 | |
| goroutine 211 [chan receive]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc00127f660) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:173 +0x3b3 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil.NewMergeLogger | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/pkg/logutil/merge_logger.go:91 +0x85 | |
| goroutine 218 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals.SetupSignalHandler.func1(0xc001245d40, 0xc000a19330) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals/signal.go:37 +0x34 | |
| created by github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals.SetupSignalHandler | |
| /go/src/github.com/rancher/k3s/vendor/github.com/rancher/wrangler/pkg/signals/signal.go:36 +0xe8 | |
| goroutine 170 [syscall]: | |
| os/signal.signal_recv(0x0) | |
| /usr/local/go/src/runtime/sigqueue.go:147 +0x9d | |
| os/signal.loop() | |
| /usr/local/go/src/os/signal/signal_unix.go:23 +0x25 | |
| created by os/signal.Notify.func1.1 | |
| /usr/local/go/src/os/signal/signal.go:150 +0x45 | |
| goroutine 219 [select]: | |
| database/sql.(*DB).connectionOpener(0xc00149ef70, 0x4d56da0, 0xc0010c0400) | |
| /usr/local/go/src/database/sql/sql.go:1126 +0xf5 | |
| created by database/sql.OpenDB | |
| /usr/local/go/src/database/sql/sql.go:740 +0x12a | |
| goroutine 386 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac970, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001274218, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001274200, 0xc00154e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001274200, 0xc00154e000, 0x8000, 0x8000, 0x203004, 0x800000601, 0xc000000000) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da070, 0xc00154e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0008667e0, 0xc0010fa3b8, 0x9, 0x9, 0xc00154e016, 0x10000c0035b6000, 0x7f91b10d3d48) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0008667e0, 0xc0010fa3b8, 0x9, 0x9, 0x9, 0x6006d384, 0xc0000a6dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fa3b8, 0x9, 0x9, 0x4c98f60, 0xc0008667e0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fa380, 0xc003a7a060, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000f44600, 0xc000ce2540, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000f44600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000f44600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 223 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).ttl(0xc0012c70f0, 0x4d56da0, 0xc0012a7200) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:304 +0xdd | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:42 +0x1d5 | |
| goroutine 189 [semacquire]: | |
| sync.runtime_Semacquire(0xc000ae90b8) | |
| /usr/local/go/src/runtime/sema.go:56 +0x45 | |
| sync.(*WaitGroup).Wait(0xc000ae90b0) | |
| /usr/local/go/src/sync/waitgroup.go:130 +0x65 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).ttlEvents.func1(0xc000ae90b0, 0xc000c8dd40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:264 +0x2b | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).ttlEvents | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:263 +0x9c | |
| goroutine 250 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000b76b60, 0xc000ae8220) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 191 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).ttlEvents.func3(0xc000ae90b0, 0xc0012c70f0, 0x4d56da0, 0xc0012a7200, 0xc000c8dd40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:289 +0x12a | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).ttlEvents | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:287 +0x130 | |
| goroutine 365 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001d24dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 224 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ad0b0, 0x72, 0x0) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2198, 0x72, 0x0, 0x0, 0x45b5276) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Accept(0xc0010f2180, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:394 +0x1fc | |
| net.(*netFD).accept(0xc0010f2180, 0xc00a539050, 0x0, 0x0) | |
| /usr/local/go/src/net/fd_unix.go:172 +0x45 | |
| net.(*UnixListener).accept(0xc00129d410, 0xc000f31e38, 0xc000f31e40, 0x18) | |
| /usr/local/go/src/net/unixsock_posix.go:162 +0x32 | |
| net.(*UnixListener).Accept(0xc00129d410, 0x47bf570, 0xc000703500, 0x4d87680, 0xc00a539050) | |
| /usr/local/go/src/net/unixsock.go:260 +0x65 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).Serve(0xc000703500, 0x4d37b60, 0xc00129d410, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:597 +0x216 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/endpoint.Listen.func1(0xc000703500, 0x4d37b60, 0xc00129d410, 0x4d56da0, 0xc0012a7200) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/endpoint/endpoint.go:80 +0x45 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/endpoint.Listen | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/endpoint/endpoint.go:79 +0x2e5 | |
| goroutine 364 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001cf7800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 229 [select]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).compactor(0xc0010c0680, 0x45d964b800) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:133 +0x325 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).startWatch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:380 +0x10c | |
| goroutine 230 [select]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).poll(0xc0010c0680, 0xc000c8dec0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:399 +0xe65 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).startWatch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:381 +0x145 | |
| goroutine 231 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).stream(0xc0010c0690, 0xc000c8dec0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:64 +0x105 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:58 +0x79 | |
| goroutine 232 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc0012a7200, 0xc0010c0690, 0xc001332180) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 233 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001245f80, 0xc001332180, 0xc001332101, 0x45acbd6, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 5119 [sync.Cond.Wait]: | |
| runtime.goparkunlock(...) | |
| /usr/local/go/src/runtime/proc.go:312 | |
| sync.runtime_notifyListWait(0xc00116a510, 0xc00000000b) | |
| /usr/local/go/src/runtime/sema.go:513 +0xf8 | |
| sync.(*Cond).Wait(0xc00116a500) | |
| /usr/local/go/src/sync/cond.go:56 +0x9d | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).Get(0xc000d316e0, 0x0, 0x0, 0x432f100) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:145 +0x89 | |
| github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver.(*DiscoveryController).processNextWorkItem(0xc00116a540, 0x203000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver/customresource_discovery_controller.go:254 +0x66 | |
| github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver.(*DiscoveryController).runWorker(0xc00116a540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver/customresource_discovery_controller.go:248 +0x2b | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00abb76d0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00abb76d0, 0x4c9d560, 0xc00a685590, 0x1, 0xc0090b20c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00abb76d0, 0x3b9aca00, 0x0, 0x47c7e01, 0xc0090b20c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc00abb76d0, 0x3b9aca00, 0xc0090b20c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver.(*DiscoveryController).Run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiextensions-apiserver/pkg/apiserver/customresource_discovery_controller.go:242 +0x2a5 | |
| goroutine 238 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14acfc8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001274618, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001274600, 0xc00134a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001274600, 0xc00134a000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8e30, 0xc00134a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001332540, 0xc0001a88f8, 0x9, 0x9, 0xc00134a009, 0xc000288000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001332540, 0xc0001a88f8, 0x9, 0x9, 0x9, 0x317842126f6, 0xc0000a4e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a88f8, 0x9, 0x9, 0x4c98f60, 0xc001332540, 0x0, 0x0, 0x7019220, 0xf824) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a88c0, 0xc0011da220, 0xc0011da220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000f06a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 177 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000f44600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 239 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0013460f0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0013326c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000f06a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 225 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0010c0b80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 258 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0010f6000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 269 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server.preparedGenericAPIServer.Run(0xc0082cc600, 0xc0012c2360, 0x4ca4ac0, 0xc0082cc600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/genericapiserver.go:344 +0xc5 | |
| github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver.preparedAPIAggregator.Run(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/kube-aggregator/pkg/apiserver/apiserver.go:358 | |
| github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app.Run(0xc0002f6840, 0xc0012c2360, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app/server.go:208 +0x1c8 | |
| github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app.NewAPIServerCommand.func2(0xc0002f6b00, 0xc0002fb400, 0x0, 0x1f, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/kubernetes/cmd/kube-apiserver/app/server.go:150 +0x13e | |
| github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).execute(0xc0002f6b00, 0xc0002fa200, 0x1f, 0x20, 0xc0002f6b00, 0xc0002fa200) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:850 +0x47c | |
| github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).ExecuteC(0xc0002f6b00, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:958 +0x375 | |
| github.com/rancher/k3s/vendor/github.com/spf13/cobra.(*Command).Execute(...) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/spf13/cobra/command.go:895 | |
| github.com/rancher/k3s/pkg/daemons/executor.Embedded.APIServer.func1(0xc0002f6b00) | |
| /go/src/github.com/rancher/k3s/pkg/daemons/executor/embed.go:54 +0x2f | |
| created by github.com/rancher/k3s/pkg/daemons/executor.Embedded.APIServer | |
| /go/src/github.com/rancher/k3s/pkg/daemons/executor/embed.go:53 +0xaf | |
| goroutine 362 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001eb8620, 0xbff9d2bfd1531105, 0x54c3898d, 0x7019220, 0x4d01ae0, 0xc0006640d0, 0xc001d2bbc0, 0xc00075e4e0, 0xc00120c480, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001eb8620, 0xc00120c480, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc001738160, 0xc00120c480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000f4ff88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001d2bf88, 0x4c9d560, 0xc000a669c0, 0x1, 0xc00120c480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000f4ff88, 0x3b9aca00, 0x0, 0x1, 0xc00120c480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc001738160, 0xc00120c480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 251 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0011d41f0, 0x4cf5ce0, 0xc00116a200) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 261 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000511130, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000638060, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000703c80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 262 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000703c80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 263 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14acee0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2518, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f2500, 0xc0014b4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f2500, 0xc0014b4000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010260, 0xc0014b4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0010dacc0, 0xc0010fa038, 0x9, 0x9, 0xc0014b4016, 0x10000c000288000, 0x7f91b10c23f0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0010dacc0, 0xc0010fa038, 0x9, 0x9, 0x9, 0x6006d37e, 0xc0010bddd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fa038, 0x9, 0x9, 0x4c98f60, 0xc0010dacc0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fa000, 0xc0011da0e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000703c80, 0xc00129db30, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000703c80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000703c80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 361 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc001738160) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 430 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252dd0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0002f4218, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0002f4200, 0xc001516000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0002f4200, 0xc001516000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0006fc020, 0xc001516000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000112660, 0xc0006fe038, 0x9, 0x9, 0xc001516016, 0x10000c00009ac00, 0x7f91b0361388) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000112660, 0xc0006fe038, 0x9, 0x9, 0x9, 0x6006d385, 0xc0006fbdd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006fe038, 0x9, 0x9, 0x4c98f60, 0xc000112660, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006fe000, 0xc007a6b0c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00069e000, 0xc0010854d0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00069e000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00069e000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 270 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0008d9020) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 241 [sleep]: | |
| time.Sleep(0x6fc23ac00) | |
| /usr/local/go/src/runtime/time.go:188 +0xbf | |
| github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.(*listener).WrapExpiration.func1(0xc0004498c0, 0x5a, 0x4d56da0, 0xc0010c0880) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/listener.go:156 +0x45 | |
| created by github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.(*listener).WrapExpiration | |
| /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/listener.go:155 +0x87 | |
| goroutine 274 [select]: | |
| io.(*pipe).Read(0xc0010da5a0, 0xc0007eb171, 0xe8f, 0xe8f, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/io/pipe.go:57 +0xe7 | |
| io.(*PipeReader).Read(0xc000010128, 0xc0007eb171, 0xe8f, 0xe8f, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/io/pipe.go:134 +0x4c | |
| bufio.(*Scanner).Scan(0xc012263f38, 0x1) | |
| /usr/local/go/src/bufio/scan.go:214 +0xa9 | |
| github.com/rancher/k3s/vendor/github.com/sirupsen/logrus.(*Entry).writerScanner(0xc0010ea150, 0xc000010128, 0xc000d03ce0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/sirupsen/logrus/writer.go:59 +0xb4 | |
| created by github.com/rancher/k3s/vendor/github.com/sirupsen/logrus.(*Entry).WriterLevel | |
| /go/src/github.com/rancher/k3s/vendor/github.com/sirupsen/logrus/writer.go:51 +0x1b7 | |
| goroutine 275 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14acdf8, 0x72, 0x0) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2018, 0x72, 0x0, 0x0, 0x45b5276) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Accept(0xc0010f2000, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:394 +0x1fc | |
| net.(*netFD).accept(0xc0010f2000, 0x45acbde, 0x1, 0x7f91b11473f0) | |
| /usr/local/go/src/net/fd_unix.go:172 +0x45 | |
| net.(*TCPListener).accept(0xc000a38f20, 0x8, 0xc0010bbb60, 0x332977e) | |
| /usr/local/go/src/net/tcpsock_posix.go:139 +0x32 | |
| net.(*TCPListener).AcceptTCP(0xc000a38f20, 0x0, 0xc0004498c0, 0x203006) | |
| /usr/local/go/src/net/tcpsock.go:248 +0x65 | |
| github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.tcpKeepAliveListener.Accept(0xc000a38f20, 0xc018f8e030, 0x1, 0x1, 0xc0010bbd90) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/tcp.go:31 +0x2f | |
| github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener.(*listener).Accept(0xc0004498c0, 0x0, 0xc0010bbe00, 0x46f37b, 0x3195c8695ba) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/rancher/dynamiclistener/listener.go:232 +0x7b | |
| crypto/tls.(*listener).Accept(0xc000a39f60, 0xc0010bbe78, 0x18, 0xc0018a0900, 0x8daf0c) | |
| /usr/local/go/src/crypto/tls/tls.go:67 +0x37 | |
| net/http.(*Server).Serve(0xc0010fa1c0, 0x4d14ba0, 0xc000a39f60, 0x0, 0x0) | |
| /usr/local/go/src/net/http/server.go:2937 +0x266 | |
| github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS.func1(0xc0010fa1c0, 0x4d14ba0, 0xc000a39f60) | |
| /go/src/github.com/rancher/k3s/pkg/cluster/https.go:80 +0x45 | |
| created by github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS | |
| /go/src/github.com/rancher/k3s/pkg/cluster/https.go:79 +0x287 | |
| goroutine 276 [chan receive]: | |
| github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS.func2(0x4d56da0, 0xc0012a7200, 0xc0010fa1c0) | |
| /go/src/github.com/rancher/k3s/pkg/cluster/https.go:86 +0x48 | |
| created by github.com/rancher/k3s/pkg/cluster.(*Cluster).initClusterAndHTTPS | |
| /go/src/github.com/rancher/k3s/pkg/cluster/https.go:85 +0x2c6 | |
| goroutine 13215 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*controller).Run.func1(0xc0012c2360, 0xc00678b8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/controller.go:130 +0x34 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*controller).Run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/controller.go:129 +0xa5 | |
| goroutine 382 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005e40f0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0008674a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0014ae600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 4002 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicFileCAContent).Run(0xc000638360, 0x1, 0xc0090b2180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/dynamic_cafile_content.go:181 +0x313 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.unionCAContent.Run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/union_content.go:104 +0xcb | |
| goroutine 271 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0008d91a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 3825 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicFileCAContent).Run(0xc0008d9ce0, 0x1, 0xc0090b2180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/dynamic_cafile_content.go:181 +0x313 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.unionCAContent.Run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/union_content.go:104 +0xcb | |
| goroutine 3988 [sync.Cond.Wait]: | |
| runtime.goparkunlock(...) | |
| /usr/local/go/src/runtime/proc.go:312 | |
| sync.runtime_notifyListWait(0xc00089b310, 0xc000000000) | |
| /usr/local/go/src/runtime/sema.go:513 +0xf8 | |
| sync.(*Cond).Wait(0xc00089b300) | |
| /usr/local/go/src/sync/cond.go:56 +0x9d | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).Get(0xc0008d9b00, 0x0, 0x0, 0x3e2f300) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:145 +0x89 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicFileCAContent).processNextWorkItem(0xc0008d9ce0, 0x203000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/dynamic_cafile_content.go:190 +0x66 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicFileCAContent).runWorker(0xc0008d9ce0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/dynamic_cafile_content.go:185 +0x2b | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00fe38040) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00fe38040, 0x4c9d560, 0xc00dee0000, 0x1, 0xc0090b2180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00fe38040, 0x3b9aca00, 0x0, 0x47c7e01, 0xc0090b2180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(0xc00fe38040, 0x3b9aca00, 0xc0090b2180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 +0x4d | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates.(*DynamicFileCAContent).Run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/server/dynamiccertificates/dynamic_cafile_content.go:171 +0x28b | |
| goroutine 285 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0008d9b00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 286 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0008d9c80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 287 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0008d9e00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 288 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0008d9f80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 10616 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*processorListener).pop(0xc00b7c6500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/shared_informer.go:742 +0x157 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start.func1(0xc0037c03e0, 0xc00a4e7d20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:73 +0x51 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.(*Group).Start | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:71 +0x65 | |
| goroutine 291 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000f246c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 292 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000f24780) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 293 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000f24960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 297 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000f24de0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 298 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000f24f00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 299 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000f25020) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 300 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000f25140) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 301 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc00075f500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 336 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00052b040) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 337 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0003782c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 338 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000f06540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 339 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14acc28, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00063a998, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00063a980, 0xc00151e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00063a980, 0xc00151e000, 0x8000, 0x8000, 0x94a93e, 0x10401, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e9340, 0xc00151e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0002496e0, 0xc0001a8d58, 0x9, 0x9, 0x9, 0xc000600000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0002496e0, 0xc0001a8d58, 0x9, 0x9, 0x9, 0x91cbb0, 0xc0010853b0, 0xc001080004) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a8d58, 0x9, 0x9, 0x4c98f60, 0xc0002496e0, 0x0, 0x0, 0xc0010853b0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a8d20, 0xc0010853b0, 0x7019200, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000f06540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 340 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005e42d0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000249800, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000f06540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 370 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005102d0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0008665a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0018a1380) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 371 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0018a1380) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 372 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14acb40, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc000598518, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc000598500, 0xc001536000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc000598500, 0xc001536000, 0x8000, 0x8000, 0x94a93e, 0x10401, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000286070, 0xc001536000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0010da960, 0xc001e7e038, 0x9, 0x9, 0x9, 0xc000100000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0010da960, 0xc001e7e038, 0x9, 0x9, 0x9, 0x91cbb0, 0xc001144150, 0xc001140004) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001e7e038, 0x9, 0x9, 0x4c98f60, 0xc0010da960, 0x0, 0x0, 0xc001144150, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001e7e000, 0xc001144150, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0018a1380, 0xc001144120, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0018a1380) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0018a1380) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 353 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000d316e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 58 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.compactor(0x4d56da0, 0xc0006361c0, 0xc00107cd00, 0x45d964b800) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/compact.go:116 +0x112 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.StartCompactor | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/compact.go:63 +0x1a8 | |
| goroutine 59 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000636400) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 60 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0005e8580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 61 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000756700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 62 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14aca58, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2498, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f2480, 0xc001ea0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f2480, 0xc001ea0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010250, 0xc001ea0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001612ba0, 0xc001eb8038, 0x9, 0x9, 0xc001ea0009, 0xc001ce4c00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001612ba0, 0xc001eb8038, 0x9, 0x9, 0x9, 0x318dd4ace7d, 0xc001511e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001eb8038, 0x9, 0x9, 0x4c98f60, 0xc001612ba0, 0x0, 0x100000000, 0x7019220, 0x10efe) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001eb8000, 0xc000b23a60, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000756700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 63 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000284d20, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001612cc0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000756700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 247 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001eb80e0, 0xc000e1d200, 0xc000f6a000, 0xc000280960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 65 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001907f80, 0x4c9d560, 0xc001144180, 0xc000636701, 0xc0013dede0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001337780, 0x6fc23ac00, 0x3fe0000000000000, 0x1, 0xc0013dede0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntilWithContext(0x4d56da0, 0xc000636740, 0xc0011a8ae0, 0x6fc23ac00, 0x3fe0000000000000, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:185 +0xa6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/storagebackend/factory.startDBSizeMonitorPerEndpoint | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/storagebackend/factory/etcd3.go:277 +0x3e6 | |
| goroutine 538 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0006640d0, 0xc001ceb020) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 685 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14336a0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0013e8018, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0013e8000, 0xc001c12000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0013e8000, 0xc001c12000, 0x8000, 0x8000, 0x203006, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0002864e0, 0xc001c12000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001613d40, 0xc0013dc1f8, 0x9, 0x9, 0xc001c12016, 0x10000c001ce4c00, 0x7f91b02bf198) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001613d40, 0xc0013dc1f8, 0x9, 0x9, 0x9, 0x6006d385, 0xc001272dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dc1f8, 0x9, 0x9, 0x4c98f60, 0xc001613d40, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dc1c0, 0xc0067872e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000c4ef00, 0xc00100f440, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000c4ef00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000c4ef00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 973 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0018f8b60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 853 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0018f8000, 0xc000fc47b0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 456 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001eb82a0, 0xc000c8c000, 0xc000f6a8a0, 0xc000281f80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 595 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0010f8580) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 379 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000510e10, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0010dbaa0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000430480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 402 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000077f80, 0xc000e1d200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 380 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000430480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 403 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc001e9a2c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 404 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001eb80e0, 0xbff9d2bfd0433aed, 0x53b3b36f, 0x7019220, 0x4d01ae0, 0xc000b76b60, 0xc0018b9bc0, 0xc000280960, 0xc000e1d200, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001eb80e0, 0xc000e1d200, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc001e9a2c0, 0xc000e1d200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001ec1788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0018b9f88, 0x4c9d560, 0xc0011e2030, 0x1, 0xc000e1d200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001ec1788, 0x3b9aca00, 0x0, 0x1, 0xc000e1d200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc001e9a2c0, 0xc000e1d200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 405 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0011a9bf0, 0x4c9d560, 0xc001085710, 0x1, 0xc000e1d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0011a9bf0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000e1d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 406 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000636bc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 407 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001ec2580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 408 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0007568c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 409 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac7a0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2998, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f2980, 0xc001edc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f2980, 0xc001edc000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010728, 0xc001edc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001613260, 0xc001eb81f8, 0x9, 0x9, 0xc001edc009, 0xc00009ac00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001613260, 0xc001eb81f8, 0x9, 0x9, 0x9, 0x3188400affa, 0xc001900e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001eb81f8, 0x9, 0x9, 0x4c98f60, 0xc001613260, 0x0, 0x100000000, 0x7019220, 0x3aa8) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001eb81c0, 0xc0066ca500, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0007568c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 410 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0002855e0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001613320, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0007568c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 381 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac888, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001274598, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001274580, 0xc00173c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001274580, 0xc00173c000, 0x8000, 0x8000, 0x203004, 0x7f91b02cbdc0, 0x7f) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da0d8, 0xc00173c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0010dba40, 0xc001e7e1f8, 0x9, 0x9, 0xc00173c016, 0x10000c00009ac00, 0x7f91b03b9fa8) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0010dba40, 0xc001e7e1f8, 0x9, 0x9, 0x9, 0x6006d383, 0xc001515dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001e7e1f8, 0x9, 0x9, 0x4c98f60, 0xc0010dba40, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001e7e1c0, 0xc0066ca4e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000430480, 0xc001144ff0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000430480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000430480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 594 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0014a89e0, 0xc00117d6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 412 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000868740, 0xc000c8c000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 413 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc001e9a6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 414 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001eb82a0, 0xbff9d2bfd04e1d1e, 0x53be95a0, 0x7019220, 0x4d01ae0, 0xc0012de0d0, 0xc000f77bc0, 0xc000281f80, 0xc000c8c000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001eb82a0, 0xc000c8c000, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc001e9a6e0, 0xc000c8c000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001ebdf88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000f77f88, 0x4c9d560, 0xc000ce2f90, 0x1, 0xc000c8c000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001ebdf88, 0x3b9aca00, 0x0, 0x1, 0xc000c8c000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc001e9a6e0, 0xc000c8c000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 415 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0012326f0, 0x4c9d560, 0xc00140c060, 0x1, 0xc000c8c060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0012326f0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000c8c060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 667 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00069e180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 249 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000b76b60, 0xc000f6a060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 360 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000696620, 0xc00120c480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 481 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc00050ed20, 0xc00050ed80, 0xc00050ed01, 0xc0006170e0, 0x17) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 384 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac5d0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00057a998, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00057a980, 0xc0014c8000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00057a980, 0xc0014c8000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010048, 0xc0014c8000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0010dbec0, 0xc001e7e118, 0x9, 0x9, 0xc0014c8016, 0x10000c000dc9400, 0x7f91b03a2980) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0010dbec0, 0xc001e7e118, 0x9, 0x9, 0x9, 0x6006d382, 0xc001755dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001e7e118, 0x9, 0x9, 0x4c98f60, 0xc0010dbec0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001e7e0e0, 0xc00650d180, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0014ae600, 0xc000ce21b0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0014ae600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0014ae600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 383 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0014ae600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 248 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000b76b60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 668 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b12524c0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0002f4e98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0002f4e80, 0xc001b80000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0002f4e80, 0xc001b80000, 0x8000, 0x8000, 0x203006, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0006fc080, 0xc001b80000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0012441e0, 0xc0006fe118, 0x9, 0x9, 0xc001b80027, 0x10000c001ce4c00, 0x7f91b114c688) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0012441e0, 0xc0006fe118, 0x9, 0x9, 0x9, 0x6006d386, 0xc0018d9dd0, 0x4c21a3d) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006fe118, 0x9, 0x9, 0x4c98f60, 0xc0012441e0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006fe0e0, 0xc009d63900, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00069e180, 0xc0006da240, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00069e180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00069e180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1172 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00069e900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 482 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000d31860) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 1044 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000e210e0, 0xc0009ef9d0, 0x5, 0x5, 0xc0068e71e0, 0x0, 0x160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000e210e0, 0xc0009ef9d0, 0x5, 0x5, 0xc0019ee040, 0x47c8228, 0xc002510960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0010e4de0, 0xc0009ef9d0, 0x5, 0x5, 0x18e, 0xc002510988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0010e4de0, 0xc0009ef9d0, 0x5, 0x5, 0x5, 0xc00efc6260, 0xc00689e68a, 0x18e) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0011f8200, 0xc0009ef9d0, 0x5, 0x5, 0x198, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0009ef9c0, 0x7fffffff, 0xc00689e680, 0x198, 0x198, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0009ef9c0, 0xc0011f8200, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00689e601, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0009ef9c0, 0x7f91b11abcb8, 0x70524e8, 0xc0011f8200, 0x0, 0x0, 0x4408c80, 0xc007bb8a50, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001150f80, 0x4408c80, 0xc007bb8a50, 0x0, 0xc002510d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001150f80, 0xc002510d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0009c1d40, 0xc002510e10, 0xc002510de0, 0x44bbff, 0xc00160e000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0009c1d40, 0x4408c80, 0xc007bb8a50, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0009ef9e0, 0x4408c80, 0xc007bb8a50, 0xc002510ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc000d32050, 0xc002510ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0018f8c30, 0x4d854c0, 0xc000d32050) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 356 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc00042f7a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 252 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000b77930) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 255 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00108a0f0, 0xc000ff24d0, 0x5, 0x5, 0xc00c7a8000, 0x0, 0x800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00108a0f0, 0xc000ff24d0, 0x5, 0x5, 0xc00049e4a0, 0x47c8228, 0xc001759960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000f62540, 0xc000ff24d0, 0x5, 0x5, 0x7c6, 0xc001759988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000f62540, 0xc000ff24d0, 0x5, 0x5, 0x5, 0xc010162a60, 0xc00c3fb00a, 0xf26) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7c100, 0xc000ff24d0, 0x5, 0x5, 0xf30, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000ff24c0, 0x7fffffff, 0xc00c3fb000, 0xf30, 0xf30, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000ff24c0, 0xc000f7c100, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00c3fb001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000ff24c0, 0x7f91b11abcb8, 0x70524e8, 0xc000f7c100, 0x0, 0x0, 0x4408c80, 0xc007dadcc0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc000408400, 0x4408c80, 0xc007dadcc0, 0x0, 0xc001759d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc000408400, 0xc001759d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000760360, 0xc001759e10, 0xc001759de0, 0x44bbff, 0xc000f6a120) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000760360, 0x4408c80, 0xc007dadcc0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc000ff24e0, 0x4408c80, 0xc007dadcc0, 0xc001759ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0011d4340, 0xc001759ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000b77930, 0x4d854c0, 0xc0011d4340) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 254 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc0010c8e00, 0xc000760360, 0x4d56e60, 0xc000f624b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 256 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000b77930, 0xc00087ad10, 0xc000f6a300) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 429 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00069e000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 257 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00108a280, 0xc000ff2750, 0x5, 0x5, 0x0, 0x0, 0xc000f6c300) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00108a280, 0xc000ff2750, 0x5, 0x5, 0xc00049e6a0, 0x47c8228, 0xc00175a778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000f627e0, 0xc000ff2750, 0x5, 0x5, 0xc000288000, 0xc00175a7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000f627e0, 0xc000ff2750, 0x5, 0x5, 0x5, 0x407fb80, 0xc000f60040, 0x7a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7c200, 0xc000ff2750, 0x5, 0x5, 0x0, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000ff2740, 0x400000, 0x40f230, 0xc000f66120, 0x90, 0x90, 0x4207f80, 0xc00175a970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000ff2740, 0xc000f7c200, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0011d44f0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000ff2740, 0x7f91b11abcb8, 0x70524e8, 0xc000f7c200, 0x0, 0x0, 0x437be20, 0xc0011d4500, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001908000, 0x437be20, 0xc0011d4500, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0011d44b0, 0x4d56da0, 0xc00116a440, 0xc00014c2a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0011d44b0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001908000, 0x70524e8, 0xc000f7c200) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc000f44600, 0xc000f7c200, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc000f44600, 0xc000f7c200, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00007ca60, 0xc000703500, 0x4d8a9e0, 0xc000f44600, 0xc000f7c200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 450 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00116a400, 0x1, 0x4d56da0, 0xc00116a440, 0xc000f6c340, 0x39, 0xc00014c2a0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 451 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00116a4c0, 0xc0010c0690, 0xc000281b60) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 452 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc000281b00, 0xc000281b60, 0xc000281b01, 0xc000f6c340, 0x39) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 523 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000d58b40, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00050e960, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0010fd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 854 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc000b50ad0, 0x4cf5ce0, 0xc0018ea4c0) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 457 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0012de0d0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 455 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc000281bc0, 0xc000281b00, 0xc0011d4550) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 852 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0018f8000, 0xc0018e4300) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 458 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0012de0d0, 0xc000f6a900) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 459 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0012de0d0, 0xc000ae8780) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 460 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0011d4710, 0x4cf5ce0, 0xc00116a700) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 461 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0012de1a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 464 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00108a500, 0xc000ff2bf0, 0x5, 0x5, 0xc00ca23800, 0x0, 0x800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00108a500, 0xc000ff2bf0, 0x5, 0x5, 0xc00049e800, 0x47c8228, 0xc00191b960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000f62cc0, 0xc000ff2bf0, 0x5, 0x5, 0x7c6, 0xc00191b988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000f62cc0, 0xc000ff2bf0, 0x5, 0x5, 0x5, 0xc01023ab20, 0xc00ca2b00a, 0xf26) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7c400, 0xc000ff2bf0, 0x5, 0x5, 0xf30, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000ff2be0, 0x7fffffff, 0xc00ca2b000, 0xf30, 0xf30, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000ff2be0, 0xc000f7c400, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00ca2b001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000ff2be0, 0x7f91b11abcb8, 0x70524e8, 0xc000f7c400, 0x0, 0x0, 0x4408c80, 0xc007df9f90, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc000408800, 0x4408c80, 0xc007df9f90, 0x0, 0xc00191bd20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc000408800, 0xc00191bd60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0007606c0, 0xc00191be10, 0xc00191bde0, 0x44bbff, 0xc000f6a9c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0007606c0, 0x4408c80, 0xc007df9f90, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc000ff2c00, 0x4408c80, 0xc007df9f90, 0xc00191bef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0011d47e0, 0xc00191bef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0012de1a0, 0x4d854c0, 0xc0011d47e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 463 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc0010c9500, 0xc0007606c0, 0x4d56e60, 0xc000f62c30) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 465 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0012de1a0, 0xc00087af20, 0xc000f6aba0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 466 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00108a690, 0xc000ff2e70, 0x5, 0x5, 0x0, 0x0, 0xc000f6c6c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00108a690, 0xc000ff2e70, 0x5, 0x5, 0xc00049e880, 0x47c8228, 0xc0006e4778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000f62e40, 0xc000ff2e70, 0x5, 0x5, 0xc00077e000, 0xc0006e47a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000f62e40, 0xc000ff2e70, 0x5, 0x5, 0x5, 0x407fb80, 0xc000f60080, 0x7a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7c500, 0xc000ff2e70, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000ff2e60, 0x400000, 0x40f230, 0xc000f663f0, 0x90, 0x90, 0x4207f80, 0xc0006e4970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000ff2e60, 0xc000f7c500, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0011d4900, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000ff2e60, 0x7f91b11abcb8, 0x70524e8, 0xc000f7c500, 0x0, 0x0, 0x437be20, 0xc0011d4910, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0019080c0, 0x437be20, 0xc0011d4910, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0011d48d0, 0x4d56da0, 0xc00116a940, 0xc00014c700) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0011d48d0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0019080c0, 0x70524e8, 0xc000f7c500) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc000430480, 0xc000f7c500, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc000430480, 0xc000f7c500, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc000936590, 0xc000703500, 0x4d8a9e0, 0xc000430480, 0xc000f7c500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 467 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00116a900, 0x2, 0x4d56da0, 0xc00116a940, 0xc000f6c700, 0x39, 0xc00014c700) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 468 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00116a9c0, 0xc0010c0690, 0xc00002dc20) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 469 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc00002dbc0, 0xc00002dc20, 0xc00002dc01, 0xc000f6c700, 0x39) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 855 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0018f80d0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 472 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc00002dc80, 0xc00002dbc0, 0xc0011d4950) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 473 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000d305a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 483 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000d31920) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 484 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000d31aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 485 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000d31b60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 486 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc000d31ce0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 487 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc000d31da0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 488 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0003ff140) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 489 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0003ff2c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 490 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0003ff5c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 491 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*Type).updateUnfinishedWorkLoop(0xc0003ff680) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:198 +0xac | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/queue.go:58 +0x135 | |
| goroutine 492 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.(*delayingType).waitingLoop(0xc0003ff8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:231 +0x405 | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue.newDelayingQueue | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/util/workqueue/delaying_queue.go:68 +0x185 | |
| goroutine 493 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00116b440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 494 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000f68b00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 495 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000f06000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 496 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac6b8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00063ae18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00063ae00, 0xc001a00000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00063ae00, 0xc001a00000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000f60300, 0xc001a00000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0003ffda0, 0xc0001a83b8, 0x9, 0x9, 0xc001a00009, 0xc000dc9400, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0003ffda0, 0xc0001a83b8, 0x9, 0x9, 0x9, 0x3185f816583, 0xc0006e5e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a83b8, 0x9, 0x9, 0x4c98f60, 0xc0003ffda0, 0x0, 0x100000000, 0x7019220, 0x1809d) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a8380, 0xc00650d1a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000f06000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 497 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00108ae10, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0003b0ae0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000f06000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 536 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001eb8620, 0xc00120c480, 0xc001ceafc0, 0xc00075e4e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 501 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000d88ec0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 502 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000379340) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 503 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000f076c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 504 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac4e8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00063b498, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00063b480, 0xc000626000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00063b480, 0xc000626000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000f60440, 0xc000626000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0008d9d40, 0xc0001a9a78, 0x9, 0x9, 0xc000626009, 0xc000100000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0008d9d40, 0xc0001a9a78, 0x9, 0x9, 0x9, 0x3179dcbd0cd, 0xc0006e6e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a9a78, 0x9, 0x9, 0x4c98f60, 0xc0008d9d40, 0x0, 0x0, 0x7019220, 0x4911) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a9a40, 0xc000697280, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000f076c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 505 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000e4a370, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000638420, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000f076c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 474 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000510910, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0008677a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0006c8180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 475 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0006c8180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 476 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac400, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00057ab18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00057ab00, 0xc001922000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00057ab00, 0xc001922000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010120, 0xc001922000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000867740, 0xc0010fa2d8, 0x9, 0x9, 0xc001922000, 0x10000c000100000, 0x7f91b10fa200) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000867740, 0xc0010fa2d8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc001512dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fa2d8, 0x9, 0x9, 0x4c98f60, 0xc000867740, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fa2a0, 0xc000697260, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0006c8180, 0xc0011e2330, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0006c8180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0006c8180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 507 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00140d140, 0x4c9d560, 0xc000aa2c90, 0x1, 0xc00064ea20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00140d140, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00064ea20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 508 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000d89580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 574 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001e7e2a0, 0xc00117d6e0, 0xc0013df920, 0xc00050f560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 480 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00052b380, 0xc0010c0690, 0xc00050ed80) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 478 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000510cd0, 0xc000a39410, 0x5, 0x5, 0x0, 0x0, 0xc000617060) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000510cd0, 0xc000a39410, 0x5, 0x5, 0xc000617020, 0x47c8228, 0xc001941778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0011e2e10, 0xc000a39410, 0x5, 0x5, 0xc00009a800, 0xc0019417a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0011e2e10, 0xc000a39410, 0x5, 0x5, 0x5, 0x7f91b13426d0, 0x0, 0x36) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d6200, 0xc000a39410, 0x5, 0x5, 0x3ffb940, 0x8, 0x2000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000a39400, 0x400000, 0x40f230, 0xc000640120, 0x90, 0x90, 0x4207f80, 0xc001941901) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000a39400, 0xc0013d6200, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc001ce9410, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000a39400, 0x7f91b11abcb8, 0x70524e8, 0xc0013d6200, 0x0, 0x0, 0x437be20, 0xc001ce9420, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc00065e0c0, 0x437be20, 0xc001ce9420, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc001ce93e0, 0x4d56da0, 0xc00052b300, 0xc001193650) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc001ce93e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc00065e0c0, 0x70524e8, 0xc0013d6200) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0006c8180, 0xc0013d6200, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0006c8180, 0xc0013d6200, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001496180, 0xc000703500, 0x4d8a9e0, 0xc0006c8180, 0xc0013d6200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 789 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0012df5f0, 0xc000a57980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 479 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00052b140, 0x3, 0x4d56da0, 0xc00052b300, 0xc0006170e0, 0x17, 0xc001193650) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 537 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0006640d0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 524 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0010fd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 539 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0006640d0, 0xc0008cecc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 366 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000756a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 367 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14ac318, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00057ae98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00057ae80, 0xc00066e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00057ae80, 0xc00066e000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0000103d0, 0xc00066e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000f24480, 0xc001eb9298, 0x9, 0x9, 0xc00066e009, 0xc000700000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000f24480, 0xc001eb9298, 0x9, 0x9, 0x9, 0x3179dd6fa7d, 0xc0006e8e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001eb9298, 0x9, 0x9, 0x4c98f60, 0xc000f24480, 0x0, 0x0, 0x7019220, 0x3f5e) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001eb9260, 0xc000617520, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000756a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 540 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc00106e550, 0x4cf5ce0, 0xc0010c0d40) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 368 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001cef720, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000f24ae0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000756a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 541 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0006641a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 544 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000114e10, 0xc00077cf30, 0x5, 0x5, 0x44b1b3, 0xc001ceb498, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000114e10, 0xc00077cf30, 0x5, 0x5, 0xc0005bb1a0, 0x47c8228, 0xc00193d960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000aa28a0, 0xc00077cf30, 0x5, 0x5, 0xc000100000, 0xc00193d988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000aa28a0, 0xc00077cf30, 0x5, 0x5, 0x5, 0xc000697220, 0xc000936772, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc001ce0c00, 0xc00077cf30, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00077cf20, 0x7fffffff, 0xc000936770, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00077cf20, 0xc001ce0c00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000936701, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00077cf20, 0x7f91b11abcb8, 0x70524e8, 0xc001ce0c00, 0x0, 0x0, 0x4408c80, 0xc001cef860, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc000599f00, 0x4408c80, 0xc001cef860, 0x0, 0xc00193dd20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc000599f00, 0xc00193dd60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000440120, 0xc00193de10, 0xc00193dde0, 0x44bbff, 0xc001ceb0e0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000440120, 0x4408c80, 0xc001cef860, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc00077cf40, 0x4408c80, 0xc001cef860, 0xc00193def4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc00106e610, 0xc00193def0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0006641a0, 0x4d854c0, 0xc00106e610) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 525 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1253340, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001274498, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001274480, 0xc000654000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001274480, 0xc000654000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c1b0, 0xc000654000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001612a20, 0xc0013dc038, 0x9, 0x9, 0xc000654016, 0x10000c000700000, 0x7f91b10d54a8) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001612a20, 0xc0013dc038, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0006e4dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dc038, 0x9, 0x9, 0x4c98f60, 0xc001612a20, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dc000, 0xc0006174a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0010fd500, 0xc00095ff80, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0010fd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0010fd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 543 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000f6f180, 0xc000440120, 0x4d56e60, 0xc000aa2300) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 545 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0006641a0, 0xc0004aedc0, 0xc001ceb2c0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 509 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0010f6840) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 510 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000f07880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 850 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001eb9420, 0xc000fbc600, 0xc0018e42a0, 0xc000073b00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 511 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1253258, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00063b818, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00063b800, 0xc0006ce000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00063b800, 0xc0006ce000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000f604f0, 0xc0006ce000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000638a20, 0xc0001a9b58, 0x9, 0x9, 0xc0006ce009, 0xc000100000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000638a20, 0xc0001a9b58, 0x9, 0x9, 0x9, 0x3179df5c907, 0xc0006e9e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a9b58, 0x9, 0x9, 0x4c98f60, 0xc000638a20, 0x0, 0x0, 0x7019220, 0x91c9) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a9b20, 0xc00078fa40, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000f07880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 512 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000e4a780, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000638ae0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000f07880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 564 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc00050ede0, 0xc00050ed20, 0xc001ce9460) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 578 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001cef900, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000638d20, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001005800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 579 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001005800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 580 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1253170, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00057b218, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00057b200, 0xc000676000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00057b200, 0xc000676000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0000103e0, 0xc000676000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000f24d80, 0xc001eb9378, 0x9, 0x9, 0xc000676027, 0x10000c000100000, 0x7f91b1244128) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000f24d80, 0xc001eb9378, 0x9, 0x9, 0x9, 0x6006d37f, 0xc001915dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001eb9378, 0x9, 0x9, 0x4c98f60, 0xc000f24d80, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001eb9340, 0xc00078fa20, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001005800, 0xc0009d65a0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc001005800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc001005800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 684 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000c4ef00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 976 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc000b51f70, 0x4cf5ce0, 0xc0018eb8c0) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 577 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000d4c340, 0xc000eb0390) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 428 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001346320, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0003e48a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00069e000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 683 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000d59310, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018fa060, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000c4ef00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 596 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001e7e2a0, 0xbff9d2bfd177fbfa, 0x54e8747f, 0x7019220, 0x4d01ae0, 0xc000d4c340, 0xc001949bc0, 0xc00050f560, 0xc00117d6e0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001e7e2a0, 0xc00117d6e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0010f8580, 0xc00117d6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000099f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001949f88, 0x4c9d560, 0xc0009ce660, 0x1, 0xc00117d6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000099f88, 0x3b9aca00, 0x0, 0x1, 0xc00117d6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0010f8580, 0xc00117d6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 597 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000ce3110, 0x4c9d560, 0xc00140da10, 0x1, 0xc00117d7a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000ce3110, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00117d7a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 598 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001122540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 599 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00177e580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 600 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00040cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 601 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1253088, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0002a0598, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0002a0580, 0xc000ee0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0002a0580, 0xc000ee0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8a30, 0xc000ee0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000248d20, 0xc001e7ef18, 0x9, 0x9, 0xc000ee0009, 0xc000dc9400, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000248d20, 0xc001e7ef18, 0x9, 0x9, 0x9, 0x318e5525bae, 0xc0006fae50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001e7ef18, 0x9, 0x9, 0x4c98f60, 0xc000248d20, 0x0, 0x100000000, 0x7019220, 0xafc1) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001e7eee0, 0xc006fe4180, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00040cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 602 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005e4910, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000248de0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00040cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 527 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000d58e10, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000f255c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0010fd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 528 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0010fd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 529 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252fa0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0000d7218, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0000d7200, 0xc000f1c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0000d7200, 0xc000f1c000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da1a0, 0xc000f1c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001613740, 0xc0013dc118, 0x9, 0x9, 0xc000f1c016, 0x10000c000dc9400, 0x7f91b09e0440) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001613740, 0xc0013dc118, 0x9, 0x9, 0x9, 0x6006d384, 0xc00193edd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dc118, 0x9, 0x9, 0x4c98f60, 0xc001613740, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dc0e0, 0xc006fe4160, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0010fd800, 0xc00100e480, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0010fd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0010fd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 582 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000697ca0, 0xc000fbc600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 583 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc001738dc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 584 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001eb9420, 0xbff9d2bfd1d9dbbb, 0x554a543e, 0x7019220, 0x4d01ae0, 0xc0018f8000, 0xc001731bc0, 0xc000073b00, 0xc000fbc600, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001eb9420, 0xc000fbc600, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc001738dc0, 0xc000fbc600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001d39788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001731f88, 0x4c9d560, 0xc0009cebd0, 0x75927b08ea716801, 0xc000fbc600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001d39788, 0x3b9aca00, 0x0, 0xaad13f1371e2f801, 0xc000fbc600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc001738dc0, 0xc000fbc600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 585 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0009d6f00, 0x4c9d560, 0xc001084750, 0x1, 0xc000fbc6c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0009d6f00, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000fbc6c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 790 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc000a463c0, 0x4cf5ce0, 0xc001bfc6c0) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 687 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000efcc00, 0x5, 0x4d56da0, 0xc000efcc40, 0xc001d10ca0, 0x1c, 0xc00074c700) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 748 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001efeb40, 0x4c9d560, 0xc0006da420, 0x1, 0xc000e1d500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001efeb40, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000e1d500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 586 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc00089a340) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 587 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0005ec2c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 575 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000d4c340) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 588 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000757880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 589 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252eb8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00057b618, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00057b600, 0xc0012ce000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00057b600, 0xc0012ce000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010570, 0xc0012ce000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000f25e60, 0xc00061c118, 0x9, 0x9, 0xc0012ce009, 0xc00009ac00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000f25e60, 0xc00061c118, 0x9, 0x9, 0x9, 0x3191c4056ea, 0xc00126ee50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061c118, 0x9, 0x9, 0x4c98f60, 0xc000f25e60, 0x0, 0x100000000, 0x7019220, 0x14fc8) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061c0e0, 0xc007a6b0e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000757880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 590 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001cefef0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000f25f80, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000757880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 729 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001e7efc0, 0xc001ef62a0, 0xc0006341e0, 0xc0003e5b00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 604 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0014a8d00, 0xc001ef62a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 605 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0010f8c60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 606 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001e7efc0, 0xbff9d2bfd1de376f, 0x554eaff7, 0x7019220, 0x4d01ae0, 0xc0006329c0, 0xc001263bc0, 0xc0003e5b00, 0xc001ef62a0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001e7efc0, 0xc001ef62a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0010f8c60, 0xc001ef62a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001d36788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001263f88, 0x4c9d560, 0xc00198e150, 0x4f61a052ee2fef01, 0xc001ef62a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001d36788, 0x3b9aca00, 0x0, 0x3767f3b6c591c801, 0xc001ef62a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0010f8c60, 0xc001ef62a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 607 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0011a9290, 0x4c9d560, 0xc001c10060, 0xf5aae80564b6f501, 0xc001ef63c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0011a9290, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001ef63c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 791 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0012df6c0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 608 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001122c80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 609 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00177f8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 626 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00040da40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 627 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252ce8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0002a0a18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0002a0a00, 0xc0017f0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0002a0a00, 0xc0017f0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8b70, 0xc0017f0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0007c86c0, 0xc001e7fc38, 0x9, 0x9, 0xc0017f0009, 0xc000288000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0007c86c0, 0xc001e7fc38, 0x9, 0x9, 0x9, 0x3179e5bc142, 0xc001756e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001e7fc38, 0x9, 0x9, 0x4c98f60, 0xc0007c86c0, 0x0, 0x0, 0x7019220, 0x1784d) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001e7fc00, 0xc001d10e80, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00040da40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 628 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005e4e10, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0007c8780, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00040da40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 732 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0006329c0, 0xc000937550) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 786 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001e7fdc0, 0xc001ef6f00, 0xc00064faa0, 0xc000639ec0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 630 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005e4fa0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0007c8a80, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000875200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 631 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000875200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 632 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252c00, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0002a0d18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0002a0d00, 0xc001848000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0002a0d00, 0xc001848000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8b88, 0xc001848000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0007c8a20, 0xc001e7fd18, 0x9, 0x9, 0xc001848027, 0x10000c000288000, 0x7f91b11eac20) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0007c8a20, 0xc001e7fd18, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0018dadd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001e7fd18, 0x9, 0x9, 0x4c98f60, 0xc0007c8a20, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001e7fce0, 0xc001d10e00, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000875200, 0xc0019e3890, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000875200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000875200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 634 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0014a8ee0, 0xc001ef6f00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 635 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0010f9080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 636 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001e7fdc0, 0xbff9d2bfd1bbc15a, 0x552c39e1, 0x7019220, 0x4d01ae0, 0xc0012df5f0, 0xc001d3fbc0, 0xc000639ec0, 0xc001ef6f00, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001e7fdc0, 0xc001ef6f00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0010f9080, 0xc001ef6f00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000b62788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001d3ff88, 0x4c9d560, 0xc001085560, 0x9ab6d24f39248001, 0xc001ef6f00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b62788, 0x3b9aca00, 0x0, 0x8ae14ca582ee2401, 0xc001ef6f00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0010f9080, 0xc001ef6f00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 637 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001c22150, 0x4c9d560, 0xc001c4a690, 0x16e1a203ff39bd01, 0xc001ef6f60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001c22150, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001ef6f60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 642 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc001ce9a90, 0x4cf5ce0, 0xc00052b940) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 643 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000d4c820) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 646 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0005119f0, 0xc00163c890, 0x5, 0x5, 0x44b1b3, 0xc0013dffd8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0005119f0, 0xc00163c890, 0x5, 0x5, 0xc000596ba0, 0x47c8228, 0xc001c90960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0011e3e00, 0xc00163c890, 0x5, 0x5, 0xc000100000, 0xc001c90988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0011e3e00, 0xc00163c890, 0x5, 0x5, 0x5, 0xc00078f9e0, 0xc000a56b76, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d6600, 0xc00163c890, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00163c880, 0x7fffffff, 0xc000a56b74, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00163c880, 0xc0013d6600, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000a56b01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00163c880, 0x7f91b11abcb8, 0x70524e8, 0xc0013d6600, 0x0, 0x0, 0x4408c80, 0xc000e4ae10, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001274c80, 0x4408c80, 0xc000e4ae10, 0x0, 0xc001c90d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001274c80, 0xc001c90d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000b407e0, 0xc001c90e10, 0xc001c90de0, 0x44bbff, 0xc0013dfbc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000b407e0, 0x4408c80, 0xc000e4ae10, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc00163c8a0, 0x4408c80, 0xc000e4ae10, 0xc001c90ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc001ce9b40, 0xc001c90ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000d4c820, 0x4d854c0, 0xc001ce9b40) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 645 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000f6f500, 0xc000b407e0, 0x4d56e60, 0xc0011e3d70) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 647 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000d4c820, 0xc001b648f0, 0xc0013dfda0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 648 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000511b80, 0xc00163cc90, 0x5, 0x5, 0x0, 0x0, 0xc000597800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000511b80, 0xc00163cc90, 0x5, 0x5, 0xc0005972c0, 0x47c8228, 0xc001c91778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0011e3f80, 0xc00163cc90, 0x5, 0x5, 0xc0003cb400, 0xc001c917a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0011e3f80, 0xc00163cc90, 0x5, 0x5, 0x5, 0x407fb80, 0xc00012c388, 0x34) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d6700, 0xc00163cc90, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00163cc80, 0x400000, 0x40f230, 0xc0006405a0, 0x90, 0x90, 0x4207f80, 0xc001c91970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00163cc80, 0xc0013d6700, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc001ce9c50, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00163cc80, 0x7f91b11abcb8, 0x70524e8, 0xc0013d6700, 0x0, 0x0, 0x437be20, 0xc001ce9c60, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc00065e180, 0x437be20, 0xc001ce9c60, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc001ce9c20, 0x4d56da0, 0xc00052bb80, 0xc001193a40) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc001ce9c20, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc00065e180, 0x70524e8, 0xc0013d6700) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc001005800, 0xc0013d6700, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc001005800, 0xc0013d6700, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc000936910, 0xc000703500, 0x4d8a9e0, 0xc001005800, 0xc0013d6700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 649 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00052bb40, 0x4, 0x4d56da0, 0xc00052bb80, 0xc000597b20, 0x16, 0xc001193a40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 650 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00052bc00, 0xc0010c0690, 0xc0002ea720) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 651 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0002ea6c0, 0xc0002ea720, 0xc0002ea701, 0xc000597b20, 0x16) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 788 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0012df5f0, 0xc00064fb00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 638 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001123540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 639 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00090edc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 640 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00093a8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 641 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252b18, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2118, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f2100, 0xc0019be000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f2100, 0xc0019be000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8ed8, 0xc0019be000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0007c92c0, 0xc00091cab8, 0x9, 0x9, 0xc0019be009, 0xc000600000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0007c92c0, 0xc00091cab8, 0x9, 0x9, 0x9, 0x3179ea0e5cb, 0xc0018dce50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00091cab8, 0x9, 0x9, 0x4c98f60, 0xc0007c92c0, 0x0, 0x0, 0x7019220, 0x497d) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00091ca80, 0xc0014a9d60, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00093a8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 690 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0005e5770, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0007c9380, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00093a8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 747 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001d30000, 0xbff9d2bfd1ee722c, 0x555eeab6, 0x7019220, 0x4d01ae0, 0xc0012df860, 0xc001bf1bc0, 0xc001c2e9c0, 0xc000e1d3e0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001d30000, 0xc000e1d3e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0002f9e40, 0xc000e1d3e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001d37f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001bf1f88, 0x4c9d560, 0xc001d60330, 0x1, 0xc000e1d3e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001d37f88, 0x3b9aca00, 0x0, 0x1, 0xc000e1d3e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0002f9e40, 0xc000e1d3e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 746 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0002f9e40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 952 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00091cc40, 0xc001ef7aa0, 0xc0009e6d80, 0xc000be4060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 692 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000284870, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0007c9680, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00091af00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 693 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00091af00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 694 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252a30, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2598, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f2580, 0xc0019e4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f2580, 0xc0019e4000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8ef0, 0xc0019e4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0007c9620, 0xc00091cb98, 0x9, 0x9, 0xc0019e4027, 0x10000c000600000, 0x7f91b141dc98) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0007c9620, 0xc00091cb98, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0018dddd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00091cb98, 0x9, 0x9, 0x4c98f60, 0xc0007c9620, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00091cb60, 0xc0014a9d40, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00091af00, 0xc000946b70, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00091af00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00091af00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 696 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0014a90a0, 0xc001ef7aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 697 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0010f94a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 698 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00091cc40, 0xbff9d2bfd21aa289, 0x558b1b11, 0x7019220, 0x4d01ae0, 0xc000958750, 0xc001a79bc0, 0xc000be4060, 0xc001ef7aa0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00091cc40, 0xc001ef7aa0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0010f94a0, 0xc001ef7aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00163a788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001a79f88, 0x4c9d560, 0xc0009d4870, 0x1, 0xc001ef7aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00163a788, 0x3b9aca00, 0x0, 0x1, 0xc001ef7aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0010f94a0, 0xc001ef7aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 699 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000947050, 0x4c9d560, 0xc0009d4a80, 0x1, 0xc001ef7b00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000947050, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001ef7b00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 700 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001123d40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 701 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0009702c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 702 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00093bc00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 703 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252948, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f2a18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f2a00, 0xc001a98000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f2a00, 0xc001a98000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e8fd8, 0xc001a98000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0007c9f80, 0xc00091d8b8, 0x9, 0x9, 0xc001a98009, 0xc0010f5400, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0007c9f80, 0xc00091d8b8, 0x9, 0x9, 0x9, 0x318f6eb21f4, 0xc0018c5e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00091d8b8, 0x9, 0x9, 0x4c98f60, 0xc0007c9f80, 0x0, 0x100000000, 0x7019220, 0x5c1e) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00091d880, 0xc002ebcea0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00093bc00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 704 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000285ea0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000d980c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00093bc00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 955 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000958750, 0xc00012b0e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 707 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0009f4370, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000d993e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0009c2c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 708 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0009c2c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 709 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252860, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0010f3218, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0010f3200, 0xc001ac0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0010f3200, 0xc001ac0000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0004e9030, 0xc001ac0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000d98fc0, 0xc00091d998, 0x9, 0x9, 0xc001ac0016, 0x10000c000dc9400, 0x7f91b09eb660) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000d98fc0, 0xc00091d998, 0x9, 0x9, 0x9, 0x6006d385, 0xc001abfdd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00091d998, 0x9, 0x9, 0x4c98f60, 0xc000d98fc0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00091d960, 0xc002bf8680, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0009c2c00, 0xc0009d4db0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0009c2c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0009c2c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 937 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000b21980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 905 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0012df930) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 666 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001346a50, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001244240, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00069e180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 745 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000b22980, 0xc000e1d3e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 832 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0010fa460, 0xc001950420, 0xc0019516e0, 0xc001c0c7e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 654 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0002ea780, 0xc0002ea6c0, 0xc001ce9ca0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 900 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001d30000, 0xc000e1d3e0, 0xc000b2e300, 0xc001c2e9c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 686 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000d59400, 0xc000f9f670, 0x5, 0x5, 0x0, 0x0, 0xc001d10c80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000d59400, 0xc000f9f670, 0x5, 0x5, 0xc001d10c40, 0x47c8228, 0xc001273778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00100f710, 0xc000f9f670, 0x5, 0x5, 0xc000288000, 0xc0012737a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc00100f710, 0xc000f9f670, 0x5, 0x5, 0x5, 0x407fb80, 0xc0002864f8, 0x40) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0010f1800, 0xc000f9f670, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000f9f660, 0x400000, 0x40f230, 0xc00155e3f0, 0x90, 0x90, 0x4207f80, 0xc001273970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000f9f660, 0xc0010f1800, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc00100d0b0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000f9f660, 0x7f91b11abcb8, 0x70524e8, 0xc0010f1800, 0x0, 0x0, 0x437be20, 0xc00100d0c0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0013ec000, 0x437be20, 0xc00100d0c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc00100d080, 0x4d56da0, 0xc000efcc40, 0xc00074c700) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc00100d080, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0013ec000, 0x70524e8, 0xc0010f1800) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc000875200, 0xc0010f1800, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc000875200, 0xc0010f1800, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0009e0a00, 0xc000703500, 0x4d8a9e0, 0xc000875200, 0xc0010f1800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 731 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0006329c0, 0xc000634240) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 656 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000e0a780, 0xc001950420) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 657 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0006d9340) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 754 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0010fa460, 0xbff9d2bfd21e7d52, 0x558ef5d9, 0x7019220, 0x4d01ae0, 0xc001978340, 0xc001adbbc0, 0xc001c0c7e0, 0xc001950420, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0010fa460, 0xc001950420, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0006d9340, 0xc001950420) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001a0d788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001adbf88, 0x4c9d560, 0xc001976ba0, 0x3a226e6f69747001, 0xc001950420) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001a0d788, 0x3b9aca00, 0x0, 0x7374616d726f6601, 0xc001950420) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0006d9340, 0xc001950420) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 755 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001c347b0, 0x4c9d560, 0xc001976db0, 0x61203a656d697401, 0xc001950480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001c347b0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001950480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 787 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0012df5f0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 756 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000636500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 851 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0018f8000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 757 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001ec3b80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 730 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0006329c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 758 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001970c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 759 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252778, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001274e98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001274e80, 0xc001ae0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001274e80, 0xc001ae0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c538, 0xc001ae0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0002eb200, 0xc0010fb0d8, 0x9, 0x9, 0xc001ae0009, 0xc00077e800, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0002eb200, 0xc0010fb0d8, 0x9, 0x9, 0x9, 0x318b0925cee, 0xc001abbe50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fb0d8, 0x9, 0x9, 0x4c98f60, 0xc0002eb200, 0x0, 0x100000000, 0x7019220, 0x29b43) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fb0a0, 0xc00fbb3c60, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001970c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 760 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00197a1e0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0002eb2c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001970c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1029 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000633e10, 0xc00007cfd0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1030 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc00096ae20, 0x4cf5ce0, 0xc00063e940) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 749 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0010c1f00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1011 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc001978340, 0xc000eb1570) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 763 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00197a6e0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b7e540, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001961980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 764 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001961980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 765 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1252690, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001275298, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001275280, 0xc001b24000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001275280, 0xc001b24000, 0x8000, 0x8000, 0x203004, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c5d0, 0xc001b24000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0002ebe00, 0xc0010fb1b8, 0x9, 0x9, 0xc001b24016, 0x10000c001420400, 0x7f91b03683e0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0002ebe00, 0xc0010fb1b8, 0x9, 0x9, 0x9, 0x6006d383, 0xc001abddd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fb1b8, 0x9, 0x9, 0x4c98f60, 0xc0002ebe00, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fb180, 0xc00fbb3c40, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001961980, 0xc0019770e0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc001961980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc001961980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 938 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1433300, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0007b2d18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0007b2d00, 0xc002522000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0007b2d00, 0xc002522000, 0x8000, 0x8000, 0x203004, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000f60638, 0xc002522000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000b70300, 0xc0001a9c38, 0x9, 0x9, 0xc002522016, 0x10000c001ce4c00, 0x7f91b0a42e48) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000b70300, 0xc0001a9c38, 0x9, 0x9, 0x9, 0x6006d385, 0xc001906dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a9c38, 0x9, 0x9, 0x4c98f60, 0xc000b70300, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a9c00, 0xc01094d620, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000b21980, 0xc0002f3440, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000b21980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000b21980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 688 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000efccc0, 0xc0010c0690, 0xc001613e60) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 750 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001d64000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 751 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001d52c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 752 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b12525a8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b58118, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b58100, 0xc001d66000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b58100, 0xc001d66000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da340, 0xc001d66000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001332360, 0xc001d30c78, 0x9, 0x9, 0xc001d66009, 0xc001ce4c00, 0xc001d2f380) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001332360, 0xc001d30c78, 0x9, 0x9, 0x9, 0x3195c595817, 0xc001baee50, 0xc9) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001d30c78, 0x9, 0x9, 0x4c98f60, 0xc001332360, 0x0, 0x200000000, 0x7019220, 0xe2d8) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001d30c40, 0xc009d63920, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001d52c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 753 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00045f810, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0013324e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001d52c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 972 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001d30d20, 0xc001d5e960, 0xc0018e5ec0, 0xc0011188a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 772 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000b22ec0, 0xc001d5e960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 773 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc00037af20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 774 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001d30d20, 0xbff9d2bfd23186a9, 0x55a1ff32, 0x7019220, 0x4d01ae0, 0xc0018f8b60, 0xc0024bdbc0, 0xc0011188a0, 0xc001d5e960, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001d30d20, 0xc001d5e960, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc00037af20, 0xc001d5e960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001d37f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0024bdf88, 0x4c9d560, 0xc000aba180, 0x1, 0xc001d5e960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001d37f88, 0x3b9aca00, 0x0, 0x1, 0xc001d5e960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc00037af20, 0xc001d5e960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 775 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001d60960, 0x4c9d560, 0xc000aba3c0, 0x1, 0xc001d5e9c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001d60960, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001d5e9c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1033 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001d51500, 0xc00107fd40, 0x4d56e60, 0xc00198f890) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 794 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000e4b590, 0xc0014acf70, 0x5, 0x5, 0x44b1b3, 0xc00064ffd8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000e4b590, 0xc0014acf70, 0x5, 0x5, 0xc00121e1a0, 0x47c8228, 0xc0018c7960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0002f2750, 0xc0014acf70, 0x5, 0x5, 0xc000288000, 0xc0018c7988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0002f2750, 0xc0014acf70, 0x5, 0x5, 0x5, 0xc001d10dc0, 0xc0007e0cda, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7d900, 0xc0014acf70, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0014acf60, 0x7fffffff, 0xc0007e0cd8, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0014acf60, 0xc000f7d900, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc0007e0c01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0014acf60, 0x7f91b11abcb8, 0x70524e8, 0xc000f7d900, 0x0, 0x0, 0x4408c80, 0xc000d59680, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0007b2700, 0x4408c80, 0xc000d59680, 0x0, 0xc0018c7d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0007b2700, 0xc0018c7d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00094e000, 0xc0018c7e10, 0xc0018c7de0, 0x44bbff, 0xc00064fbc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00094e000, 0x4408c80, 0xc000d59680, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0014acf80, 0x4408c80, 0xc000d59680, 0xc0018c7ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc000a46480, 0xc0018c7ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0012df6c0, 0x4d854c0, 0xc000a46480) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1034 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00128e0f0, 0xc00114c710, 0x5, 0x5, 0x44b1b3, 0xc000635198, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00128e0f0, 0xc00114c710, 0x5, 0x5, 0xc001294600, 0x47c8228, 0xc0024dc960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00198f920, 0xc00114c710, 0x5, 0x5, 0xc000600000, 0xc0024dc988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc00198f920, 0xc00114c710, 0x5, 0x5, 0x5, 0xc0014a9dc0, 0xc000966182, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000544e00, 0xc00114c710, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00114c700, 0x7fffffff, 0xc000966180, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00114c700, 0xc000544e00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000966101, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00114c700, 0x7f91b11abcb8, 0x70524e8, 0xc000544e00, 0x0, 0x0, 0x4408c80, 0xc0009f5180, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc00128c280, 0x4408c80, 0xc0009f5180, 0x0, 0xc0024dcd20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc00128c280, 0xc0024dcd60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00107fd40, 0xc0024dce10, 0xc0024dcde0, 0x44bbff, 0xc000634d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00107fd40, 0x4408c80, 0xc0009f5180, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc00114c720, 0x4408c80, 0xc0009f5180, 0xc0024dcef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc00096af40, 0xc0024dcef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000633ee0, 0x4d854c0, 0xc00096af40) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 776 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b54780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 777 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001d65340) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 778 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001d53a40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 779 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1433788, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b58518, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b58500, 0xc001bd4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b58500, 0xc001bd4000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da4a8, 0xc001bd4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001333200, 0xc001d31998, 0x9, 0x9, 0xc001bd4009, 0xc001ce4c00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001333200, 0xc001d31998, 0x9, 0x9, 0x9, 0x319282210cb, 0xc001baae50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001d31998, 0x9, 0x9, 0x4c98f60, 0xc001333200, 0x0, 0x100000000, 0x7019220, 0x5bd9) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001d31960, 0xc006787300, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001d53a40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 793 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000568a80, 0xc00094e000, 0x4d56e60, 0xc0002f26c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 795 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0012df6c0, 0xc00087bd90, 0xc00064fda0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 780 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000a82140, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001333320, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001d53a40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 689 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001613e00, 0xc001613e60, 0xc001613e01, 0xc001d10ca0, 0x1c) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1028 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000633e10, 0xc000634cc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1026 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001d31a40, 0xc001d5f6e0, 0xc000634c60, 0xc00064d200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 783 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000b23520, 0xc001d5f6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 784 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc00037ba20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 785 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc001d31a40, 0xbff9d2bfd223fc9b, 0x55947522, 0x7019220, 0x4d01ae0, 0xc000633e10, 0xc002439bc0, 0xc00064d200, 0xc001d5f6e0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc001d31a40, 0xc001d5f6e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc00037ba20, 0xc001d5f6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0018d2f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002439f88, 0x4c9d560, 0xc000c10c90, 0x3f24d01, 0xc001d5f6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0018d2f88, 0x3b9aca00, 0x0, 0x47bf701, 0xc001d5f6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc00037ba20, 0xc001d5f6e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 802 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000aba960, 0x4c9d560, 0xc000c10ea0, 0x1, 0xc001d5f800) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000aba960, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001d5f800) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1035 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000633ee0, 0xc00063c790, 0xc000634f60) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 904 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc000a46ac0, 0x4cf5ce0, 0xc001bfce80) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 903 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0012df860, 0xc000297c50) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 936 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000b72050, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000b70360, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000b21980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 803 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b55340) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 804 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000ad0dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 805 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000afc8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 806 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14335b8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b58c98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b58c80, 0xc001c80000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b58c80, 0xc001c80000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da698, 0xc001c80000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001c43980, 0xc000af29d8, 0x9, 0x9, 0xc001c80009, 0xc00077e000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001c43980, 0xc000af29d8, 0x9, 0x9, 0x9, 0x3179eb2246d, 0xc001bade50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000af29d8, 0x9, 0x9, 0x4c98f60, 0xc001c43980, 0x0, 0x0, 0x7019220, 0x357b) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000af29a0, 0xc0019f0020, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000afc8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1027 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000633e10) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 807 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000a82eb0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001c43b00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000afc8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1171 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001347860, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b7f500, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00069e900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 988 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000ae0dd0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 977 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0018f8c30) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 902 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0012df860, 0xc000b2e360) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 858 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0003ad360, 0xc000c87530, 0x5, 0x5, 0x44b1b3, 0xc0018e47d8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0003ad360, 0xc000c87530, 0x5, 0x5, 0xc0011dae40, 0x47c8228, 0xc001e72960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001c11770, 0xc000c87530, 0x5, 0x5, 0xc000700000, 0xc001e72988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001c11770, 0xc000c87530, 0x5, 0x5, 0x5, 0xc0011db660, 0xc000fc4eaa, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc001b4c400, 0xc000c87530, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000c87520, 0x7fffffff, 0xc000fc4ea8, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000c87520, 0xc001b4c400, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000fc4e01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000c87520, 0x7f91b11abcb8, 0x70524e8, 0xc001b4c400, 0x0, 0x0, 0x4408c80, 0xc000e200f0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001150380, 0x4408c80, 0xc000e200f0, 0x0, 0xc001e72d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001150380, 0xc001e72d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00025dc20, 0xc001e72e10, 0xc001e72de0, 0x44bbff, 0xc0018e43c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00025dc20, 0x4408c80, 0xc000e200f0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc000c87580, 0x4408c80, 0xc000e200f0, 0xc001e72ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc000b50bd0, 0xc001e72ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0018f80d0, 0x4d854c0, 0xc000b50bd0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1031 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000633ee0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 868 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc001613ec0, 0xc001613e00, 0xc00100d130) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 857 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc0010c9c00, 0xc00025dc20, 0x4d56e60, 0xc001c116e0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 859 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0018f80d0, 0xc0018e6160, 0xc0018e45a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 860 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0003ad4f0, 0xc000c878d0, 0x5, 0x5, 0x0, 0x0, 0xc0011db400) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0003ad4f0, 0xc000c878d0, 0x5, 0x5, 0xc0011db3a0, 0x47c8228, 0xc001e73778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001c11a10, 0xc000c878d0, 0x5, 0x5, 0xc000700000, 0xc001e737a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001c11a10, 0xc000c878d0, 0x5, 0x5, 0x5, 0x407fb80, 0xc0018e00d0, 0x3a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc001b4c500, 0xc000c878d0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000c878c0, 0x400000, 0x40f230, 0xc00144d5f0, 0x90, 0x90, 0x4207f80, 0xc001e73970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000c878c0, 0xc001b4c500, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc000b50d80, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000c878c0, 0x7f91b11abcb8, 0x70524e8, 0xc001b4c500, 0x0, 0x0, 0x437be20, 0xc000b50d90, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0018fc000, 0x437be20, 0xc000b50d90, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc000b50d50, 0x4d56da0, 0xc0018ea700, 0xc000be9a40) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc000b50d50, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0018fc000, 0x70524e8, 0xc001b4c500) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0010fd800, 0xc001b4c500, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0010fd800, 0xc001b4c500, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001051bf0, 0xc000703500, 0x4d8a9e0, 0xc0010fd800, 0xc001b4c500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 733 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc00096a440, 0x4cf5ce0, 0xc00063e200) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1045 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0018f8c30, 0xc0018e64d0, 0xc00160e1e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 861 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc0018ea6c0, 0x6, 0x4d56da0, 0xc0018ea700, 0xc0011db440, 0x19, 0xc000be9a40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 862 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc0018ea780, 0xc0010c0690, 0xc0018fade0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 863 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0018fad80, 0xc0018fade0, 0xc0018fad01, 0xc0011db440, 0x19) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 901 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0012df860) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 734 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000633790) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 737 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00083a780, 0xc000cd3870, 0x5, 0x5, 0xc018766900, 0x0, 0x900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00083a780, 0xc000cd3870, 0x5, 0x5, 0xc000ce9e20, 0x47c8228, 0xc001270960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00198ed50, 0xc000cd3870, 0x5, 0x5, 0x8bb, 0xc001270988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc00198ed50, 0xc000cd3870, 0x5, 0x5, 0x5, 0xc010d6cf80, 0xc01876600a, 0x8bb) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000544a00, 0xc000cd3870, 0x5, 0x5, 0x8c5, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000cd3860, 0x7fffffff, 0xc018766000, 0x8c5, 0x8c5, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000cd3860, 0xc000544a00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc018766001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000cd3860, 0x7f91b11abcb8, 0x70524e8, 0xc000544a00, 0x0, 0x0, 0x4408c80, 0xc007b810e0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc00057be00, 0x4408c80, 0xc007b810e0, 0x0, 0xc001270d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc00057be00, 0xc001270d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00107fb00, 0xc001270e10, 0xc001270de0, 0x44bbff, 0xc000634300) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00107fb00, 0x4408c80, 0xc007b810e0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc000cd3880, 0x4408c80, 0xc007b810e0, 0xc001270ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc00096a580, 0xc001270ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000633790, 0x4d854c0, 0xc00096a580) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 736 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc00067e700, 0xc00107fb00, 0x4d56e60, 0xc00198ecc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 882 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000633790, 0xc00063c2c0, 0xc0006344e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 883 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00083a910, 0xc000cd3cb0, 0x5, 0x5, 0x0, 0x0, 0xc001294020) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00083a910, 0xc000cd3cb0, 0x5, 0x5, 0xc000ce9fe0, 0x47c8228, 0xc001271778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00198eed0, 0xc000cd3cb0, 0x5, 0x5, 0xc00009b800, 0xc0012717a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc00198eed0, 0xc000cd3cb0, 0x5, 0x5, 0x5, 0x407fb80, 0xc000010790, 0x2c) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000544c00, 0xc000cd3cb0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc000cd3ca0, 0x400000, 0x40f230, 0xc0013caf30, 0x90, 0x90, 0x4207f80, 0xc001271970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc000cd3ca0, 0xc000544c00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc00096a6e0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc000cd3ca0, 0x7f91b11abcb8, 0x70524e8, 0xc000544c00, 0x0, 0x0, 0x437be20, 0xc00096a6f0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0005c55c0, 0x437be20, 0xc00096a6f0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc00096a6b0, 0x4d56da0, 0xc00063e440, 0xc000181810) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc00096a6b0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0005c55c0, 0x70524e8, 0xc000544c00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc00069e000, 0xc000544c00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc00069e000, 0xc000544c00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0004a6450, 0xc000703500, 0x4d8a9e0, 0xc00069e000, 0xc000544c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 884 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00063e400, 0x7, 0x4d56da0, 0xc00063e440, 0xc001294040, 0x12, 0xc000181810) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 987 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000e8e0e0, 0xc0018e4d80, 0xc000daaba0, 0xc000daede0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1111 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc001b880c0, 0xc0010c0690, 0xc001b8a0c0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 885 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00063e4c0, 0xc0010c0690, 0xc00064cb40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 886 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc00064cae0, 0xc00064cb40, 0xc00064cb01, 0xc001294040, 0x12) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 914 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0018fae40, 0xc0018fad80, 0xc000b50de0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1221 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003a7a040, 0xc00117d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1173 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432bc0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001414218, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001414200, 0xc00284c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001414200, 0xc00284c000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0006fc130, 0xc00284c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001b7f4a0, 0xc0006fe1f8, 0x9, 0x9, 0xc00284c016, 0x10000c000dc9400, 0x7f91b02ba068) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001b7f4a0, 0xc0006fe1f8, 0x9, 0x9, 0x9, 0x6006d384, 0xc00281add0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006fe1f8, 0x9, 0x9, 0x4c98f60, 0xc001b7f4a0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006fe1c0, 0xc00c413f20, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00069e900, 0xc0006db680, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00069e900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00069e900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1036 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00128e280, 0xc00114c930, 0x5, 0x5, 0x0, 0x0, 0xc0012946e0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00128e280, 0xc00114c930, 0x5, 0x5, 0xc0012946a0, 0x47c8228, 0xc0024dd778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc00198faa0, 0xc00114c930, 0x5, 0x5, 0xc00009b800, 0xc0024dd7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc00198faa0, 0xc00114c930, 0x5, 0x5, 0x5, 0x407fb80, 0xc000010860, 0x2c) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000544f00, 0xc00114c930, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00114c920, 0x400000, 0x40f230, 0xc0013cb3b0, 0x90, 0x90, 0x4207f80, 0xc0024dd970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00114c920, 0xc000544f00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc00096b0b0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00114c920, 0x7f91b11abcb8, 0x70524e8, 0xc000544f00, 0x0, 0x0, 0x437be20, 0xc00096b0c0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0005c5680, 0x437be20, 0xc00096b0c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc00096b070, 0x4d56da0, 0xc00063eb80, 0xc00016a4d0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc00096b070, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0005c5680, 0x70524e8, 0xc000544f00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc000c4ef00, 0xc000544f00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc000c4ef00, 0xc000544f00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0007e03c0, 0xc000703500, 0x4d8a9e0, 0xc000c4ef00, 0xc000544f00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 889 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc00064cba0, 0xc00064cae0, 0xc00096a750) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1126 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0012dfd40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1060 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00128e550, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0012a02a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0012a2600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 908 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000e4ba40, 0xc0014ad750, 0x5, 0x5, 0xc003e78dd0, 0x0, 0xd0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000e4ba40, 0xc0014ad750, 0x5, 0x5, 0xc00121e520, 0x47c8228, 0xc00193b960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0002f2f30, 0xc0014ad750, 0x5, 0x5, 0xfb, 0xc00193b988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0002f2f30, 0xc0014ad750, 0x5, 0x5, 0x5, 0xc0039d96e0, 0xc005df7c29, 0xfb) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7db00, 0xc0014ad750, 0x5, 0x5, 0x104, 0x4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0014ad740, 0x7fffffff, 0xc005df7c20, 0x104, 0x104, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0014ad740, 0xc000f7db00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc005df7c01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0014ad740, 0x7f91b11abcb8, 0x70524e8, 0xc000f7db00, 0x0, 0x0, 0x4408c80, 0xc005a2f6d0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0007b2b00, 0x4408c80, 0xc005a2f6d0, 0x0, 0xc00193bd20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0007b2b00, 0xc00193bd60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00094e240, 0xc00193be10, 0xc00193bde0, 0x44bbff, 0xc000b2e420) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00094e240, 0x4408c80, 0xc005a2f6d0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0014ad760, 0x4408c80, 0xc005a2f6d0, 0xc00193bef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc000a46bb0, 0xc00193bef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0012df930, 0x4d854c0, 0xc000a46bb0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 907 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc00194b180, 0xc00094e240, 0x4d56e60, 0xc0002f2ea0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 909 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0012df930, 0xc000b54160, 0xc000b2e600) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 910 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000e4bbd0, 0xc0014ad910, 0x5, 0x5, 0x0, 0x0, 0xc00121e5e0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000e4bbd0, 0xc0014ad910, 0x5, 0x5, 0xc00121e5a0, 0x47c8228, 0xc002412778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0002f30b0, 0xc0014ad910, 0x5, 0x5, 0xc000100000, 0xc0024127a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0002f30b0, 0xc0014ad910, 0x5, 0x5, 0x5, 0x407fb80, 0xc000f60620, 0x32) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000f7dc00, 0xc0014ad910, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0014ad900, 0x400000, 0x40f230, 0xc001435e60, 0x90, 0x90, 0x4207f80, 0xc002412970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0014ad900, 0xc000f7dc00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc000a46d60, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0014ad900, 0x7f91b11abcb8, 0x70524e8, 0xc000f7dc00, 0x0, 0x0, 0x437be20, 0xc000a46d70, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0019086c0, 0x437be20, 0xc000a46d70, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc000a46d20, 0x4d56da0, 0xc000b5c140, 0xc00124f9d0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc000a46d20, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0019086c0, 0x70524e8, 0xc000f7dc00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc001961980, 0xc000f7dc00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc001961980, 0xc000f7dc00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc000eb0a10, 0xc000703500, 0x4d8a9e0, 0xc001961980, 0xc000f7dc00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 911 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000b5c100, 0x8, 0x4d56da0, 0xc000b5c140, 0xc00121e600, 0x15, 0xc00124f9d0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 916 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000e20190, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018fb1a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0018e9200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 917 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0018e9200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 912 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000b5c1c0, 0xc0010c0690, 0xc000b70000) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 918 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14334d0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001150518, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001150500, 0xc002420000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001150500, 0xc002420000, 0x8000, 0x8000, 0x203000, 0x800000601, 0xc000000000) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e00e0, 0xc002420000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0018fb140, 0xc000e8e038, 0x9, 0x9, 0xc002420027, 0x10000c00077e000, 0x7f91b1120120) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0018fb140, 0xc000e8e038, 0x9, 0x9, 0x9, 0x6006d37f, 0xc001e73dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000e8e038, 0x9, 0x9, 0x4c98f60, 0xc0018fb140, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000e8e000, 0xc0019f0000, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0018e9200, 0xc000e46270, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0018e9200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0018e9200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 913 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001c2ff20, 0xc000b70000, 0xc000b70001, 0xc00121e600, 0x15) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 920 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0011dba00, 0xc0018e4d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 921 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0007c34a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 922 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000e8e0e0, 0xbff9d2bfd239c238, 0x55aa3aba, 0x7019220, 0x4d01ae0, 0xc000ae0dd0, 0xc001e95bc0, 0xc000daede0, 0xc0018e4d80, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000e8e0e0, 0xc0018e4d80, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0007c34a0, 0xc0018e4d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001ae9788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001e95f88, 0x4c9d560, 0xc000e47f20, 0x1, 0xc0018e4d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001ae9788, 0x3b9aca00, 0x0, 0x1, 0xc0018e4d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0007c34a0, 0xc0018e4d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 923 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000e46750, 0x4c9d560, 0xc0010e4180, 0x1, 0xc0018e4ea0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000e46750, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc0018e4ea0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1163 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc001978b60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 932 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc000b70060, 0xc001c2ff20, 0xc000a46dc0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1064 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00128e640, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001119ce0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0012a2780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 924 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0018eaf00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1010 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc001978340, 0xc001951740) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 925 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0018f1080) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 926 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000ed2c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 927 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14333e8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001150818, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001150800, 0xc0024c2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001150800, 0xc0024c2000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e01b8, 0xc0024c2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0018fb9e0, 0xc000e8ed58, 0x9, 0x9, 0xc0024c2009, 0xc001ce4c00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0018fb9e0, 0xc000e8ed58, 0x9, 0x9, 0x9, 0x318f700e3f6, 0xc002410e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000e8ed58, 0x9, 0x9, 0x4c98f60, 0xc0018fb9e0, 0x0, 0x100000000, 0x7019220, 0x3f92) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000e8ed20, 0xc01094d640, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000ed2c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 928 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000e20730, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0018fbaa0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000ed2c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 954 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000958750, 0xc0009e6de0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 989 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000ae0dd0, 0xc000daac00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1048 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc0018ebb80, 0xc0010c0690, 0xc001119440) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1043 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001d50700, 0xc0009c1d40, 0x4d56e60, 0xc0010e4d50) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 833 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc001978340) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 974 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0018f8b60, 0xc0018e5f20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 975 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0018f8b60, 0xc000fc5c40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 953 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000958750) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1477 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0001a9ce0, 0xc000a42540, 0xc000daa960, 0xc003a813e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1008 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002942050, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc002928060, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001b40a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 990 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000ae0dd0, 0xc0010998d0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 849 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc001b8a120, 0xc001b8a060, 0xc000d32a10) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1047 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc0018ebac0, 0xc, 0x4d56da0, 0xc0018ebb00, 0xc0019ee120, 0x1d, 0xc00013ed20) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 956 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0010aa250, 0x4cf5ce0, 0xc000bd6580) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 957 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000958820) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 960 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0009f4cd0, 0xc0003fb4b0, 0x5, 0x5, 0x44b1b3, 0xc0009e72b8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0009f4cd0, 0xc0003fb4b0, 0x5, 0x5, 0xc0014a9b40, 0x47c8228, 0xc002417960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0009d5c20, 0xc0003fb4b0, 0x5, 0x5, 0xc000600000, 0xc002417988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0009d5c20, 0xc0003fb4b0, 0x5, 0x5, 0x5, 0xc0014a9d00, 0xc00096604a, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0009e2900, 0xc0003fb4b0, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0003fb4a0, 0x7fffffff, 0xc000966048, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0003fb4a0, 0xc0009e2900, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000966001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0003fb4a0, 0x7f91b11abcb8, 0x70524e8, 0xc0009e2900, 0x0, 0x0, 0x4408c80, 0xc0009f50e0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0010f3b00, 0x4408c80, 0xc0009f50e0, 0x0, 0xc002417d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0010f3b00, 0xc002417d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00052d320, 0xc002417e10, 0xc002417de0, 0x44bbff, 0xc0009e6ea0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00052d320, 0x4408c80, 0xc0009f50e0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0003fb4e0, 0x4408c80, 0xc0009f50e0, 0xc002417ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0010aa300, 0xc002417ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000958820, 0x4d854c0, 0xc0010aa300) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 959 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000569880, 0xc00052d320, 0x4d56e60, 0xc0009d5b90) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 961 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000958820, 0xc000bc4420, 0xc0009e7080) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1012 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc001208ee0, 0x4cf5ce0, 0xc000637a00) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 994 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0009f4e60, 0xc0003fba10, 0x5, 0x5, 0x0, 0x0, 0xc0010e7530) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0009f4e60, 0xc0003fba10, 0x5, 0x5, 0xc0014a9c00, 0x47c8228, 0xc001e70778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0009d5da0, 0xc0003fba10, 0x5, 0x5, 0xc000600000, 0xc001e707a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0009d5da0, 0xc0003fba10, 0x5, 0x5, 0x5, 0x407fb80, 0xc0004e9308, 0x4a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0009e2a00, 0xc0003fba10, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0003fba00, 0x400000, 0x40f230, 0xc0006f3830, 0x90, 0x90, 0x4207f80, 0xc001e70970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0003fba00, 0xc0009e2a00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0010aa850, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0003fba00, 0x7f91b11abcb8, 0x70524e8, 0xc0009e2a00, 0x0, 0x0, 0x437be20, 0xc0010aa860, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc000861b00, 0x437be20, 0xc0010aa860, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0010aa7e0, 0x4d56da0, 0xc000bd67c0, 0xc0010ebd50) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0010aa7e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc000861b00, 0x70524e8, 0xc0009e2a00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc00091af00, 0xc0009e2a00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc00091af00, 0xc0009e2a00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0009e0c90, 0xc000703500, 0x4d8a9e0, 0xc00091af00, 0xc0009e2a00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1046 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000e21270, 0xc0009efef0, 0x5, 0x5, 0x0, 0x0, 0xc0019ee100) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000e21270, 0xc0009efef0, 0x5, 0x5, 0xc0019ee0c0, 0x47c8228, 0xc002511778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0010e4f60, 0xc0009efef0, 0x5, 0x5, 0xc00077e000, 0xc0025117a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0010e4f60, 0xc0009efef0, 0x5, 0x5, 0x5, 0x407fb80, 0xc0018e0250, 0x42) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0011f8300, 0xc0009efef0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0009efee0, 0x400000, 0xc002511920, 0x41a1e5, 0x7f91b11ea758, 0x0, 0x2104207f80, 0xc002511970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0009efee0, 0xc0011f8300, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc000d321e0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0009efee0, 0x7f91b11abcb8, 0x70524e8, 0xc0011f8300, 0x0, 0x0, 0x437be20, 0xc000d321f0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0018fc240, 0x437be20, 0xc000d321f0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc000d321a0, 0x4d56da0, 0xc0018ebb00, 0xc00013ed20) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc000d321a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0018fc240, 0x70524e8, 0xc0011f8300) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc00069e180, 0xc0011f8300, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc00069e180, 0xc0011f8300, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0004a7d70, 0xc000703500, 0x4d8a9e0, 0xc00069e180, 0xc0011f8300) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 995 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000bd6780, 0x9, 0x4d56da0, 0xc000bd67c0, 0xc0010e7590, 0x21, 0xc0010ebd50) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 996 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000bd6840, 0xc0010c0690, 0xc000be4e40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 997 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc000be4de0, 0xc000be4e40, 0xc000be4e01, 0xc0010e7590, 0x21) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1013 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc001978410) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1016 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc00197aeb0, 0xc00121a310, 0x5, 0x5, 0xc011f14a80, 0x0, 0xa80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00197aeb0, 0xc00121a310, 0x5, 0x5, 0xc000fecca0, 0x47c8228, 0xc001b78960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001977dd0, 0xc00121a310, 0x5, 0x5, 0x995, 0xc001b78988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001977dd0, 0xc00121a310, 0x5, 0x5, 0x5, 0xc0086fdee0, 0xc011f1400a, 0x995) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d7300, 0xc00121a310, 0x5, 0x5, 0x99f, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00121a300, 0x7fffffff, 0xc011f14000, 0x99f, 0x99f, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00121a300, 0xc0013d7300, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc011f14001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00121a300, 0x7f91b11abcb8, 0x70524e8, 0xc0013d7300, 0x0, 0x0, 0x4408c80, 0xc0080a7770, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001275b00, 0x4408c80, 0xc0080a7770, 0x0, 0xc001b78d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001275b00, 0xc001b78d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0009de000, 0xc001b78e10, 0xc001b78de0, 0x44bbff, 0xc001951800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0009de000, 0x4408c80, 0xc0080a7770, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc00121a320, 0x4408c80, 0xc0080a7770, 0xc001b78ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc001208fc0, 0xc001b78ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc001978410, 0x4d854c0, 0xc001208fc0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1015 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000950700, 0xc0009de000, 0x4d56e60, 0xc001977d40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1017 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc001978410, 0xc001b64f20, 0xc0019519e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1018 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc00197b040, 0xc00121a590, 0x5, 0x5, 0x0, 0x0, 0xc000fece40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc00197b040, 0xc00121a590, 0x5, 0x5, 0xc000fece00, 0x47c8228, 0xc001b79778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001977f50, 0xc00121a590, 0x5, 0x5, 0x20300000000000, 0xc001b797a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001977f50, 0xc00121a590, 0x5, 0x5, 0x5, 0x7f91b11b0b20, 0x7f91b11b0b20, 0x30) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d7400, 0xc00121a590, 0x5, 0x5, 0x3ffb940, 0x8, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00121a580, 0x400000, 0x40f230, 0xc000641050, 0x90, 0x90, 0x4207f80, 0xc001b79970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00121a580, 0xc0013d7400, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc001209110, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00121a580, 0x7f91b11abcb8, 0x70524e8, 0xc0013d7400, 0x0, 0x0, 0x437be20, 0xc001209120, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc00065e3c0, 0x437be20, 0xc001209120, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0012090d0, 0x4d56da0, 0xc000637c40, 0xc0002d0620) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0012090d0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc00065e3c0, 0x70524e8, 0xc0013d7400) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0009c2c00, 0xc0013d7400, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0009c2c00, 0xc0013d7400, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0009e1110, 0xc000703500, 0x4d8a9e0, 0xc0009c2c00, 0xc0013d7400) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1019 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000637c00, 0xa, 0x4d56da0, 0xc000637c40, 0xc000fece60, 0x15, 0xc0002d0620) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1020 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000637cc0, 0xc0010c0690, 0xc000a22000) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1021 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001c0df80, 0xc000a22000, 0xc000a22001, 0xc000fece60, 0x15) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1266 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b14329f0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5e098, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5e080, 0xc00292a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5e080, 0xc00292a000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e0008, 0xc00292a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc002928000, 0xc0001a96f8, 0x9, 0x9, 0xc00292a027, 0x10000c00009ac00, 0x7f91b11b4b48) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc002928000, 0xc0001a96f8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc00281ddd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0001a96f8, 0x9, 0x9, 0x4c98f60, 0xc002928000, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0001a96c0, 0xc003b101c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001b40a80, 0xc002946120, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc001b40a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc001b40a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1000 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc000be4ea0, 0xc000be4de0, 0xc0010aa8c0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1162 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00061c380, 0xc000635a40, 0xc000a43740, 0xc000a23920) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1037 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00063eb40, 0xb, 0x4d56da0, 0xc00063eb80, 0xc001294700, 0x12, 0xc00016a4d0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1038 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00063ec00, 0xc0010c0690, 0xc0012a0060) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1039 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0012a0000, 0xc0012a0060, 0xc0012a0001, 0xc001294700, 0x12) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1062 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432f60, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00128c418, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00128c400, 0xc002672000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00128c400, 0xc002672000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010880, 0xc002672000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0012a0240, 0xc00061c1f8, 0x9, 0x9, 0xc002672016, 0x10000c0010f5400, 0x7f91b1119ff0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0012a0240, 0xc00061c1f8, 0x9, 0x9, 0x9, 0x6006d381, 0xc0024dddd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061c1f8, 0x9, 0x9, 0x4c98f60, 0xc0012a0240, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061c1c0, 0xc001b087c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0012a2600, 0xc00198fd10, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0012a2600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0012a2600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1058 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0012a00c0, 0xc0012a0000, 0xc00096b100) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1049 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0011193e0, 0xc001119440, 0xc001119401, 0xc0019ee120, 0x1d) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1090 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc000fed080, 0xc000a42120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1024 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc000a22060, 0xc001c0df80, 0xc001209160) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1009 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001b40a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1179 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0006ee270, 0xc000da7dc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1052 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0011194a0, 0xc0011193e0, 0xc000d32230) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 991 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc000d62a70, 0x4cf5ce0, 0xc000d86d00) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 992 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000ae0ea0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1075 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000a83c70, 0xc0011bc870, 0x5, 0x5, 0x44b1b3, 0xc000dab0d8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000a83c70, 0xc0011bc870, 0x5, 0x5, 0xc0013c8a80, 0x47c8228, 0xc001ba8960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000dce0c0, 0xc0011bc870, 0x5, 0x5, 0xc00077e000, 0xc001ba8988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000dce0c0, 0xc0011bc870, 0x5, 0x5, 0x5, 0xc0006b7d80, 0xc000da760a, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000acea00, 0xc0011bc870, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0011bc860, 0x7fffffff, 0xc000da7608, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0011bc860, 0xc000acea00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000da7601, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0011bc860, 0x7f91b11abcb8, 0x70524e8, 0xc000acea00, 0x0, 0x0, 0x4408c80, 0xc001347770, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc000dc2500, 0x4408c80, 0xc001347770, 0x0, 0xc001ba8d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc000dc2500, 0xc001ba8d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000955680, 0xc001ba8e10, 0xc001ba8de0, 0x44bbff, 0xc000daacc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000955680, 0x4408c80, 0xc001347770, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0011bc880, 0x4408c80, 0xc001347770, 0xc001ba8ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc000d62d20, 0xc001ba8ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000ae0ea0, 0x4d854c0, 0xc000d62d20) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1074 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000ae2380, 0xc000955680, 0x4d56e60, 0xc000dce030) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1076 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000ae0ea0, 0xc0004af760, 0xc000daaea0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1077 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000a83e00, 0xc0011bca90, 0x5, 0x5, 0x0, 0x0, 0xc001099ad0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000a83e00, 0xc0011bca90, 0x5, 0x5, 0xc0013c8ac0, 0x47c8228, 0xc001ba9778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000dce240, 0xc0011bca90, 0x5, 0x5, 0xc00009ac00, 0xc001ba97a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000dce240, 0xc0011bca90, 0x5, 0x5, 0x5, 0x407fb80, 0xc0003da7d8, 0x26) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc000aceb00, 0xc0011bca90, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0011bca80, 0x400000, 0x40f230, 0xc000fd3290, 0x90, 0x90, 0x4207f80, 0xc001ba9970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0011bca80, 0xc000aceb00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc000d62f90, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0011bca80, 0x7f91b11abcb8, 0x70524e8, 0xc000aceb00, 0x0, 0x0, 0x437be20, 0xc000d62fa0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001d62480, 0x437be20, 0xc000d62fa0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc000d62f50, 0x4d56da0, 0xc000d86f40, 0xc0001f6230) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc000d62f50, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001d62480, 0x70524e8, 0xc000aceb00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0018e9200, 0xc000aceb00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0018e9200, 0xc000aceb00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc000fc5020, 0xc000703500, 0x4d8a9e0, 0xc0018e9200, 0xc000aceb00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1078 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000d86f00, 0xd, 0x4d56da0, 0xc000d86f40, 0xc001099ae0, 0xf, 0xc0001f6230) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1079 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000d86fc0, 0xc0010c0690, 0xc000dafa40) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1080 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc000daf9e0, 0xc000dafa40, 0xc000dafa01, 0xc001099ae0, 0xf) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1125 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0010fb260, 0xc000a42120, 0xc000b2f0e0, 0xc000b70ae0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1083 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc000dafaa0, 0xc000daf9e0, 0xc000d63010) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1091 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0006149a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1092 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0010fb260, 0xbff9d2bfd3de2b78, 0x574ea41a, 0x7019220, 0x4d01ae0, 0xc0012dfd40, 0xc0025abbc0, 0xc000b70ae0, 0xc000a42120, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0010fb260, 0xc000a42120, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0006149a0, 0xc000a42120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0024eff88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0025abf88, 0x4c9d560, 0xc000dce3c0, 0x1, 0xc000a42120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0024eff88, 0x3b9aca00, 0x0, 0x1, 0xc000a42120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0006149a0, 0xc000a42120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1093 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000a1c4b0, 0x4c9d560, 0xc0010e50e0, 0x1, 0xc000a42180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000a1c4b0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000a42180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1094 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000a6a400) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1176 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000af37a0, 0xc001b163c0, 0xc0006d6f00, 0xc001b7f8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1095 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00197cb00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1138 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000d87740) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1096 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001970e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1097 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1433218, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001275d18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001275d00, 0xc0025ba000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001275d00, 0xc0025ba000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c8b8, 0xc0025ba000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000a226c0, 0xc0010fb378, 0x9, 0x9, 0xc0025ba009, 0xc001ce5800, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000a226c0, 0xc0010fb378, 0x9, 0x9, 0x9, 0x318ec11db87, 0xc001b77e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fb378, 0x9, 0x9, 0x4c98f60, 0xc000a226c0, 0x0, 0x100000000, 0x7019220, 0x1231c) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fb340, 0xc00cd702c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001970e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1098 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00197b680, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000a22780, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001970e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1086 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0018502d0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b7f1a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00173a780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1087 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00173a780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1088 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1433130, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc000dc2718, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc000dc2700, 0xc0025d2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc000dc2700, 0xc0025d2000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da838, 0xc0025d2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001854300, 0xc000af2ab8, 0x9, 0x9, 0xc0025d2016, 0x10000c001ce5800, 0x7f91b02bf198) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001854300, 0xc000af2ab8, 0x9, 0x9, 0x9, 0x6006d384, 0xc00250edd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000af2ab8, 0x9, 0x9, 0x4c98f60, 0xc001854300, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000af2a80, 0xc00cd702a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00173a780, 0xc000dce720, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00173a780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00173a780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1061 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0012a2600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1100 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000a6a9c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1101 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00197d600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1223 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00091c700, 0xbff9d2bfd7d7c63c, 0x5b483ec0, 0x7019220, 0x4d01ae0, 0xc0018f8dd0, 0xc0024f5bc0, 0xc001c2cc00, 0xc00117d260, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00091c700, 0xc00117d260, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0006d8420, 0xc00117d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00241cf88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0024f5f88, 0x4c9d560, 0xc001c36000, 0x1000001, 0xc00117d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00241cf88, 0x3b9aca00, 0x0, 0x1, 0xc00117d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0006d8420, 0xc00117d260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1177 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0006ee270) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1102 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001970fc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1103 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1433048, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001a7e098, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001a7e080, 0xc00265a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001a7e080, 0xc00265a000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c978, 0xc00265a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000a22ae0, 0xc0010fb458, 0x9, 0x9, 0xc00265a009, 0xc00077f000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000a22ae0, 0xc0010fb458, 0x9, 0x9, 0x9, 0x3180b2853c4, 0xc002690e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fb458, 0x9, 0x9, 0x4c98f60, 0xc000a22ae0, 0x0, 0x0, 0x7019220, 0xc69c) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fb420, 0xc001afad40, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001970fc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1110 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc001b88000, 0xe, 0x4d56da0, 0xc001b88040, 0xc0019ee4c0, 0x1a, 0xc00013f1f0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1178 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0006ee270, 0xc0006d6f60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1104 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00197ba40, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000a22c00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001970fc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1127 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0012dfd40, 0xc000b2f140) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1112 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001b8a060, 0xc001b8a0c0, 0xc001b8a001, 0xc0019ee4c0, 0x1a) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1139 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001b00840) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1140 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000afd6c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1141 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432e78, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc000dc2918, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc000dc2900, 0xc00270a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc000dc2900, 0xc00270a000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003da928, 0xc00270a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001854b40, 0xc000af36f8, 0x9, 0x9, 0xc00270a009, 0xc0003cb400, 0xc00173b800) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001854b40, 0xc000af36f8, 0x9, 0x9, 0x9, 0x317a0c27b32, 0xc002691e50, 0x92) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000af36f8, 0x9, 0x9, 0x4c98f60, 0xc001854b40, 0x0, 0x0, 0x7019220, 0x1a852) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000af36c0, 0xc0013c9240, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000afd6c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1128 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0012dfd40, 0xc000aa6720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1142 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001850780, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001854c00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000afd6c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1065 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0012a2780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1066 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432d90, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00128c618, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00128c600, 0xc002722000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00128c600, 0xc002722000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc000010898, 0xc002722000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0012a03c0, 0xc00061c2d8, 0x9, 0x9, 0xc002722016, 0x10000c0003cb400, 0x7f91b141bc30) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0012a03c0, 0xc00061c2d8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0024dedd0, 0x4c21a3d) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061c2d8, 0x9, 0x9, 0x4c98f60, 0xc0012a03c0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061c2a0, 0xc0013c9220, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0012a2780, 0xc00198ff20, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0012a2780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0012a2780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1129 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc000a47840, 0x4cf5ce0, 0xc000b5c980) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1130 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0012dfe10) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1109 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc000e21900, 0xc0013e6590, 0x5, 0x5, 0x0, 0x0, 0xc0019ee4a0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000e21900, 0xc0013e6590, 0x5, 0x5, 0xc0019ee440, 0x47c8228, 0xc0024da778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0010e5800, 0xc0013e6590, 0x5, 0x5, 0xc000700000, 0xc0024da7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0010e5800, 0xc0013e6590, 0x5, 0x5, 0x5, 0x407fb80, 0xc0018e02a0, 0x3c) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0011f8700, 0xc0013e6590, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0013e6580, 0x400000, 0x40f230, 0xc001018360, 0x90, 0x90, 0x4207f80, 0xc0024da970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0013e6580, 0xc0011f8700, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc000d329b0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0013e6580, 0x7f91b11abcb8, 0x70524e8, 0xc0011f8700, 0x0, 0x0, 0x437be20, 0xc000d329c0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0018fc300, 0x437be20, 0xc000d329c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc000d32970, 0x4d56da0, 0xc001b88040, 0xc00013f1f0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc000d32970, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0018fc300, 0x70524e8, 0xc0011f8700) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc000b21980, 0xc0011f8700, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc000b21980, 0xc0011f8700, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00060ecc0, 0xc000703500, 0x4d8a9e0, 0xc000b21980, 0xc0011f8700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1133 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc000b72870, 0xc00143c4d0, 0x5, 0x5, 0xc00d997600, 0x0, 0x580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc000b72870, 0xc00143c4d0, 0x5, 0x5, 0xc00121ea80, 0x47c8228, 0xc002511960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0019ae210, 0xc00143c4d0, 0x5, 0x5, 0x5ef, 0xc002511988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0019ae210, 0xc00143c4d0, 0x5, 0x5, 0x5, 0xc00e661700, 0xc00bce800a, 0xb29) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0019b0000, 0xc00143c4d0, 0x5, 0x5, 0xb33, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00143c4c0, 0x7fffffff, 0xc00bce8000, 0xb33, 0xb33, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00143c4c0, 0xc0019b0000, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00bce8001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00143c4c0, 0x7f91b11abcb8, 0x70524e8, 0xc0019b0000, 0x0, 0x0, 0x4408c80, 0xc00782fef0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0007b3200, 0x4408c80, 0xc00782fef0, 0x0, 0xc002511d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0007b3200, 0xc002511d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc00094e480, 0xc002511e10, 0xc002511de0, 0x44bbff, 0xc000b2f200) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc00094e480, 0x4408c80, 0xc00782fef0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc00143c4e0, 0x4408c80, 0xc00782fef0, 0xc002511ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc000a47990, 0xc002511ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0012dfe10, 0x4d854c0, 0xc000a47990) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1132 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc0018f2e00, 0xc00094e480, 0x4d56e60, 0xc0019ae180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1134 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0012dfe10, 0xc000b54630, 0xc000b2f3e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1144 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0013c8fc0, 0xc001b163c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1145 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0012e29a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1146 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000af37a0, 0xbff9d2bfd4239ce0, 0x5794157a, 0x7019220, 0x4d01ae0, 0xc0006ee270, 0xc002755bc0, 0xc001b7f8c0, 0xc001b163c0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000af37a0, 0xc001b163c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0012e29a0, 0xc001b163c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0024eaf88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002755f88, 0x4c9d560, 0xc0013665d0, 0x1, 0xc001b163c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0024eaf88, 0x3b9aca00, 0x0, 0x1, 0xc001b163c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0012e29a0, 0xc001b163c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1147 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001b34540, 0x4c9d560, 0xc0013f2f00, 0x1, 0xc001b16480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001b34540, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001b16480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1148 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000d87ec0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1287 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00091c700, 0xc00117d260, 0xc000e1c660, 0xc001c2cc00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1149 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001b01b80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1222 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0006d8420) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1150 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b48540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1151 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432ca8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc000dc2c98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc000dc2c80, 0xc002804000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc000dc2c80, 0xc002804000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0003daa50, 0xc002804000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001855260, 0xc001b4a498, 0x9, 0x9, 0xc002804009, 0xc001ce4c00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001855260, 0xc001b4a498, 0x9, 0x9, 0x9, 0x318ec1e640a, 0xc00250ae50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001b4a498, 0x9, 0x9, 0x4c98f60, 0xc001855260, 0x0, 0x100000000, 0x7019220, 0x777c) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001b4a460, 0xc00bd693e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b48540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1152 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001850cd0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001855320, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001b48540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1068 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0012948c0, 0xc000635a40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1069 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc000d81080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1070 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00061c380, 0xbff9d2bfd48d99e1, 0x57fe127c, 0x7019220, 0x4d01ae0, 0xc001978b60, 0xc0018bbbc0, 0xc000a23920, 0xc000635a40, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00061c380, 0xc000635a40, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc000d81080, 0xc000635a40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0018d4788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0018bbf88, 0x4c9d560, 0xc000a1d320, 0x1, 0xc000635a40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0018d4788, 0x3b9aca00, 0x0, 0x4d8a901, 0xc000635a40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc000d81080, 0xc000635a40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1071 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0012b84b0, 0x4c9d560, 0xc0013f35f0, 0x1, 0xc000635aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0012b84b0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000635aa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1180 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0012396b0, 0x4cf5ce0, 0xc0013a0740) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1181 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0006ee340) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1184 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc001347d10, 0xc001ba22b0, 0x5, 0x5, 0x44b1b3, 0xc0006d7438, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001347d10, 0xc001ba22b0, 0x5, 0x5, 0xc0019f0280, 0x47c8228, 0xc00280d960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0006dbe30, 0xc001ba22b0, 0x5, 0x5, 0xc0003cb400, 0xc00280d988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0006dbe30, 0xc001ba22b0, 0x5, 0x5, 0x5, 0xc0013c91c0, 0xc000a1a6ca, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc00017f400, 0xc001ba22b0, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001ba22a0, 0x7fffffff, 0xc000a1a6c8, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001ba22a0, 0xc00017f400, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc000a1a601, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001ba22a0, 0x7f91b11abcb8, 0x70524e8, 0xc00017f400, 0x0, 0x0, 0x4408c80, 0xc001850e60, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001414400, 0x4408c80, 0xc001850e60, 0x0, 0xc00280dd20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001414400, 0xc00280dd60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0010b4c60, 0xc00280de10, 0xc00280dde0, 0x44bbff, 0xc0006d7020) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0010b4c60, 0x4408c80, 0xc001850e60, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001ba22c0, 0x4408c80, 0xc001850e60, 0xc00280def4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc001239790, 0xc00280def0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0006ee340, 0x4d854c0, 0xc001239790) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1183 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000ae3180, 0xc0010b4c60, 0x4d56e60, 0xc0006dbda0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1185 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0006ee340, 0xc0014928f0, 0xc0006d7200) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1202 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001347ea0, 0xc001ba2490, 0x5, 0x5, 0x0, 0x0, 0xc0019f0340) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001347ea0, 0xc001ba2490, 0x5, 0x5, 0xc0019f0300, 0x47c8228, 0xc00286a778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0006dbfb0, 0xc001ba2490, 0x5, 0x5, 0xc000288000, 0xc00286a7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0006dbfb0, 0xc001ba2490, 0x5, 0x5, 0x5, 0x407fb80, 0xc0006fc178, 0x34) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc00017f500, 0xc001ba2490, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001ba2480, 0x400000, 0x40f428, 0x7f91b11a40c0, 0xc000b92900, 0x90, 0x90, 0xc00286a970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001ba2480, 0xc00017f500, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b10bc718, 0xc0012398c0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001ba2480, 0x7f91b11abcb8, 0x70524e8, 0xc00017f500, 0x0, 0x0, 0x437be20, 0xc0012398e0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001438000, 0x437be20, 0xc0012398e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc001239890, 0x4d56da0, 0xc0013a0980, 0xc00086ae70) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc001239890, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001438000, 0x70524e8, 0xc00017f500) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0012a2780, 0xc00017f500, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0012a2780, 0xc00017f500, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00007d7d0, 0xc000703500, 0x4d8a9e0, 0xc0012a2780, 0xc00017f500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1400 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0002ffe10, 0xc00147e870) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1203 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc0013a0940, 0xf, 0x4d56da0, 0xc0013a0980, 0xc0019f0360, 0x16, 0xc00086ae70) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1204 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc0013a0a00, 0xc0010c0690, 0xc00142a840) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1205 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc00142a7e0, 0xc00142a840, 0xc00142a801, 0xc0019f0360, 0x16) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1224 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001b663c0, 0x4c9d560, 0xc002890000, 0x1, 0xc00117d8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001b663c0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00117d8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1413 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc00289eb40, 0xc00289eba0, 0xc00289eb01, 0xc0028926f0, 0x23) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1119 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0007c2b00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1399 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0002ffe10, 0xc003dfc060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1445 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0019792b0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1412 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc0028a2700, 0xc0010c0690, 0xc00289eba0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1159 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc00142a8a0, 0xc00142a7e0, 0xc001239920) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1164 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc001978b60, 0xc000a437a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1165 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc001978b60, 0xc000a7eb10) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1166 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0006a03c0, 0x4cf5ce0, 0xc000a6b140) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1167 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc001978c30) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1169 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001b4e000, 0xc0009deb40, 0x4d56e60, 0xc000a1dc20) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1234 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc001a82230, 0xc001c4e1d0, 0x5, 0x5, 0xc00f1e0800, 0x0, 0x800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001a82230, 0xc001c4e1d0, 0x5, 0x5, 0xc000feda60, 0x47c8228, 0xc002831960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000a1dcb0, 0xc001c4e1d0, 0x5, 0x5, 0x773, 0xc002831988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000a1dcb0, 0xc001c4e1d0, 0x5, 0x5, 0x5, 0xc00f195b20, 0xc00f1e000a, 0x773) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d7d00, 0xc001c4e1d0, 0x5, 0x5, 0x77d, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001c4e1c0, 0x7fffffff, 0xc00f1e0000, 0x77d, 0x77d, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001c4e1c0, 0xc0013d7d00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00f1e0001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001c4e1c0, 0x7f91b11abcb8, 0x70524e8, 0xc0013d7d00, 0x0, 0x0, 0x4408c80, 0xc0076f3ea0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001a7e500, 0x4408c80, 0xc0076f3ea0, 0x0, 0xc002831d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001a7e500, 0xc002831d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0009deb40, 0xc002831e10, 0xc002831de0, 0x44bbff, 0xc000a43860) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0009deb40, 0x4408c80, 0xc0076f3ea0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001c4e1e0, 0x4408c80, 0xc0076f3ea0, 0xc002831ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0006a0490, 0xc002831ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc001978c30, 0x4d854c0, 0xc0006a0490) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1235 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc001978c30, 0xc001b653f0, 0xc000a43a40) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1236 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001a823c0, 0xc001c4e3d0, 0x5, 0x5, 0x400, 0x140, 0x13f) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001a823c0, 0xc001c4e3d0, 0x5, 0x5, 0xc000fedb40, 0x47c8228, 0xc002866778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000a1de30, 0xc001c4e3d0, 0x5, 0x5, 0xc0003cb400, 0xc0028667a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000a1de30, 0xc001c4e3d0, 0x5, 0x5, 0x5, 0x407fb80, 0xc00012c9f8, 0x3a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0013d7e00, 0xc001c4e3d0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001c4e3c0, 0x400000, 0x40f428, 0x7f91b163f7d0, 0xc00137a240, 0x90, 0x90, 0xc002866970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001c4e3c0, 0xc0013d7e00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b1381a10, 0xc0006a05e0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001c4e3c0, 0x7f91b11abcb8, 0x70524e8, 0xc0013d7e00, 0x0, 0x0, 0x437be20, 0xc0006a05f0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc00065e780, 0x437be20, 0xc0006a05f0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0006a05a0, 0x4d56da0, 0xc000a6b380, 0xc0002d1ab0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0006a05a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc00065e780, 0x70524e8, 0xc0013d7e00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc00069e900, 0xc0013d7e00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc00069e900, 0xc0013d7e00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc000da7990, 0xc000703500, 0x4d8a9e0, 0xc00069e900, 0xc0013d7e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1237 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000a6b340, 0x10, 0x4d56da0, 0xc000a6b380, 0xc000fedbe0, 0x19, 0xc0002d1ab0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1238 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000a6b400, 0xc0010c0690, 0xc001af6780) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1239 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001af6720, 0xc001af6780, 0xc001af6701, 0xc000fedbe0, 0x19) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1136 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc003995b00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1135 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc001af67e0, 0xc001af6720, 0xc0006a0640) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1137 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc003806dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1250 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc000ed3c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1251 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432ad8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0039ccb98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0039ccb80, 0xc0039e0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0039ccb80, 0xc0039e0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0006fc2b8, 0xc0039e0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003973ec0, 0xc0013dd0d8, 0x9, 0x9, 0xc0039e0009, 0xc00009ac00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003973ec0, 0xc0013dd0d8, 0x9, 0x9, 0x9, 0x317a451174c, 0xc002813e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dd0d8, 0x9, 0x9, 0x4c98f60, 0xc003973ec0, 0x0, 0x0, 0x7019220, 0x5449) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dd0a0, 0xc003b101e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc000ed3c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1252 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0039d04b0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0039f80c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc000ed3c00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1459 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0001a9ce0, 0xbff9d2bfd84c90a1, 0x5bbd0924, 0x7019220, 0x4d01ae0, 0xc0006eeea0, 0xc002505bc0, 0xc003a813e0, 0xc000a42540, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0001a9ce0, 0xc000a42540, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc00148f4a0, 0xc000a42540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc002520788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002505f88, 0x4c9d560, 0xc002890c90, 0x1, 0xc000a42540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002520788, 0x3b9aca00, 0x0, 0xc002520701, 0xc000a42540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc00148f4a0, 0xc000a42540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1290 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0018f8dd0, 0xc001c204a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1118 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc001bf8040, 0xc0002d3e60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1479 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0006eeea0, 0xc000daa9c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1397 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0006fe2a0, 0xc0002d3e60, 0xc003dfc000, 0xc003bfd4a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1225 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b7c540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1226 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc003a76b00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1227 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003a8c1c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1228 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1432908, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5e318, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5e300, 0xc003a96000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5e300, 0xc003a96000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e00e8, 0xc003a96000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003a80480, 0xc001b4aab8, 0x9, 0x9, 0xc003a96009, 0xc00009b800, 0xc0018cd080) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003a80480, 0xc001b4aab8, 0x9, 0x9, 0x9, 0x317a49c3314, 0xc003b00e50, 0x4e) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001b4aab8, 0x9, 0x9, 0x4c98f60, 0xc003a80480, 0x0, 0x0, 0x7019220, 0x6000) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001b4aa80, 0xc003b109c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003a8c1c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1229 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003a78410, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003a80540, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003a8c1c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1289 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0018f8dd0, 0xc000e1c8a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1458 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc00148f4a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1288 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0018f8dd0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1328 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00061d0a0, 0xc000c8de00, 0xc00064f320, 0xc003c869c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1209 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003bfe050, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003a805a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00191c780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1210 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00191c780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1211 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384fd0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00145c098, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00145c080, 0xc003c00000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00145c080, 0xc003c00000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc003bf2000, 0xc003c00000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003bfc000, 0xc00061cff8, 0x9, 0x9, 0x45b393, 0x317a49c0f94, 0xc003bf8d88) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003bfc000, 0xc00061cff8, 0x9, 0x9, 0x9, 0x5b91f953, 0x7019220, 0x4d) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061cff8, 0x9, 0x9, 0x4c98f60, 0xc003bfc000, 0x0, 0x0, 0xc003b109a0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061cfc0, 0xc003b109a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00191c780, 0xc003c1a120, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00191c780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00191c780) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1120 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0006fe2a0, 0xbff9d2bfd815870d, 0x5b85ff8f, 0x7019220, 0x4d01ae0, 0xc0002ffe10, 0xc0025b9bc0, 0xc003bfd4a0, 0xc0002d3e60, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0006fe2a0, 0xc0002d3e60, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0007c2b00, 0xc0002d3e60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000b60f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0025b9f88, 0x4c9d560, 0xc0028901e0, 0x1, 0xc0002d3e60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000b60f88, 0x3b9aca00, 0x0, 0x1, 0xc0002d3e60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0007c2b00, 0xc0002d3e60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1121 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001bc43c0, 0x4c9d560, 0xc0039db6b0, 0xc001ef6f01, 0xc0013df0e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001bc43c0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc0013df0e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1291 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc001c446c0, 0x4cf5ce0, 0xc001c28780) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1460 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002947380, 0x4c9d560, 0xc003de3500, 0x1, 0xc000a42720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002947380, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc000a42720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1314 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001bcc540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1315 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001be6b00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1281 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc00294e2e0, 0xc000a42540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1480 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0006eeea0, 0xc001b60b20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1316 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003c84fc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1317 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384ee8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003c92198, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003c92180, 0xc003c9c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003c92180, 0xc003c9c000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc001bc60b8, 0xc003c9c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003c86480, 0xc0006fef18, 0x9, 0x9, 0xc003c9c009, 0xc00009ac00, 0xc000c4fc80) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003c86480, 0xc0006fef18, 0x9, 0x9, 0x9, 0x317a4a56bd6, 0xc003bf4e50, 0x21) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006fef18, 0x9, 0x9, 0x4c98f60, 0xc003c86480, 0x0, 0x0, 0x7019220, 0x6af5) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006feee0, 0xc001bf8420, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003c84fc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1318 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001be8410, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003c86540, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003c84fc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1231 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003a78550, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003a80660, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0018cd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1232 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0018cd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1233 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384e00, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5e698, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5e680, 0xc003ab0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5e680, 0xc003ab0000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e00f0, 0xc003ab0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003a80600, 0xc001b4ab98, 0x9, 0x9, 0xc003ab0027, 0x10000c00009ac00, 0x7f91b11dd418) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003a80600, 0xc001b4ab98, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0027fcdd0, 0x4c21a3d) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001b4ab98, 0x9, 0x9, 0x4c98f60, 0xc003a80600, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001b4ab60, 0xc001bf8400, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0018cd500, 0xc001b67dd0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0018cd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0018cd500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1292 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0018f8ea0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1295 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc001c30870, 0xc001c2acf0, 0x5, 0x5, 0x44b1b3, 0xc001d5ebf8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001c30870, 0xc001c2acf0, 0x5, 0x5, 0xc003b10180, 0x47c8228, 0xc003b24960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001c36f00, 0xc001c2acf0, 0x5, 0x5, 0xc00009b800, 0xc003b24988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001c36f00, 0xc001c2acf0, 0x5, 0x5, 0x5, 0xc00294e0e0, 0xc00294a45a, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003b0e500, 0xc001c2acf0, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001c2ace0, 0x7fffffff, 0xc00294a458, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001c2ace0, 0xc003b0e500, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00294a401, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001c2ace0, 0x7f91b11abcb8, 0x70524e8, 0xc003b0e500, 0x0, 0x0, 0x4408c80, 0xc002942780, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc003b0c480, 0x4408c80, 0xc002942780, 0x0, 0xc003b24d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc003b0c480, 0xc003b24d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003b0a240, 0xc003b24e10, 0xc003b24de0, 0x44bbff, 0xc000e1cba0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003b0a240, 0x4408c80, 0xc002942780, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001c2ad00, 0x4408c80, 0xc002942780, 0xc003b24ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc001c44770, 0xc003b24ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0018f8ea0, 0x4d854c0, 0xc001c44770) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1294 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc0013bdc00, 0xc003b0a240, 0x4d56e60, 0xc001c36e70) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1296 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0018f8ea0, 0xc0004ae790, 0xc001d5e720) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1213 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003c20080, 0xc000c8de00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1214 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0003fc9a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1215 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00061d0a0, 0xbff9d2bfd81c02cb, 0x5b8c7b52, 0x7019220, 0x4d01ae0, 0xc0019791e0, 0xc002757bc0, 0xc003c869c0, 0xc000c8de00, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00061d0a0, 0xc000c8de00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0003fc9a0, 0xc000c8de00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00240df88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002757f88, 0x4c9d560, 0xc0029465a0, 0x1, 0xc000c8de00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00240df88, 0x3b9aca00, 0x0, 0x1, 0xc000c8de00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0003fc9a0, 0xc000c8de00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1216 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003c1a540, 0x4c9d560, 0xc001b67f20, 0x1, 0xc0018e4060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003c1a540, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc0018e4060) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1242 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0029820a0, 0xc002994110, 0x5, 0x5, 0x400, 0x7048478, 0xc003b25708) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0029820a0, 0xc002994110, 0x5, 0x5, 0xc00298c020, 0x47c8228, 0xc003b25778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002984120, 0xc002994110, 0x5, 0x5, 0x90, 0xc003b257a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc002984120, 0xc002994110, 0x5, 0x5, 0x5, 0x7f91b10d3c38, 0x0, 0x4e) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002996000, 0xc002994110, 0x5, 0x5, 0x3ffb940, 0x8, 0x2000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc002994100, 0x400000, 0x40f230, 0xc0029a0000, 0x90, 0x90, 0x4207f80, 0xc003b25901) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc002994100, 0xc002996000, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0029880c0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc002994100, 0x7f91b11abcb8, 0x70524e8, 0xc002996000, 0x0, 0x0, 0x437be20, 0xc0029880d0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001d62000, 0x437be20, 0xc0029880d0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc002988090, 0x4d56da0, 0xc00298a100, 0xc00299a000) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc002988090, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001d62000, 0x70524e8, 0xc002996000) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc001b40a80, 0xc002996000, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc001b40a80, 0xc002996000, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00294a020, 0xc000703500, 0x4d8a9e0, 0xc001b40a80, 0xc002996000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1243 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00298a0c0, 0x11, 0x4d56da0, 0xc00298a100, 0xc00299c060, 0x23, 0xc00299a000) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1244 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00298a180, 0xc0010c0690, 0xc002992180) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1245 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc002992120, 0xc002992180, 0xc002992101, 0xc00299c060, 0x23) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1404 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001c9c000, 0xc003c330e0, 0x4d56e60, 0xc003de2930) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1405 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc003bff090, 0xc003bf15f0, 0x5, 0x5, 0x44b1b3, 0xc003dfc538, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003bff090, 0xc003bf15f0, 0x5, 0x5, 0xc003c20340, 0x47c8228, 0xc003df7960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003de29c0, 0xc003bf15f0, 0x5, 0x5, 0xc00009b800, 0xc003df7988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003de29c0, 0xc003bf15f0, 0x5, 0x5, 0x5, 0xc003b10940, 0xc001c20a1a, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c42500, 0xc003bf15f0, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003bf15e0, 0x7fffffff, 0xc001c20a18, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003bf15e0, 0xc003c42500, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001c20a01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003bf15e0, 0x7f91b11abcb8, 0x70524e8, 0xc003c42500, 0x0, 0x0, 0x4408c80, 0xc001c31db0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc00145cc00, 0x4408c80, 0xc001c31db0, 0x0, 0xc003df7d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc00145cc00, 0xc003df7d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003c330e0, 0xc003df7e10, 0xc003df7de0, 0x44bbff, 0xc003dfc120) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003c330e0, 0x4408c80, 0xc001c31db0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc003bf1600, 0x4408c80, 0xc001c31db0, 0xc003df7ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc003c18e20, 0xc003df7ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0002ffee0, 0x4d854c0, 0xc003c18e20) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1217 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc003c225c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1346 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc003c28b00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1347 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003c2da40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1348 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384d18, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00145c398, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00145c380, 0xc003c46000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00145c380, 0xc003c46000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc003bf20c8, 0xc003c46000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003bfc840, 0xc00061dd18, 0x9, 0x9, 0xc003c46009, 0xc00009ac00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003bfc840, 0xc00061dd18, 0x9, 0x9, 0x9, 0x318f77c5ae0, 0xc003bfae50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061dd18, 0x9, 0x9, 0x4c98f60, 0xc003bfc840, 0x0, 0x100000000, 0x7019220, 0x6db0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061dce0, 0xc002bfdb60, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003c2da40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1349 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003bfe5f0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003bfc900, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003c2da40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1402 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0002ffee0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1351 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003bfe730, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc002928c00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc003c3ca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1352 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc003c3ca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1353 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384c30, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00145c698, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00145c680, 0xc003c5e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00145c680, 0xc003c5e000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc003bf20d0, 0xc003c5e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003bfc9c0, 0xc00061ddf8, 0x9, 0x9, 0xc003c5e016, 0x10000c00077e800, 0x7f91b10969b0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003bfc9c0, 0xc00061ddf8, 0x9, 0x9, 0x9, 0x6006d385, 0xc003bfbdd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061ddf8, 0x9, 0x9, 0x4c98f60, 0xc003bfc9c0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061ddc0, 0xc001d10a40, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc003c3ca80, 0xc003c1bef0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc003c3ca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc003c3ca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1407 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000e8e9a0, 0xc001d5f560, 0xc003dfc720, 0xc003dfe3c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1362 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003b10240, 0xc001d5f560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1363 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0013a8dc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1364 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000e8e9a0, 0xbff9d2bfd81c30bd, 0x5b8ca943, 0x7019220, 0x4d01ae0, 0xc000d4ca90, 0xc0024f7bc0, 0xc003dfe3c0, 0xc001d5f560, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000e8e9a0, 0xc001d5f560, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0013a8dc0, 0xc001d5f560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00251cf88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0024f7f88, 0x4c9d560, 0xc003c1bf50, 0x1, 0xc001d5f560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00251cf88, 0x3b9aca00, 0x0, 0x1, 0xc001d5f560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0013a8dc0, 0xc001d5f560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1365 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001c37320, 0x4c9d560, 0xc0029469c0, 0x1, 0xc001d5f5c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001c37320, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001d5f5c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1409 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000d4ca90, 0xc003dfc780) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1366 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001c28e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1367 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc003b23080) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1368 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003b36c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1369 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384b48, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0c618, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0c600, 0xc003b3e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0c600, 0xc003b3e000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c630, 0xc003b3e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001c2df20, 0xc000e8f998, 0x9, 0x9, 0xc003b3e009, 0xc00077e800, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001c2df20, 0xc000e8f998, 0x9, 0x9, 0x9, 0x318a74e8603, 0xc003b29e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000e8f998, 0x9, 0x9, 0x4c98f60, 0xc001c2df20, 0x0, 0x100000000, 0x7019220, 0x76a0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000e8f960, 0xc007815d60, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003b36c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1370 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001c30dc0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003b5e000, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003b36c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1408 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000d4ca90) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1372 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001c30f50, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003b5e360, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc003b31680) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1373 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc003b31680) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1374 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384a60, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0c918, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0c900, 0xc003b60000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0c900, 0xc003b60000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c638, 0xc003b60000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003b5e300, 0xc000e8fa78, 0x9, 0x9, 0xc003b60016, 0x10000c0010f5400, 0x7f91b0361388) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003b5e300, 0xc000e8fa78, 0x9, 0x9, 0x9, 0x6006d383, 0xc003b2add0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000e8fa78, 0x9, 0x9, 0x4c98f60, 0xc003b5e300, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000e8fa40, 0xc00feb2ac0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc003b31680, 0xc003b3acc0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc003b31680) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc003b31680) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1636 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384150, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0013e8198, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0013e8180, 0xc0029b2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0013e8180, 0xc0029b2000, 0x8000, 0x8000, 0x203003, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00299e000, 0xc0029b2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc002992840, 0xc00061cc78, 0x9, 0x9, 0xc0029b2016, 0x10000c000dc9400, 0x7f91b03a6698) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc002992840, 0xc00061cc78, 0x9, 0x9, 0x9, 0x6006d382, 0xc0029b1dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00061cc78, 0x9, 0x9, 0x4c98f60, 0xc002992840, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00061cc40, 0xc00650d740, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000f40900, 0xc0013f21e0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000f40900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000f40900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1248 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0029921e0, 0xc002992120, 0xc002988110) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1703 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0012de5b0, 0xc001c20560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1376 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003b10460, 0xc0009e6cc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1377 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0013a9600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1378 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc000e8fb20, 0xbff9d2bfd84cd414, 0x5bbd4c96, 0x7019220, 0x4d01ae0, 0xc000633930, 0xc001953bc0, 0xc003dffbc0, 0xc0009e6cc0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc000e8fb20, 0xc0009e6cc0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0013a9600, 0xc0009e6cc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc002844f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001953f88, 0x4c9d560, 0xc003e74a50, 0x1, 0xc0009e6cc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002844f88, 0x3b9aca00, 0x0, 0x1, 0xc0009e6cc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0013a9600, 0xc0009e6cc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1379 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003b3b1a0, 0x4c9d560, 0xc003e74c90, 0x1, 0xc0009e6d20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003b3b1a0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc0009e6d20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1647 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0013ddea0, 0xc003ad5200, 0xc0019515c0, 0xc0029936e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1380 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001c29700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1381 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc003e70580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1444 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc001b8eaf0, 0x4cf5ce0, 0xc001bccd00) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1443 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0019791e0, 0xc001b9c520) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1481 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc003a71220, 0x4cf5ce0, 0xc001b7d5c0) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1411 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc0028a2640, 0x12, 0x4d56da0, 0xc0028a2680, 0xc0028926f0, 0x23, 0xc002898460) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1401 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc003c18d70, 0x4cf5ce0, 0xc003c22f80) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1442 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0019791e0, 0xc00064f380) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1634 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002982050, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0029928a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000f40900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1410 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0028a07d0, 0xc002894b30, 0x5, 0x5, 0x0, 0x0, 0xc0028926c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0028a07d0, 0xc002894b30, 0x5, 0x5, 0xc0028aa1a0, 0x47c8228, 0xc003b03778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002890b40, 0xc002894b30, 0x5, 0x5, 0xc000700000, 0xc003b037a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc002890b40, 0xc002894b30, 0x5, 0x5, 0x5, 0x407fb80, 0xc00289c068, 0x4e) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0028a8500, 0xc002894b30, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc002894b20, 0x400000, 0x40f428, 0x7f91b14190e8, 0xc0028ae1b0, 0x90, 0x90, 0xc003b03970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc002894b20, 0xc0028a8500, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b1419748, 0xc002896730, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc002894b20, 0x7f91b11abcb8, 0x70524e8, 0xc0028a8500, 0x0, 0x0, 0x437be20, 0xc002896740, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0018fc0c0, 0x437be20, 0xc002896740, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc002896700, 0x4d56da0, 0xc0028a2680, 0xc002898460) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc002896700, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0018fc0c0, 0x70524e8, 0xc0028a8500) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc00191c780, 0xc0028a8500, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc00191c780, 0xc0028a8500, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00147e030, 0xc000703500, 0x4d8a9e0, 0xc00191c780, 0xc0028a8500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1398 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0002ffe10) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1382 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003b37a40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1383 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384978, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0cb98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0cb80, 0xc003f08000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0cb80, 0xc003f08000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c938, 0xc003f08000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003b5ec00, 0xc0010fbc38, 0x9, 0x9, 0xc003f08009, 0xc00009ac00, 0xc003b7ef00) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003b5ec00, 0xc0010fbc38, 0x9, 0x9, 0x9, 0x317a4cb34db, 0xc003f07e50, 0x2a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fbc38, 0x9, 0x9, 0x4c98f60, 0xc003b5ec00, 0x0, 0x0, 0x7019220, 0x42ff) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fbc00, 0xc001bf8540, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003b37a40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1384 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001c314f0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003b5ecc0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003b37a40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1329 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0019791e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1497 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000e8fb20, 0xc0009e6cc0, 0xc003dfd440, 0xc003dffbc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1406 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0002ffee0, 0xc001b64370, 0xc003dfc300) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1478 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0006eeea0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1524 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0039fc480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1416 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc00289ec00, 0xc00289eb40, 0xc002896780) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1448 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc001be89b0, 0xc001bcaf30, 0x5, 0x5, 0x44b1b3, 0xc00064f858, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001be89b0, 0xc001bcaf30, 0x5, 0x5, 0xc001bf8320, 0x47c8228, 0xc003bf6960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003cc6300, 0xc001bcaf30, 0x5, 0x5, 0xc00009ac00, 0xc003bf6988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003cc6300, 0xc001bcaf30, 0x5, 0x5, 0x5, 0xc001bf83c0, 0xc001b9c702, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c98400, 0xc001bcaf30, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001bcaf20, 0x7fffffff, 0xc001b9c700, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001bcaf20, 0xc003c98400, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001b9c701, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001bcaf20, 0x7f91b11abcb8, 0x70524e8, 0xc003c98400, 0x0, 0x0, 0x4408c80, 0xc001be8dc0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc003c92780, 0x4408c80, 0xc001be8dc0, 0x0, 0xc003bf6d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc003c92780, 0xc003bf6d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003c8aea0, 0xc003bf6e10, 0xc003bf6de0, 0x44bbff, 0xc00064f440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003c8aea0, 0x4408c80, 0xc001be8dc0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001bcaf40, 0x4408c80, 0xc001be8dc0, 0xc003bf6ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc001b8eba0, 0xc003bf6ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0019792b0, 0x4d854c0, 0xc001b8eba0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1426 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000d4ca90, 0xc00147e970) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1387 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001c31ae0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003b5f800, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc003b7f500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1388 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc003b7f500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1389 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384890, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0cf98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0cf80, 0xc003f30000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0cf80, 0xc003f30000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012ca20, 0xc003f30000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003b5f7a0, 0xc0010fbd18, 0x9, 0x9, 0xc003f30027, 0x10000c00009ac00, 0x7f91b11dd418) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003b5f7a0, 0xc0010fbd18, 0x9, 0x9, 0x9, 0x6006d37f, 0xc003f29dd0, 0x4c21a3d) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fbd18, 0x9, 0x9, 0x4c98f60, 0xc003b5f7a0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fbce0, 0xc001bf8520, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc003b7f500, 0xc003e75170, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc003b7f500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc003b7f500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1427 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc003c190b0, 0x4cf5ce0, 0xc003c23440) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1428 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000d4cd00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1431 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc003bff3b0, 0xc003bf1b30, 0x5, 0x5, 0xc00c901300, 0x0, 0x1300) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003bff3b0, 0xc003bf1b30, 0x5, 0x5, 0xc003c20460, 0x47c8228, 0xc003df8960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003de31d0, 0xc003bf1b30, 0x5, 0x5, 0x10de, 0xc003df8988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003de31d0, 0xc003bf1b30, 0x5, 0x5, 0x5, 0xc0111a6640, 0xc00c90000a, 0x10de) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c42700, 0xc003bf1b30, 0x5, 0x5, 0x10e8, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003bf1b20, 0x7fffffff, 0xc00c900000, 0x10e8, 0x10e8, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003bf1b20, 0xc003c42700, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00c900001, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003bf1b20, 0x7f91b11abcb8, 0x70524e8, 0xc003c42700, 0x0, 0x0, 0x4408c80, 0xc0080a7bd0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc00145cd00, 0x4408c80, 0xc0080a7bd0, 0x0, 0xc003df8d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc00145cd00, 0xc003df8d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003c33320, 0xc003df8e10, 0xc003df8de0, 0x44bbff, 0xc003dfc840) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003c33320, 0x4408c80, 0xc0080a7bd0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc003bf1b40, 0x4408c80, 0xc0080a7bd0, 0xc003df8ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc003c19160, 0xc003df8ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000d4cd00, 0x4d854c0, 0xc003c19160) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1430 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc003c30a80, 0xc003c33320, 0x4d56e60, 0xc003de3140) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1432 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000d4cd00, 0xc001b64420, 0xc003dfca20) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1433 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc003bff540, 0xc003bf1cf0, 0x5, 0x5, 0x0, 0x0, 0xc00147ea60) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003bff540, 0xc003bf1cf0, 0x5, 0x5, 0xc003c204a0, 0x47c8228, 0xc003df9778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003de3380, 0xc003bf1cf0, 0x5, 0x5, 0xc00077e000, 0xc003df97a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003de3380, 0xc003bf1cf0, 0x5, 0x5, 0x5, 0x407fb80, 0xc003bf21d8, 0x26) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c42800, 0xc003bf1cf0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003bf1ce0, 0x400000, 0x40f428, 0x7f91b11a8b78, 0xc003c40900, 0x90, 0x90, 0xc003df9970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003bf1ce0, 0xc003c42800, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b149c6f0, 0xc003c19270, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003bf1ce0, 0x7f91b11abcb8, 0x70524e8, 0xc003c42800, 0x0, 0x0, 0x437be20, 0xc003c19280, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0005c5440, 0x437be20, 0xc003c19280, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc003c19240, 0x4d56da0, 0xc003c23680, 0xc003c7e7e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc003c19240, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0005c5440, 0x70524e8, 0xc003c42800) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc003c3ca80, 0xc003c42800, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc003c3ca80, 0xc003c42800, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00147e1d0, 0xc000703500, 0x4d8a9e0, 0xc003c3ca80, 0xc003c42800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1434 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc003c23640, 0x13, 0x4d56da0, 0xc003c23680, 0xc00147ea70, 0xf, 0xc003c7e7e0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1447 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc000f6ee00, 0xc003c8aea0, 0x4d56e60, 0xc003cc6270) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1449 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0019792b0, 0xc000199ef0, 0xc00064f620) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1435 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc003c23700, 0xc0010c0690, 0xc003dff3e0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1436 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc003dff380, 0xc003dff3e0, 0xc003dff301, 0xc00147ea70, 0xf) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1450 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001be8b40, 0xc001bcb0f0, 0x5, 0x5, 0x0, 0x0, 0xc001bce540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001be8b40, 0xc001bcb0f0, 0x5, 0x5, 0xc001bf8360, 0x47c8228, 0xc003bf7778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003cc64b0, 0xc001bcb0f0, 0x5, 0x5, 0xc00009ac00, 0xc003bf77a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003cc64b0, 0xc001bcb0f0, 0x5, 0x5, 0x5, 0x407fb80, 0xc001bc6148, 0x4e) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c98500, 0xc001bcb0f0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001bcb0e0, 0x400000, 0x40f428, 0x7f91b13834a0, 0xc003c96750, 0x90, 0x90, 0xc003bf7970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001bcb0e0, 0xc003c98500, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b1340f70, 0xc001b8ecb0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001bcb0e0, 0x7f91b11abcb8, 0x70524e8, 0xc003c98500, 0x0, 0x0, 0x437be20, 0xc001b8ecc0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0008612c0, 0x437be20, 0xc001b8ecc0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc001b8ec80, 0x4d56da0, 0xc001bccf40, 0xc003cb6310) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc001b8ec80, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0008612c0, 0x70524e8, 0xc003c98500) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0018cd500, 0xc003c98500, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0018cd500, 0xc003c98500, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001b60170, 0xc000703500, 0x4d8a9e0, 0xc0018cd500, 0xc003c98500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1451 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc001bccf00, 0x14, 0x4d56da0, 0xc001bccf40, 0xc001bce570, 0x23, 0xc003cb6310) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1452 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc001bccfc0, 0xc0010c0690, 0xc003c877a0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1453 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc003c87740, 0xc003c877a0, 0xc003c87701, 0xc001bce570, 0x23) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1502 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc003f50000) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1612 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001be9130, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000b70d80, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000bdd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1456 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc003c87800, 0xc003c87740, 0xc001b8ed00) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1439 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc003dff440, 0xc003dff380, 0xc003c192c0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1532 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0039b01a0, 0xc003ad48a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1482 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0006eef70) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1613 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000bdd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1810 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000f0e750, 0xc0029865d0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1501 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc003c19aa0, 0x4cf5ce0, 0xc003c23f80) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1500 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000633930, 0xc00147f050) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1523 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc004002140, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003ad8240, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0039fc480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1499 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000633930, 0xc003dfd4a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1498 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000633930) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1525 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b13846c0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0039cc298, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0039cc280, 0xc0028dc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0039cc280, 0xc0028dc000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0006fc000, 0xc0028dc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003b5e8a0, 0xc0013dc2d8, 0x9, 0x9, 0xc0028dc016, 0x10000c000700000, 0x7f91b0f96f30) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003b5e8a0, 0xc0013dc2d8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc003df5dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dc2d8, 0x9, 0x9, 0x4c98f60, 0xc003b5e8a0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dc2a0, 0xc003a7a240, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0039fc480, 0xc0039db140, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0039fc480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0039fc480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 2024 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00402c0e0, 0xc001cebaa0, 0xc001372060, 0xc000d98900) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1505 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc003bffea0, 0xc003f4c910, 0x5, 0x5, 0x44b1b3, 0xc003dfd978, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003bffea0, 0xc003f4c910, 0x5, 0x5, 0xc003c20760, 0x47c8228, 0xc0028ce960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003f4e360, 0xc003f4c910, 0x5, 0x5, 0xc00009ac00, 0xc0028ce988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003f4e360, 0xc003f4c910, 0x5, 0x5, 0x5, 0xc001bf84e0, 0xc001b9c7a2, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c42d00, 0xc003f4c910, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003f4c900, 0x7fffffff, 0xc001b9c7a0, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003f4c900, 0xc003c42d00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001b9c701, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003f4c900, 0x7f91b11abcb8, 0x70524e8, 0xc003c42d00, 0x0, 0x0, 0x4408c80, 0xc001be8e60, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc00145d200, 0x4408c80, 0xc001be8e60, 0x0, 0xc0028ced20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc00145d200, 0xc0028ced60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003c337a0, 0xc0028cee10, 0xc0028cede0, 0x44bbff, 0xc003dfd560) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003c337a0, 0x4408c80, 0xc001be8e60, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc003f4c920, 0x4408c80, 0xc001be8e60, 0xc0028ceef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc003c19b50, 0xc0028ceef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc003f50000, 0x4d854c0, 0xc003c19b50) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1533 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0010f9600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1485 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc003a79400, 0xc001b63b50, 0x5, 0x5, 0x44b1b3, 0xc000dab5b8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003a79400, 0xc001b63b50, 0x5, 0x5, 0xc003a7a680, 0x47c8228, 0xc003df3960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003acb5c0, 0xc001b63b50, 0x5, 0x5, 0xc000600000, 0xc003df3988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003acb5c0, 0xc001b63b50, 0x5, 0x5, 0x5, 0xc003a7a720, 0xc001b60d02, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003a92800, 0xc001b63b50, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001b63b40, 0x7fffffff, 0xc001b60d00, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001b63b40, 0xc003a92800, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001b60d01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001b63b40, 0x7f91b11abcb8, 0x70524e8, 0xc003a92800, 0x0, 0x0, 0x4408c80, 0xc003a79810, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001b5ef80, 0x4408c80, 0xc003a79810, 0x0, 0xc003df3d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001b5ef80, 0xc003df3d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003a850e0, 0xc003df3e10, 0xc003df3de0, 0x44bbff, 0xc000daaa80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003a850e0, 0x4408c80, 0xc003a79810, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001b63b60, 0x4408c80, 0xc003a79810, 0xc003df3ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc003a712d0, 0xc003df3ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0006eef70, 0x4d854c0, 0xc003a712d0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1484 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc003b35180, 0xc003a850e0, 0x4d56e60, 0xc003acb530) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1504 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc003b34380, 0xc003c337a0, 0x4d56e60, 0xc003f4e2d0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1486 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0006eef70, 0xc0018e6580, 0xc000daaf60) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1538 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc003f50000, 0xc001b64790, 0xc003dfd740) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1487 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc003a79590, 0xc001b63d10, 0x5, 0x5, 0x0, 0x0, 0xc003a72840) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003a79590, 0xc001b63d10, 0x5, 0x5, 0xc003a7a6c0, 0x47c8228, 0xc003df4778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003acb740, 0xc001b63d10, 0x5, 0x5, 0xc000600000, 0xc003df47a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003acb740, 0xc001b63d10, 0x5, 0x5, 0x5, 0x407fb80, 0xc0018e02a0, 0x52) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003a92900, 0xc001b63d10, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001b63d00, 0x400000, 0x40f428, 0x7f91b11b2ae0, 0xc003a90990, 0x90, 0x90, 0xc003df4970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001b63d00, 0xc003a92900, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b1072230, 0xc003a713e0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001b63d00, 0x7f91b11abcb8, 0x70524e8, 0xc003a92900, 0x0, 0x0, 0x437be20, 0xc003a713f0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001908300, 0x437be20, 0xc003a713f0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc003a713b0, 0x4d56da0, 0xc001b7d800, 0xc003ac84d0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc003a713b0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001908300, 0x70524e8, 0xc003a92900) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc003b7f500, 0xc003a92900, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc003b7f500, 0xc003a92900, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001c20990, 0xc000703500, 0x4d8a9e0, 0xc003b7f500, 0xc003a92900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1539 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc003f5e050, 0xc003f4cad0, 0x5, 0x5, 0x0, 0x0, 0xc003c20820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003f5e050, 0xc003f4cad0, 0x5, 0x5, 0xc003c207e0, 0x47c8228, 0xc0028cf778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003f4e4e0, 0xc003f4cad0, 0x5, 0x5, 0xc00077e000, 0xc0028cf7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003f4e4e0, 0xc003f4cad0, 0x5, 0x5, 0x5, 0x407fb80, 0xc003bf2290, 0x2e) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c42e00, 0xc003f4cad0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003f4cac0, 0x400000, 0x40f428, 0x7f91b11a8b78, 0xc003c40e10, 0x90, 0x90, 0xc0028cf970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003f4cac0, 0xc003c42e00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0x7f91b149c6f0, 0xc003c19c60, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003f4cac0, 0x7f91b11abcb8, 0x70524e8, 0xc003c42e00, 0x0, 0x0, 0x437be20, 0xc003c19c70, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0005c5500, 0x437be20, 0xc003c19c70, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc003c19c30, 0x4d56da0, 0xc003f541c0, 0xc003c7ebd0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc003c19c30, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0005c5500, 0x70524e8, 0xc003c42e00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc003b31680, 0xc003c42e00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc003b31680, 0xc003c42e00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001c20700, 0xc000703500, 0x4d8a9e0, 0xc003b31680, 0xc003c42e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1488 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc001b7d7c0, 0x15, 0x4d56da0, 0xc001b7d800, 0xc003a72870, 0x25, 0xc003ac84d0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1540 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc003f54180, 0x16, 0x4d56da0, 0xc003f541c0, 0xc003c20840, 0x13, 0xc003c7ebd0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1541 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc003f54240, 0xc0010c0690, 0xc003f528a0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1542 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc003f52840, 0xc003f528a0, 0xc003f52801, 0xc003c20840, 0x13) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1489 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc001b7d880, 0xc0010c0690, 0xc003a81f80) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1554 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc003a81f20, 0xc003a81f80, 0xc003a81f01, 0xc003a72870, 0x25) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1530 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384320, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0c118, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0c100, 0xc001994000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0c100, 0xc001994000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c248, 0xc001994000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc00289fce0, 0xc0013dcd58, 0x9, 0x9, 0xc001994027, 0x10000c0010f5c00, 0x7f91b11ae1b0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc00289fce0, 0xc0013dcd58, 0x9, 0x9, 0x9, 0x6006d37f, 0xc004005dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dcd58, 0x9, 0x9, 0x4c98f60, 0xc00289fce0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dcd20, 0xc0028aaae0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0039fc600, 0xc0039dbcb0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0039fc600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0039fc600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1575 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc003f881c0, 0xc001afc120, 0xc001afd7a0, 0xc0013f88a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1545 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc003f52900, 0xc003f52840, 0xc003c19cb0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1557 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc003ad8000, 0xc003a81f20, 0xc003a71430) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1461 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc002952240) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1462 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc002972b00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1463 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc002976e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1464 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b13847a8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc002954198, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc002954180, 0xc003f8e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc002954180, 0xc003f8e000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00295c070, 0xc003f8e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0029290e0, 0xc003f88118, 0x9, 0x9, 0xc003f8e009, 0xc000700000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0029290e0, 0xc003f88118, 0x9, 0x9, 0x9, 0x317a4f53e8d, 0xc003f2be50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc003f88118, 0x9, 0x9, 0x4c98f60, 0xc0029290e0, 0x0, 0x0, 0x7019220, 0x5331) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003f880e0, 0xc003a7a260, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc002976e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1465 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002942370, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc002929560, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc002976e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1528 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0040026e0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0013f8360, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0039fc600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1467 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc00294e440, 0xc001afc120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1468 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc00148f8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1469 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc003f881c0, 0xbff9d2bfd87a8d0c, 0x5beb0591, 0x7019220, 0x4d01ae0, 0xc00129e750, 0xc0025adbc0, 0xc0013f88a0, 0xc001afc120, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc003f881c0, 0xc001afc120, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc00148f8c0, 0xc001afc120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc001ae8f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0025adf88, 0x4c9d560, 0xc0039db470, 0x1, 0xc001afc120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001ae8f88, 0x3b9aca00, 0x0, 0x1, 0xc001afc120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc00148f8c0, 0xc001afc120) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1470 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003f86f60, 0x4c9d560, 0xc003aca120, 0x1, 0xc001afc180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003f86f60, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001afc180) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1576 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc00129e750) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1471 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc002953500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1740 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134718, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0dd18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0dd00, 0xc002cee000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0dd00, 0xc002cee000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012cb48, 0xc002cee000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0012a1860, 0xc0006ffc38, 0x9, 0x9, 0xc002cee027, 0x10000c00077e000, 0x7f91b10fd610) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0012a1860, 0xc0006ffc38, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0029ccdd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006ffc38, 0x9, 0x9, 0x4c98f60, 0xc0012a1860, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006ffc00, 0xc003b11bc0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0028fca80, 0xc0014305a0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0028fca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0028fca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1472 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0038062c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1473 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc002977dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1570 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b13845d8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc002954718, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc002954700, 0xc003fa6000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc002954700, 0xc003fa6000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00295c1f0, 0xc003fa6000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc002929aa0, 0xc003f88e38, 0x9, 0x9, 0xc003fa6009, 0xc000288000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc002929aa0, 0xc003f88e38, 0x9, 0x9, 0x9, 0x317a5271b22, 0xc0028d1e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc003f88e38, 0x9, 0x9, 0x4c98f60, 0xc002929aa0, 0x0, 0x0, 0x7019220, 0x1846d) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003f88e00, 0xc003c20e20, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc002977dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1571 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002942ff0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc002929b60, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc002977dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1547 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0039d0190, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003c86120, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0028c8d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1548 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0028c8d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1549 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b13844f0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0028a6118, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0028a6100, 0xc003f64000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0028a6100, 0xc003f64000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00289c000, 0xc003f64000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0039f8b40, 0xc0010fb8b8, 0x9, 0x9, 0xc003f64027, 0x10000c000288000, 0x7f91b11b4b48) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0039f8b40, 0xc0010fb8b8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc003f2edd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0010fb8b8, 0x9, 0x9, 0x4c98f60, 0xc0039f8b40, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0010fb880, 0xc003c20e00, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0028c8d80, 0xc003f4e780, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0028c8d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0028c8d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1551 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0028aa300, 0xc003cd2480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1529 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0039fc600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1635 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000f40900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1552 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc003ad2dc0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1553 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0010fbdc0, 0xbff9d2bfd89cd96b, 0x5c0d51f6, 0x7019220, 0x4d01ae0, 0xc0012de5b0, 0xc001265bc0, 0xc001b8a2a0, 0xc003cd2480, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0010fbdc0, 0xc003cd2480, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc003ad2dc0, 0xc003cd2480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc002845f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001265f88, 0x4c9d560, 0xc0028916b0, 0xc003e7a801, 0xc003cd2480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002845f88, 0x3b9aca00, 0x0, 0x100000000000001, 0xc003cd2480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc003ad2dc0, 0xc003cd2480) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1586 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003f4eb40, 0x4c9d560, 0xc003cc68d0, 0x1, 0xc003cd24e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003f4eb40, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc003cd24e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1700 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0010fbdc0, 0xc003cd2480, 0xc003e7af00, 0xc001b8a2a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1742 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc003f7d800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1587 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc003f54880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1588 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc003e718c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1589 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003a8c8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1590 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384408, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0028a6318, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0028a6300, 0xc0015f0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0028a6300, 0xc0015f0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00289c168, 0xc0015f0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0039f9020, 0xc001b4b618, 0x9, 0x9, 0xc0015f0009, 0xc0010f5c00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0039f9020, 0xc001b4b618, 0x9, 0x9, 0x9, 0x317a53f4bcd, 0xc003f2fe50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001b4b618, 0x9, 0x9, 0x4c98f60, 0xc0039f9020, 0x0, 0x0, 0x7019220, 0x16c0c) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001b4b5e0, 0xc0028aab20, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003a8c8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1591 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0039d0aa0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0039f9140, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003a8c8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1743 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134548, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0028a7398, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0028a7380, 0xc002d0e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0028a7380, 0xc002d0e000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00289c220, 0xc002d0e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0008d99e0, 0xc001b4b6f8, 0x9, 0x9, 0xc002d0e027, 0x10000c00009ac00, 0x7f91b11dd418) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0008d99e0, 0xc001b4b6f8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc002923dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc001b4b6f8, 0x9, 0x9, 0x4c98f60, 0xc0008d99e0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc001b4b6c0, 0xc001bf9040, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc003f7d800, 0xc001430b70, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc003f7d800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc003f7d800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1728 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0040388c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1534 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0013dd180, 0xbff9d2bfd8b63c3d, 0x5c26b4c4, 0x7019220, 0x4d01ae0, 0xc003f509c0, 0xc00066bbc0, 0xc000d306c0, 0xc003ad48a0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0013dd180, 0xc003ad48a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0010f9600, 0xc003ad48a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc002844f88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00066bf88, 0x4c9d560, 0xc0012b98c0, 0x1, 0xc003ad48a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002844f88, 0x3b9aca00, 0x0, 0x1, 0xc003ad48a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0010f9600, 0xc003ad48a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1535 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0019ae240, 0x4c9d560, 0xc0028919e0, 0x1, 0xc003ad4900) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0019ae240, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc003ad4900) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1794 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0013dd180, 0xc003ad48a0, 0xc003cd3200, 0xc000d306c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1797 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc003f509c0, 0xc001b611f0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1577 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc00129e750, 0xc001afd800) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1720 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b11348e8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5f318, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5f300, 0xc004014000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5f300, 0xc004014000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e01a8, 0xc004014000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003f53260, 0xc00402c038, 0x9, 0x9, 0xc004014027, 0x10000c00077e000, 0x7f91b10fd610) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003f53260, 0xc00402c038, 0x9, 0x9, 0x9, 0x6006d37f, 0xc003c77dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00402c038, 0x9, 0x9, 0x4c98f60, 0xc003f53260, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00402c000, 0xc001d100c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0029a6d80, 0xc001482450, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0029a6d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0029a6d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1679 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000efd240, 0x1a, 0x4d56da0, 0xc000efd280, 0xc0039b0d80, 0x19, 0xc0029569a0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1536 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b7dec0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1537 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0005edb80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1618 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003c2cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1619 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1384238, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0c318, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0c300, 0xc0019b6000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0c300, 0xc0019b6000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012c9a0, 0xc0019b6000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0018549c0, 0xc0013dddf8, 0x9, 0x9, 0xc0019b6009, 0xc000dc9400, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0018549c0, 0xc0013dddf8, 0x9, 0x9, 0x9, 0x3185ff0e14e, 0xc004006e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0013dddf8, 0x9, 0x9, 0x4c98f60, 0xc0018549c0, 0x0, 0x100000000, 0x7019220, 0x7adc) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0013dddc0, 0xc00650d760, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003c2cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1620 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc004002b90, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001854f00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003c2cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1578 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc00129e750, 0xc00294a430) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1579 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0029453f0, 0x4cf5ce0, 0xc002953c80) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1580 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc00129e820) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1583 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc002943720, 0xc00143c550, 0x5, 0x5, 0x44b1b3, 0xc001afdcd8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002943720, 0xc00143c550, 0x5, 0x5, 0xc00294e8c0, 0x47c8228, 0xc0029ad960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001b5a330, 0xc00143c550, 0x5, 0x5, 0xc000700000, 0xc0029ad988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001b5a330, 0xc00143c550, 0x5, 0x5, 0x5, 0xc003a7a1c0, 0xc0039ce4f2, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002966d00, 0xc00143c550, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00143c540, 0x7fffffff, 0xc0039ce4f0, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00143c540, 0xc002966d00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc0039ce401, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00143c540, 0x7f91b11abcb8, 0x70524e8, 0xc002966d00, 0x0, 0x0, 0x4408c80, 0xc0028a10e0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc002954b80, 0x4408c80, 0xc0028a10e0, 0x0, 0xc0029add20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc002954b80, 0xc0029add60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003e76b40, 0xc0029ade10, 0xc0029adde0, 0x44bbff, 0xc001afd8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003e76b40, 0x4408c80, 0xc0028a10e0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc00143c560, 0x4408c80, 0xc0028a10e0, 0xc0029adef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0029454a0, 0xc0029adef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc00129e820, 0x4d854c0, 0xc0029454a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1719 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0029a6d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1582 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc002978a80, 0xc003e76b40, 0x4d56e60, 0xc001b5a2a0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1584 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc00129e820, 0xc0018e6790, 0xc001afdaa0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1622 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0039b0560, 0xc003ad5200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1623 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc00143a840) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1624 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0013ddea0, 0xbff9d2bfd8bc53a2, 0x5c2ccc2a, 0x7019220, 0x4d01ae0, 0xc000f0e750, 0xc001d3dbc0, 0xc0029936e0, 0xc003ad5200, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0013ddea0, 0xc003ad5200, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc00143a840, 0xc003ad5200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc00251af88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001d3df88, 0x4c9d560, 0xc0013f2330, 0x1, 0xc003ad5200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00251af88, 0x3b9aca00, 0x0, 0x1, 0xc003ad5200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc00143a840, 0xc003ad5200) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1625 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00288e030, 0x4c9d560, 0xc003e75e90, 0x1, 0xc003ad52c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc00288e030, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc003ad52c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1585 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0029438b0, 0xc00143c770, 0x5, 0x5, 0x0, 0x0, 0xc002958720) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0029438b0, 0xc00143c770, 0x5, 0x5, 0xc00294e900, 0x47c8228, 0xc0029ae778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001b5a4b0, 0xc00143c770, 0x5, 0x5, 0xc000100000, 0xc0029ae7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001b5a4b0, 0xc00143c770, 0x5, 0x5, 0x5, 0x407fb80, 0xc00295c270, 0x52) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002966e00, 0xc00143c770, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00143c760, 0x400000, 0x40f230, 0xc00295ecf0, 0x90, 0x90, 0x4207f80, 0xc0029ae970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00143c760, 0xc002966e00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0029455b0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00143c760, 0x7f91b11abcb8, 0x70524e8, 0xc002966e00, 0x0, 0x0, 0x437be20, 0xc0029455c0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0013ec3c0, 0x437be20, 0xc0029455c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc002945580, 0x4d56da0, 0xc002953ec0, 0xc003ac8a80) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc002945580, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0013ec3c0, 0x70524e8, 0xc002966e00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0039fc480, 0xc002966e00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0039fc480, 0xc002966e00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00289a020, 0xc000703500, 0x4d8a9e0, 0xc0039fc480, 0xc002966e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1650 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc002953e80, 0x17, 0x4d56da0, 0xc002953ec0, 0xc002958750, 0x25, 0xc003ac8a80) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1651 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc002953f40, 0xc0010c0690, 0xc0013f9860) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1652 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0013f9800, 0xc0013f9860, 0xc0013f9801, 0xc002958750, 0x25) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1739 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0028fca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1817 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc003f88ee0, 0xc001b16d80, 0xc000fbccc0, 0xc001cb28a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1655 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0013f98c0, 0xc0013f9800, 0xc002945600) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1702 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0012de5b0, 0xc003e7af60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1955 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc001bf8a40, 0xc001349500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1626 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000efc840) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1627 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc000653b80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1628 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc003c856c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1629 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134f40, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0c898, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0c880, 0xc001ab0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0c880, 0xc001ab0000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012cae0, 0xc001ab0000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001855c20, 0xc0006ffa78, 0x9, 0x9, 0xc001ab0009, 0xc000700000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001855c20, 0xc0006ffa78, 0x9, 0x9, 0x9, 0x317a5423b2b, 0xc0029cde50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006ffa78, 0x9, 0x9, 0x4c98f60, 0xc001855c20, 0x0, 0x0, 0x7019220, 0x674a) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006ffa40, 0xc003a7ab00, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc003c856c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1630 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0040030e0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001855ce0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc003c856c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1718 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003a79d10, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003f532c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0029a6d80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1632 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc004003270, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0012a0120, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0028fc000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1633 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0028fc000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1666 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134e58, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003b0d718, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003b0d700, 0xc001b68000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003b0d700, 0xc001b68000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00012cae8, 0xc001b68000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001855f80, 0xc0006ffb58, 0x9, 0x9, 0xc001b68027, 0x10000c0003cb400, 0x7f91b1419638) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001855f80, 0xc0006ffb58, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0029cedd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0006ffb58, 0x9, 0x9, 0x4c98f60, 0xc001855f80, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0006ffb20, 0xc0039b0ea0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0028fc000, 0xc00288fa40, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0028fc000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0028fc000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1657 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc00294e9a0, 0xc001b16d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1658 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0028cb1e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1659 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc003f88ee0, 0xbff9d2bfd8bf7749, 0x5c2fefd3, 0x7019220, 0x4d01ae0, 0xc000f0e9c0, 0xc0029e1bc0, 0xc001cb28a0, 0xc001b16d80, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc003f88ee0, 0xc001b16d80, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0028cb1e0, 0xc001b16d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc003f5cf88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0029e1f88, 0x4c9d560, 0xc00288fb90, 0x1, 0xc001b16d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003f5cf88, 0x3b9aca00, 0x0, 0x1, 0xc001b16d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0028cb1e0, 0xc001b16d80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1660 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001b5a9f0, 0x4c9d560, 0xc0010e42d0, 0x1, 0xc001b16e40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001b5a9f0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001b16e40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1701 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0012de5b0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1722 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003b10d40, 0xc001cebaa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1723 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc000d81600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1727 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001bfe580) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1726 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0028a3700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1661 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000b5c7c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1614 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134c88, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003c92a18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003c92a00, 0xc003cdc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003c92a00, 0xc003cdc000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc003bf20f8, 0xc003cdc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000b70d20, 0xc00091da78, 0x9, 0x9, 0xc003cdc027, 0x10000c000100000, 0x7f91b106d720) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000b70d20, 0xc00091da78, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0028f4dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00091da78, 0x9, 0x9, 0x4c98f60, 0xc000b70d20, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00091da40, 0xc001a12820, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000bdd800, 0xc002984930, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc000bdd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc000bdd800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1662 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0009718c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1663 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b48700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1664 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134d70, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc002954d98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc002954d80, 0xc003fd2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc002954d80, 0xc003fd2000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00295c340, 0xc003fd2000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0013f9f20, 0xc003f89b58, 0x9, 0x9, 0xc003fd2009, 0xc000100000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0013f9f20, 0xc003f89b58, 0x9, 0x9, 0x9, 0x317a621c3ff, 0xc0029aee50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc003f89b58, 0x9, 0x9, 0x4c98f60, 0xc0013f9f20, 0x0, 0x0, 0x7019220, 0x2e8ea8) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003f89b20, 0xc001a128e0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b48700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1665 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002943ef0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00142a900, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001b48700) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 2090 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc003f89c00, 0xc001b17980, 0xc0002ee1e0, 0xc001af7f80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1649 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000f0e750, 0xc001951620) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1725 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000aa3710, 0x4c9d560, 0xc001233a40, 0x1, 0xc001cebb60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000aa3710, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001cebb60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1683 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc00294ed00, 0xc001b17980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1684 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0028cb600) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1685 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc003f89c00, 0xbff9d2bfd96c0b14, 0x5cdc8396, 0x7019220, 0x4d01ae0, 0xc000958a90, 0xc002ce5bc0, 0xc001af7f80, 0xc001b17980, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc003f89c00, 0xc001b17980, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0028cb600, 0xc001b17980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc003feff88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002ce5f88, 0x4c9d560, 0xc001c668d0, 0x1, 0xc001b17980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003feff88, 0x3b9aca00, 0x0, 0x1, 0xc001b17980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0028cb600, 0xc001b17980) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1686 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0010e4870, 0x4c9d560, 0xc001c66b10, 0x1, 0xc001b179e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0010e4870, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001b179e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1704 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc003c19f80, 0x4cf5ce0, 0xc003994a80) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1796 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc003f509c0, 0xc003cd3260) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1705 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0012de680) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1956 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc003ccd760) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1687 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000b5d1c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1708 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc003f5e730, 0xc003e7d490, 0x5, 0x5, 0x44b1b3, 0xc003e7b438, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003f5e730, 0xc003e7d490, 0x5, 0x5, 0xc003c20be0, 0x47c8228, 0xc0028f7960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003cc7260, 0xc003e7d490, 0x5, 0x5, 0xc000288000, 0xc0028f7988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003cc7260, 0xc003e7d490, 0x5, 0x5, 0x5, 0xc003c20dc0, 0xc001c20f4a, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c42f00, 0xc003e7d490, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003e7d480, 0x7fffffff, 0xc001c20f48, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003e7d480, 0xc003c42f00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001c20f01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003e7d480, 0x7f91b11abcb8, 0x70524e8, 0xc003c42f00, 0x0, 0x0, 0x4408c80, 0xc003f5ed70, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc00145c700, 0x4408c80, 0xc003f5ed70, 0x0, 0xc0028f7d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc00145c700, 0xc0028f7d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003c32fc0, 0xc0028f7e10, 0xc0028f7de0, 0x44bbff, 0xc003e7b020) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003c32fc0, 0x4408c80, 0xc003f5ed70, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc003e7d4a0, 0x4408c80, 0xc003f5ed70, 0xc0028f7ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc00083c270, 0xc0028f7ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0012de680, 0x4d854c0, 0xc00083c270) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1957 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00191e000, 0xbff9d2bfd94954b4, 0x5cb9cd3f, 0x7019220, 0x4d01ae0, 0xc003f51110, 0xc002fc1bc0, 0xc001c52ea0, 0xc001349500, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00191e000, 0xc001349500, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc003ccd760, 0xc001349500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc003f5df88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002fc1f88, 0x4c9d560, 0xc0009d4390, 0x1, 0xc001349500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003f5df88, 0x3b9aca00, 0x0, 0x1, 0xc001349500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc003ccd760, 0xc001349500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1688 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001b51600) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1707 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc002979880, 0xc003c32fc0, 0x4d56e60, 0xc003cc71d0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1709 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0012de680, 0xc0004af1e0, 0xc003e7b200) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1648 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000f0e750) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1724 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00402c0e0, 0xbff9d2bfd91fb57a, 0x5c902e07, 0x7019220, 0x4d01ae0, 0xc0018f9860, 0xc00305fbc0, 0xc000d98900, 0xc001cebaa0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00402c0e0, 0xc001cebaa0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc000d81600, 0xc001cebaa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc004012788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00305ff88, 0x4c9d560, 0xc0009cff50, 0x1, 0xc001cebaa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc004012788, 0x3b9aca00, 0x0, 0x1, 0xc001cebaa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc000d81600, 0xc001cebaa0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1689 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc001b49500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1690 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134ba0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc002955198, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc002955180, 0xc001c58000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc002955180, 0xc001c58000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00295c408, 0xc001c58000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc00142b320, 0xc003ff4818, 0x9, 0x9, 0xc001c58009, 0xc0003cb400, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc00142b320, 0xc003ff4818, 0x9, 0x9, 0x9, 0x317a5a5ce43, 0xc001c3ee50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc003ff4818, 0x9, 0x9, 0x4c98f60, 0xc00142b320, 0x0, 0x0, 0x7019220, 0x46dc) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003ff47e0, 0xc0039b15c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc001b49500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1691 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000b72780, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc00142b3e0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc001b49500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1746 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc003f5eaa0, 0xc003e7d770, 0x5, 0x5, 0x0, 0x0, 0xc003c20ce0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc003f5eaa0, 0xc003e7d770, 0x5, 0x5, 0xc003c20ca0, 0x47c8228, 0xc0028fa778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003cc7650, 0xc003e7d770, 0x5, 0x5, 0xc000288000, 0xc0028fa7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003cc7650, 0xc003e7d770, 0x5, 0x5, 0x5, 0x407fb80, 0xc001bc6178, 0x2a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003c43000, 0xc003e7d770, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc003e7d760, 0x400000, 0x40f230, 0xc003c96480, 0x90, 0x90, 0x4207f80, 0xc0028fa970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc003e7d760, 0xc003c43000, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc00083cb70, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc003e7d760, 0x7f91b11abcb8, 0x70524e8, 0xc003c43000, 0x0, 0x0, 0x437be20, 0xc00083cb90, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0018fc180, 0x437be20, 0xc00083cb90, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc00083cb00, 0x4d56da0, 0xc003994e00, 0xc002898a80) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc00083cb00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0018fc180, 0x70524e8, 0xc003c43000) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0028c8d80, 0xc003c43000, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0028c8d80, 0xc003c43000, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001b60080, 0xc000703500, 0x4d8a9e0, 0xc0028c8d80, 0xc003c43000) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1711 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003f5e8c0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b8af60, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0039fec00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1712 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0039fec00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1713 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134ab8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00145d398, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00145d380, 0xc0027dc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00145d380, 0xc0027dc000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc001bc6170, 0xc0027dc000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001b8af00, 0xc0000c6038, 0x9, 0x9, 0xc0027dc027, 0x10000c0003cb400, 0x7f91b1419638) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001b8af00, 0xc0000c6038, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0028f8dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0000c6038, 0x9, 0x9, 0x4c98f60, 0xc001b8af00, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0000c6000, 0xc0039b15a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0039fec00, 0xc003cc73e0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0039fec00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0039fec00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1747 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc003994dc0, 0x18, 0x4d56da0, 0xc003994e00, 0xc003c20d00, 0x11, 0xc002898a80) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1748 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc003994e80, 0xc0010c0690, 0xc001b8b4a0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1749 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001b8b440, 0xc001b8b4a0, 0xc001b8b401, 0xc003c20d00, 0x11) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1884 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc003ff48c0, 0xc0006d68a0, 0xc003cd3da0, 0xc000639500) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1694 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc00294f180, 0xc0006d68a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1695 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0028cbb80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1696 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc003ff48c0, 0xbff9d2bfd8fed6f5, 0x5c6f4f7f, 0x7019220, 0x4d01ae0, 0xc003f50c30, 0xc002cdfbc0, 0xc000639500, 0xc0006d68a0, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc003ff48c0, 0xc0006d68a0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0028cbb80, 0xc0006d68a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc003fef788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002cdff88, 0x4c9d560, 0xc001144c30, 0x3f24d01, 0xc0006d68a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003fef788, 0x3b9aca00, 0x0, 0x47bf701, 0xc0006d68a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0028cbb80, 0xc0006d68a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1697 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc001c670e0, 0x4c9d560, 0xc001145c20, 0x1, 0xc0006d6960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc001c670e0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc0006d6960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1795 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc003f509c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1678 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc004003c20, 0xc001383050, 0x5, 0x5, 0x0, 0x0, 0xc0039b0d60) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc004003c20, 0xc001383050, 0x5, 0x5, 0xc0039b0d20, 0x47c8228, 0xc002d0d778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0029805a0, 0xc001383050, 0x5, 0x5, 0xc0003cb400, 0xc002d0d7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0029805a0, 0xc001383050, 0x5, 0x5, 0x5, 0x407fb80, 0xc00012cb50, 0x3a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003854900, 0xc001383050, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001383040, 0x400000, 0x40f230, 0xc003809560, 0x90, 0x90, 0x4207f80, 0xc002d0d970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001383040, 0xc003854900, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0039fb3a0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001383040, 0x7f91b11abcb8, 0x70524e8, 0xc003854900, 0x0, 0x0, 0x437be20, 0xc0039fb3b0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001908540, 0x437be20, 0xc0039fb3b0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0039fb370, 0x4d56da0, 0xc000efd280, 0xc0029569a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0039fb370, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001908540, 0x70524e8, 0xc003854900) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc000f40900, 0xc003854900, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc000f40900, 0xc003854900, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc002986090, 0xc000703500, 0x4d8a9e0, 0xc000f40900, 0xc003854900) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1889 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc003f50d00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1752 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc001b8b500, 0xc001b8b440, 0xc00083cc30) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1762 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000b5db40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1763 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001d14dc0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1764 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0012d8c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1765 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b11349d0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc002955618, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc002955600, 0xc002886000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc002955600, 0xc002886000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc00295c508, 0xc002886000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001af6ba0, 0xc003ff5538, 0x9, 0x9, 0xc002886009, 0xc00009ac00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001af6ba0, 0xc003ff5538, 0x9, 0x9, 0x9, 0x317a5ca0018, 0xc002927e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc003ff5538, 0x9, 0x9, 0x4c98f60, 0xc001af6ba0, 0x0, 0x0, 0x7019220, 0xb9fab) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc003ff5500, 0xc001bf9100, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0012d8c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1766 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000b73130, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001af6c60, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0012d8c40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 2093 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000958a90, 0xc00294b540) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 2108 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc002983860, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b7ef00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001cae180) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1958 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002985ce0, 0x4c9d560, 0xc0009d4ae0, 0x1, 0xc001349560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc002985ce0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001349560) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1741 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0039d1860, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003ad8ea0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc003f7d800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1729 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134800, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5f598, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5f580, 0xc00403a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5f580, 0xc00403a000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e0360, 0xc00403a000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc003f53a40, 0xc00402cd58, 0x9, 0x9, 0xc00403a009, 0xc00077e000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc003f53a40, 0xc00402cd58, 0x9, 0x9, 0x9, 0x317a592776d, 0xc002d0ae50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00402cd58, 0x9, 0x9, 0x4c98f60, 0xc003f53a40, 0x0, 0x0, 0x7019220, 0x8906) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00402cd20, 0xc003b11be0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0040388c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1925 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0000ca480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1991 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001851270, 0xc001383dd0, 0x5, 0x5, 0x0, 0x0, 0xc0039b1360) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001851270, 0xc001383dd0, 0x5, 0x5, 0xc0039b1320, 0x47c8228, 0xc003039778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002981710, 0xc001383dd0, 0x5, 0x5, 0xc0003cb400, 0xc0030397a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc002981710, 0xc001383dd0, 0x5, 0x5, 0x5, 0x407fb80, 0xc00012cbe8, 0x2c) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003854d00, 0xc001383dd0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001383dc0, 0x400000, 0x40f230, 0xc003809a70, 0x90, 0x90, 0x4207f80, 0xc003039970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001383dc0, 0xc003854d00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0039fbc40, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001383dc0, 0x7f91b11abcb8, 0x70524e8, 0xc003854d00, 0x0, 0x0, 0x437be20, 0xc0039fbc50, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001908600, 0x437be20, 0xc0039fbc50, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0039fbc10, 0x4d56da0, 0xc000efddc0, 0xc002956d20) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0039fbc10, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001908600, 0x70524e8, 0xc003854d00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0028fca80, 0xc003854d00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0028fca80, 0xc003854d00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0039ceab0, 0xc000703500, 0x4d8a9e0, 0xc0028fca80, 0xc003854d00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1798 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc002897730, 0x4cf5ce0, 0xc003f55180) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1738 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc004003b30, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003ad8ae0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0028fca80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1799 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc003f50a90) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1802 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0039d1360, 0xc002994cd0, 0x5, 0x5, 0x44b1b3, 0xc003cd3738, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0039d1360, 0xc002994cd0, 0x5, 0x5, 0xc0028aa920, 0x47c8228, 0xc003cda960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000c140c0, 0xc002994cd0, 0x5, 0x5, 0xc0010f5c00, 0xc003cda988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000c140c0, 0xc002994cd0, 0x5, 0x5, 0x5, 0xc0028aaaa0, 0xc001b613da, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0028a8d00, 0xc002994cd0, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc002994cc0, 0x7fffffff, 0xc001b613d8, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc002994cc0, 0xc0028a8d00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001b61301, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc002994cc0, 0x7f91b11abcb8, 0x70524e8, 0xc0028a8d00, 0x0, 0x0, 0x4408c80, 0xc0039d17c0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0028a7200, 0x4408c80, 0xc0039d17c0, 0x0, 0xc003cdad20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0028a7200, 0xc003cdad60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0028a5320, 0xc003cdae10, 0xc003cdade0, 0x44bbff, 0xc003cd3320) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0028a5320, 0x4408c80, 0xc0039d17c0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc002994ce0, 0x4408c80, 0xc0039d17c0, 0xc003cdaef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0028977e0, 0xc003cdaef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc003f50a90, 0x4d854c0, 0xc0028977e0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1801 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc003b35880, 0xc0028a5320, 0x4d56e60, 0xc000a67da0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1803 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc003f50a90, 0xc001492370, 0xc003cd3500) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1804 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0039d14f0, 0xc002994e90, 0x5, 0x5, 0x0, 0x0, 0xc0028aa9e0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0039d14f0, 0xc002994e90, 0x5, 0x5, 0xc0028aa9a0, 0x47c8228, 0xc002923778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc000c14330, 0xc002994e90, 0x5, 0x5, 0xc0010f5c00, 0xc0029237a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc000c14330, 0xc002994e90, 0x5, 0x5, 0x5, 0x407fb80, 0xc00289c210, 0x2a) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0028a8e00, 0xc002994e90, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc002994e80, 0x400000, 0x40f230, 0xc0028aecf0, 0x90, 0x90, 0x4207f80, 0xc002923970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc002994e80, 0xc0028a8e00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0028978f0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc002994e80, 0x7f91b11abcb8, 0x70524e8, 0xc0028a8e00, 0x0, 0x0, 0x437be20, 0xc002897900, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0014383c0, 0x437be20, 0xc002897900, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0028978c0, 0x4d56da0, 0xc003f553c0, 0xc003cb6a10) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0028978c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0014383c0, 0x70524e8, 0xc0028a8e00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0039fc600, 0xc0028a8e00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0039fc600, 0xc0028a8e00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00289a1d0, 0xc000703500, 0x4d8a9e0, 0xc0039fc600, 0xc0028a8e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1805 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc003f55380, 0x19, 0x4d56da0, 0xc003f553c0, 0xc0028aaa00, 0x11, 0xc003cb6a10) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1806 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc003f55440, 0xc0010c0690, 0xc0008d8240) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1807 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0008d81e0, 0xc0008d8240, 0xc0008d8201, 0xc0028aaa00, 0x11) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1811 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc002988790, 0x4cf5ce0, 0xc00298a980) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1888 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc002897e40, 0x4cf5ce0, 0xc003f55880) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 2014 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc002989350, 0x4cf5ce0, 0xc00298b4c0) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1680 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000efd300, 0xc0010c0690, 0xc0012a1980) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1812 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000f0e820) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1815 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc002982960, 0xc001b70c10, 0x5, 0x5, 0xc0062c4b60, 0x0, 0x1a0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002982960, 0xc001b70c10, 0x5, 0x5, 0xc00298c5c0, 0x47c8228, 0xc0029ab960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0013f3230, 0xc001b70c10, 0x5, 0x5, 0x1ce, 0xc0029ab988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0013f3230, 0xc001b70c10, 0x5, 0x5, 0x5, 0xc00ef9f7a0, 0xc0011c6b4a, 0x1ce) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002996500, 0xc001b70c10, 0x5, 0x5, 0x1d8, 0x5, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001b70c00, 0x7fffffff, 0xc0011c6b40, 0x1d8, 0x1d8, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001b70c00, 0xc002996500, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc0011c6b01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001b70c00, 0x7f91b11abcb8, 0x70524e8, 0xc002996500, 0x0, 0x0, 0x4408c80, 0xc007bbefa0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0013e8700, 0x4408c80, 0xc007bbefa0, 0x0, 0xc0029abd20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0013e8700, 0xc0029abd60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000ad4240, 0xc0029abe10, 0xc0029abde0, 0x44bbff, 0xc001951980) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000ad4240, 0x4408c80, 0xc007bbefa0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001b70c20, 0x4408c80, 0xc007bbefa0, 0xc0029abef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc002988840, 0xc0029abef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000f0e820, 0x4d854c0, 0xc002988840) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 2015 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000f0ed00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1814 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001c9d180, 0xc000ad4240, 0x4d56e60, 0xc0013f31a0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1874 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0008d82a0, 0xc0008d81e0, 0xc002897940) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1816 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000f0e820, 0xc001b64c60, 0xc000f6b680) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1826 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0009f4410, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003f53b00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0040388c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1681 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc0012a1920, 0xc0012a1980, 0xc0012a1901, 0xc0039b0d80, 0x19) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1818 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000f0e9c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1819 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000f0e9c0, 0xc000fbd8c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1820 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000f0e9c0, 0xc002986680) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1821 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0029889d0, 0x4cf5ce0, 0xc00298ac80) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1822 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc000f0ea90) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 1825 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc002982af0, 0xc001b71030, 0x5, 0x5, 0x44b1b3, 0xc0013df1f8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002982af0, 0xc001b71030, 0x5, 0x5, 0xc00298c7c0, 0x47c8228, 0xc002d06960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0013f3770, 0xc001b71030, 0x5, 0x5, 0xc000700000, 0xc002d06988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0013f3770, 0xc001b71030, 0x5, 0x5, 0x5, 0xc003a7aae0, 0xc0039cec32, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002996700, 0xc001b71030, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001b71020, 0x7fffffff, 0xc0039cec30, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001b71020, 0xc002996700, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc0039cec01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001b71020, 0x7f91b11abcb8, 0x70524e8, 0xc002996700, 0x0, 0x0, 0x4408c80, 0xc0028a17c0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0013e8780, 0x4408c80, 0xc0028a17c0, 0x0, 0xc002d06d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0013e8780, 0xc002d06d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000ad4480, 0xc002d06e10, 0xc002d06de0, 0x44bbff, 0xc00120d860) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000ad4480, 0x4408c80, 0xc0028a17c0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001b71040, 0x4408c80, 0xc0028a17c0, 0xc002d06ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc002988a80, 0xc002d06ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000f0ea90, 0x4d854c0, 0xc002988a80) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1824 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc003cc8380, 0xc000ad4480, 0x4d56e60, 0xc0013f36e0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1842 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc000f0ea90, 0xc001b64d10, 0xc00055acc0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1843 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc002982c80, 0xc001b711f0, 0x5, 0x5, 0x0, 0x0, 0xc00298c880) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002982c80, 0xc001b711f0, 0x5, 0x5, 0xc00298c840, 0x47c8228, 0xc002d07778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0013f38f0, 0xc001b711f0, 0x5, 0x5, 0xc000600000, 0xc002d077a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0013f38f0, 0xc001b711f0, 0x5, 0x5, 0x5, 0x407fb80, 0xc00299e0c8, 0x2c) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002996800, 0xc001b711f0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001b711e0, 0x400000, 0x40f230, 0xc0029a0630, 0x90, 0x90, 0x4207f80, 0xc002d07970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001b711e0, 0xc002996800, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc002988b90, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001b711e0, 0x7f91b11abcb8, 0x70524e8, 0xc002996800, 0x0, 0x0, 0x437be20, 0xc002988ba0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc000861140, 0x437be20, 0xc002988ba0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc002988b60, 0x4d56da0, 0xc00298aec0, 0xc00074ce70) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc002988b60, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc000861140, 0x70524e8, 0xc002996800) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0028fc000, 0xc002996800, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0028fc000, 0xc002996800, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc00289ae00, 0xc000703500, 0x4d8a9e0, 0xc0028fc000, 0xc002996800) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1844 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc00298ae80, 0x1b, 0x4d56da0, 0xc00298aec0, 0xc00298c8a0, 0x12, 0xc00074ce70) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1845 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc00298af40, 0xc0010c0690, 0xc00075e720) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1846 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc00075e6c0, 0xc00075e720, 0xc00075e701, 0xc00298c8a0, 0x12) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1983 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00191e000, 0xc001349500, 0xc001a346c0, 0xc001c52ea0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1990 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc0028fe270, 0xc0013e46e0, 0xc000635e00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 1860 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc0012a19e0, 0xc0012a1920, 0xc0039fb3f0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1869 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00402ce00, 0xc00160f080, 0xc000635920, 0xc000073080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 2174 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0006652b0, 0xc003aea000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1829 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003b111e0, 0xc00160f080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1830 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc000d81b80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1831 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00402ce00, 0xbff9d2bfd90dffaa, 0x5c7e7839, 0x7019220, 0x4d01ae0, 0xc0028fe1a0, 0xc00243bbc0, 0xc000073080, 0xc00160f080, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00402ce00, 0xc00160f080, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc000d81b80, 0xc00160f080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0028b7788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc00243bf88, 0x4c9d560, 0xc00140dd70, 0x3f24d01, 0xc00160f080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0028b7788, 0x3b9aca00, 0x0, 0x47bf701, 0xc00160f080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc000d81b80, 0xc00160f080) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1832 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0019e3710, 0x4c9d560, 0xc001430cf0, 0x1, 0xc00160f140) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0019e3710, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00160f140) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1872 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0028fe1a0, 0xc00289b9e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1873 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0039fba80, 0x4cf5ce0, 0xc000efda00) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1924 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003f5f3b0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001b8baa0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0000ca480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1833 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0013a00c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1834 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001bff8c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 2011 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000f0ec30) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1849 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc00075e840, 0xc00075e6c0, 0xc002988be0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 1835 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0040396c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1836 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134630, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5fa18, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5fa00, 0xc00405e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5fa00, 0xc00405e000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e0460, 0xc00405e000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000248780, 0xc00402da78, 0x9, 0x9, 0xc00405e009, 0xc000288000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000248780, 0xc00402da78, 0x9, 0x9, 0x9, 0x317a5c798db, 0xc0029e6e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00402da78, 0x9, 0x9, 0x4c98f60, 0xc000248780, 0x0, 0x0, 0x7019220, 0x6206) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00402da40, 0xc003c217a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0040396c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1837 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0009f4eb0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0002489c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0040396c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 2111 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0000c61c0, 0xc003e7bf20, 0xc0029f6c60, 0xc001b7fd40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 2010 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc00402db20, 0xc00160fc20, 0xc0029f6180, 0xc0018fb680) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1840 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003b11560, 0xc00160fc20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1841 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc001008580) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1890 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc00402db20, 0xbff9d2bfd945a585, 0x5cb61e0c, 0x7019220, 0x4d01ae0, 0xc000f0ec30, 0xc004057bc0, 0xc0018fb680, 0xc00160fc20, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc00402db20, 0xc00160fc20, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc001008580, 0xc00160fc20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc0028b7788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc004057f88, 0x4c9d560, 0xc001efe270, 0x3f24d01, 0xc00160fc20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0028b7788, 0x3b9aca00, 0x0, 0x47bf701, 0xc00160fc20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc001008580, 0xc00160fc20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1891 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc0010848d0, 0x4c9d560, 0xc001efe4b0, 0x1, 0xc00160fce0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc0010848d0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc00160fce0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1887 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc003f50c30, 0xc001b617f0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1892 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc0013a0e40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1988 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001422380, 0xc003c8b7a0, 0x4d56e60, 0xc002981500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1893 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc00405d080) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1894 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc0012ba540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1895 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134460, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc001b5ff98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc001b5ff80, 0xc002e60000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc001b5ff80, 0xc002e60000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e0540, 0xc002e60000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc0007c9ce0, 0xc000dca818, 0x9, 0x9, 0xc002e60009, 0xc000100000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc0007c9ce0, 0xc000dca818, 0x9, 0x9, 0x9, 0x317a621ef80, 0xc0029e2e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000dca818, 0x9, 0x9, 0x4c98f60, 0xc0007c9ce0, 0x0, 0x0, 0x7019220, 0xaaaa) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000dca7e0, 0xc001a12940, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc0012ba540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1896 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0009f5860, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000280de0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc0012ba540) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1870 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0028fe1a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 2303 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc001cdca00, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003972de0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001cc4a80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 2013 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc000f0ec30, 0xc002986f20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 2073 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000dce570, 0x4c9d560, 0xc00198e5d0, 0x1, 0xc001b30840) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000dce570, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc001b30840) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 1926 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134378, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00145d998, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00145d980, 0xc002e88000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00145d980, 0xc002e88000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc001bc61b8, 0xc002e88000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001b8ba40, 0xc0000c6118, 0x9, 0x9, 0xc002e88027, 0x10000c000100000, 0x7f91b106d720) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001b8ba40, 0xc0000c6118, 0x9, 0x9, 0x9, 0x6006d37f, 0xc002e7bdd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0000c6118, 0x9, 0x9, 0x4c98f60, 0xc001b8ba40, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0000c60e0, 0xc001a128a0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0000ca480, 0xc001d60450, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0000ca480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0000ca480) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 1886 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc003f50c30, 0xc003cd3e00) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1928 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc003c21100, 0xc003e7bf20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 1929 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc000614000) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1930 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0000c61c0, 0xbff9d2bfd95e5eed, 0x5cced777, 0x7019220, 0x4d01ae0, 0xc000f0eea0, 0xc003315bc0, 0xc001b7fd40, 0xc003e7bf20, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0000c61c0, 0xc003e7bf20, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc000614000, 0xc003e7bf20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc003fee788) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc003315f88, 0x4c9d560, 0xc001c10600, 0x1, 0xc003e7bf20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003fee788, 0x3b9aca00, 0x0, 0x1, 0xc003e7bf20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc000614000, 0xc003e7bf20) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 1931 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000aba2a0, 0x4c9d560, 0xc001c10810, 0x1, 0xc003e7bf80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:167 +0x149 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000aba2a0, 0xdf8475800, 0x3ff3333333333333, 0x1, 0xc003e7bf80) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry.(*Store).startObservingCount | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/registry/generic/registry/store.go:1378 +0x266 | |
| goroutine 2175 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0006652b0, 0xc0039cfc40) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 1932 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc001b88300) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1933 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc001af1080) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1934 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00138ec40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1935 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1134290, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc00145dc98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc00145dc80, 0xc002eb4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc00145dc80, 0xc002eb4000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc001bc6270, 0xc002eb4000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001c1e240, 0xc0000c6e38, 0x9, 0x9, 0xc002eb4009, 0xc000600000, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001c1e240, 0xc0000c6e38, 0x9, 0x9, 0x9, 0x317a5cb19b1, 0xc002ef1e50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0000c6e38, 0x9, 0x9, 0x4c98f60, 0xc001c1e240, 0x0, 0x0, 0x7019220, 0x6a7b) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0000c6e00, 0xc00298cea0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00138ec40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1936 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003f5f950, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001c1e300, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00138ec40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1989 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc001851090, 0xc001383b90, 0x5, 0x5, 0x44b1b3, 0xc001b30058, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001851090, 0xc001383b90, 0x5, 0x5, 0xc0039b1280, 0x47c8228, 0xc002922960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc002981590, 0xc001383b90, 0x5, 0x5, 0xc00077e000, 0xc002922988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc002981590, 0xc001383b90, 0x5, 0x5, 0x5, 0xc003b11b80, 0xc0009dc172, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003854c00, 0xc001383b90, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001383b80, 0x7fffffff, 0xc0009dc170, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001383b80, 0xc003854c00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc0009dc101, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001383b80, 0x7f91b11abcb8, 0x70524e8, 0xc003854c00, 0x0, 0x0, 0x4408c80, 0xc000e20910, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc001376300, 0x4408c80, 0xc000e20910, 0x0, 0xc002922d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc001376300, 0xc002922d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc003c8b7a0, 0xc002922e10, 0xc002922de0, 0x44bbff, 0xc000635c20) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc003c8b7a0, 0x4408c80, 0xc000e20910, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001383ba0, 0x4408c80, 0xc000e20910, 0xc002922ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc0039fbb30, 0xc002922ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc0028fe270, 0x4d854c0, 0xc0039fbb30) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 2339 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc001cdbd60, 0xc00163cdb0, 0x5, 0x5, 0x0, 0x0, 0xc001a12a00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc001cdbd60, 0xc00163cdb0, 0x5, 0x5, 0xc001a129c0, 0x47c8228, 0xc0034cb778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc003436de0, 0xc00163cdb0, 0x5, 0x5, 0xc000100000, 0xc0034cb7a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc003436de0, 0xc00163cdb0, 0x5, 0x5, 0x5, 0x407fb80, 0xc00295c858, 0x40) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0019b1100, 0xc00163cdb0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc00163cda0, 0x400000, 0x40f230, 0xc0006f2ab0, 0x90, 0x90, 0x4207f80, 0xc0034cb970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc00163cda0, 0xc0019b1100, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0011d5390, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc00163cda0, 0x7f91b11abcb8, 0x70524e8, 0xc0019b1100, 0x0, 0x0, 0x437be20, 0xc0011d53d0, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc0013eccc0, 0x437be20, 0xc0011d53d0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0011d5300, 0x4d56da0, 0xc000d89a40, 0xc003ac9ea0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0011d5300, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc0013eccc0, 0x70524e8, 0xc0019b1100) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc001b8d500, 0xc0019b1100, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc001b8d500, 0xc0019b1100, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc0009dca20, 0xc000703500, 0x4d8a9e0, 0xc001b8d500, 0xc0019b1100) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1939 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc003f5fe50, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc003ad98c0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc0000cbc80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 1940 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc0000cbc80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 1941 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b11341a8, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc000dc2098, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc000dc2080, 0xc002ef8000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc000dc2080, 0xc002ef8000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc001bc62b8, 0xc002ef8000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001c1f080, 0xc0000c6f18, 0x9, 0x9, 0xc002ef8027, 0x10000c0010f5c00, 0x7f91b11ae1b0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001c1f080, 0xc0000c6f18, 0x9, 0x9, 0x9, 0x6006d37f, 0xc002e79dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc0000c6f18, 0x9, 0x9, 0x4c98f60, 0xc001c1f080, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc0000c6ee0, 0xc0028ab2c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc0000cbc80, 0xc001c10b70, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc0000cbc80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc0000cbc80) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 2012 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc000f0ec30, 0xc0029f61e0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1885 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc003f50c30) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 2526 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0018b01a0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 2376 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc001b46b60, 0xc001b31aa0, 0xc0019cb3e0, 0xc002ea2960) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 1871 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0028fe1a0, 0xc000635b60) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 1986 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc0028fe270) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 2070 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*timeBudgetImpl).periodicallyRefresh(0xc0039b16c0, 0xc001b30720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:69 +0xe5 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.newTimeBudget | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/time_budget.go:61 +0x6e | |
| goroutine 2072 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).watchHandler(0xc0006ffce0, 0xbff9d2bfd9a5b0be, 0x5d162942, 0x7019220, 0x4d01ae0, 0xc001979e10, 0xc002f13bc0, 0xc001c43320, 0xc001b30720, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:463 +0x1a5 | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch(0xc0006ffce0, 0xc001b30720, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:427 +0x6ac | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).startCaching(0xc0002f9340, 0xc001b30720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:418 +0x119 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1.1() | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:385 +0x65 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc003feef88) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:155 +0x5f | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc002f13f88, 0x4c9d560, 0xc00198e360, 0x1, 0xc001b30720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:156 +0xad | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc003feef88, 0x3b9aca00, 0x0, 0x1, 0xc001b30720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133 +0x98 | |
| github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait.Until(...) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:90 | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig.func1(0xc0002f9340, 0xc001b30720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:382 +0xc7 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:379 +0x94e | |
| goroutine 2360 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001980380, 0xc0009297a0, 0x4d56e60, 0xc00344a150) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 2049 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc0006ffce0, 0xc001b30720, 0xc0019caa20, 0xc001c43320) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 2059 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc001b8d500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 2236 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0003abde0, 0x4cf5ce0, 0xc001123d00) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1959 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*ccBalancerWrapper).watcher(0xc000a6a240) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:69 +0xc8 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newCCBalancerWrapper | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/balancer_conn_wrappers.go:60 +0x172 | |
| goroutine 1972 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc0039d1c70, 0xc0029955b0, 0x5, 0x5, 0x44b1b3, 0xc001a342f8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0039d1c70, 0xc0029955b0, 0x5, 0x5, 0xc0028aade0, 0x47c8228, 0xc002925960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc001c22b10, 0xc0029955b0, 0x5, 0x5, 0xc0003cb400, 0xc002925988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc001c22b10, 0xc0029955b0, 0x5, 0x5, 0x5, 0xc0039b1560, 0xc00289bd5a, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc0028a9000, 0xc0029955b0, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc0029955a0, 0x7fffffff, 0xc00289bd58, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc0029955a0, 0xc0028a9000, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc00289bd01, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc0029955a0, 0x7f91b11abcb8, 0x70524e8, 0xc0028a9000, 0x0, 0x0, 0x4408c80, 0xc001851770, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0028a7800, 0x4408c80, 0xc001851770, 0x0, 0xc002925d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0028a7800, 0xc002925d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc0028a5560, 0xc002925e10, 0xc002925de0, 0x44bbff, 0xc003cd3ec0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc0028a5560, 0x4408c80, 0xc001851770, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc0029955c0, 0x4408c80, 0xc001851770, 0xc002925ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc002897ef0, 0xc002925ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc003f50d00, 0x4d854c0, 0xc002897ef0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 1960 [chan receive]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).resetTransport(0xc0006f18c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:1179 +0x709 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*addrConn).connect | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/clientconn.go:815 +0x12a | |
| goroutine 1961 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).keepalive(0xc00198cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1331 +0x193 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:295 +0x16fc | |
| goroutine 1962 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b11340c0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc003c93398, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc003c93380, 0xc002f34000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc003c93380, 0xc002f34000, 0x8000, 0x8000, 0x94aa9e, 0x800010601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc003bf23a8, 0xc002f34000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001333860, 0xc00191ec78, 0x9, 0x9, 0xc002f34009, 0xc00009ac00, 0x0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001333860, 0xc00191ec78, 0x9, 0x9, 0x9, 0x317a62c4b64, 0xc002eefe50, 0x49d6fa) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc00191ec78, 0x9, 0x9, 0x4c98f60, 0xc001333860, 0x0, 0x0, 0x7019220, 0x348d) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc00191ec40, 0xc001bf9860, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Client).reader(0xc00198cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1265 +0x179 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:300 +0xd31 | |
| goroutine 1963 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0014520f0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001333920, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client.func3(0xc00198cc40) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x7b | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Client | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_client.go:344 +0xefc | |
| goroutine 1971 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream.func5(0xc001993c00, 0xc0028a5560, 0x4d56e60, 0xc001c229c0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:319 +0xda | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.newClientStream | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:318 +0xbf0 | |
| goroutine 1973 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveSubstream(0xc003f50d00, 0xc001492840, 0xc001a340c0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:810 +0x285 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:547 +0x859 | |
| goroutine 2130 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc003f51110, 0xc001b61cb0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 2358 [select]: | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).run(0xc001979ee0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:530 +0x385 | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watcher).newWatcherGrpcStream | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:283 +0x305 | |
| goroutine 2022 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc00407fe00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:968 +0x28a | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:302 +0x10fb | |
| goroutine 2098 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).readClient(0xc002983450, 0xc001b71990, 0x5, 0x5, 0x44b1b3, 0xc0029f66b8, 0x1) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:186 +0xd3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc002983450, 0xc001b71990, 0x5, 0x5, 0xc00298cd20, 0x47c8228, 0xc002d07960) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:166 +0x190 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0006da630, 0xc001b71990, 0x5, 0x5, 0xc00009ac00, 0xc002d07988, 0x972e3c) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0006da630, 0xc001b71990, 0x5, 0x5, 0x5, 0xc001bf9000, 0xc001b9d6c2, 0x0) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc002996a00, 0xc001b71990, 0x5, 0x5, 0x3ffb940, 0x2, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001b71980, 0x7fffffff, 0xc001b9d6c0, 0x6, 0x6, 0x0, 0x0, 0x4d22160) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001b71980, 0xc002996a00, 0x0, 0x0, 0x7fffffff, 0x0, 0x0, 0x0, 0xc001b9d601, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001b71980, 0x7f91b11abcb8, 0x70524e8, 0xc002996a00, 0x0, 0x0, 0x4408c80, 0xc0014529b0, 0x7fffffff, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*csAttempt).recvMsg(0xc0013e8f80, 0x4408c80, 0xc0014529b0, 0x0, 0xc002d07d20, 0x44b1b3) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:885 +0xee | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg.func1(0xc0013e8f80, 0xc002d07d60, 0x46a2b7) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:736 +0x46 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).withRetry(0xc000ad46c0, 0xc002d07e10, 0xc002d07de0, 0x44bbff, 0xc0029f62a0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:590 +0x37e | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*clientStream).RecvMsg(0xc000ad46c0, 0x4408c80, 0xc0014529b0, 0x50, 0x438a820) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:735 +0x105 | |
| github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.(*monitoredClientStream).RecvMsg(0xc001b719a0, 0x4408c80, 0xc0014529b0, 0xc002d07ef4, 0x2) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/client_metrics.go:160 +0x4b | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchClient).Recv(0xc002989400, 0xc002d07ef0, 0x2, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3704 +0x62 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).serveWatchClient(0xc000f0ed00, 0x4d854c0, 0xc002989400) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:764 +0x5c | |
| created by github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3.(*watchGrpcStream).newWatchClient | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/clientv3/watch.go:919 +0x545 | |
| goroutine 2112 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc000f0eea0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 2071 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.(*Cacher).dispatchEvents(0xc0002f9340) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:794 +0x1fa | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher.NewCacherFromConfig | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/cacher/cacher.go:376 +0x8fb | |
| goroutine 1992 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000efdd80, 0x1c, 0x4d56da0, 0xc000efddc0, 0xc0039b1380, 0x12, 0xc002956d20) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 2232 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch.func2(0xc000dcaa80, 0xc001372b40, 0xc001a352c0, 0xc0037522a0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:373 +0x16f | |
| created by github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache.(*Reflector).ListAndWatch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/client-go/tools/cache/reflector.go:367 +0x2c5 | |
| goroutine 2058 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000e21400, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc001c0d500, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc001b8d500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 2021 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc000e20af0, 0x1, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x125 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc000d99020, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1d3 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc00407fe00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:296 +0xd7 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.newHTTP2Server | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:293 +0x10d6 | |
| goroutine 2025 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0018f9860) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 1993 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc000efde40, 0xc0010c0690, 0xc001c2e3c0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 1994 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001c2e2a0, 0xc001c2e3c0, 0xc001c2e301, 0xc0039b1380, 0x12) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 1998 [select]: | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).read(0xc0018514f0, 0xc001383ff0, 0x5, 0x5, 0x400, 0x180, 0x17f) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:174 +0xcb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*recvBufferReader).Read(0xc0018514f0, 0xc001383ff0, 0x5, 0x5, 0xc0039b1440, 0x47c8228, 0xc003039778) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:168 +0x211 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*transportReader).Read(0xc0029819b0, 0xc001383ff0, 0x5, 0x5, 0xc0003cb400, 0xc0030397a0, 0x9742dc) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:479 +0x55 | |
| io.ReadAtLeast(0x4c9cbe0, 0xc0029819b0, 0xc001383ff0, 0x5, 0x5, 0x5, 0x407fb80, 0xc00012cbf8, 0x2c) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*Stream).Read(0xc003854e00, 0xc001383ff0, 0x5, 0x5, 0x3ffb940, 0x8, 0x7f91b1250440) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/transport.go:463 +0xd2 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*parser).recvMsg(0xc001383fe0, 0x400000, 0x40f230, 0xc003809cb0, 0x90, 0x90, 0x4207f80, 0xc003039970) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:508 +0x63 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recvAndDecompress(0xc001383fe0, 0xc003854e00, 0x0, 0x0, 0x400000, 0x0, 0x0, 0x0, 0xc0039fbdf0, 0x10, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:639 +0x4d | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.recv(0xc001383fe0, 0x7f91b11abcb8, 0x70524e8, 0xc003854e00, 0x0, 0x0, 0x437be20, 0xc0039fbe00, 0x400000, 0x0, ...) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/rpc_util.go:707 +0x9b | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*serverStream).RecvMsg(0xc001908780, 0x437be20, 0xc0039fbe00, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/stream.go:1474 +0x156 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb.(*watchWatchServer).Recv(0xc0039fbdc0, 0x4d56da0, 0xc000efdfc0, 0xc002956d90) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3745 +0x62 | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*KVServerBridge).Watch(0xc0000101c8, 0x4d85520, 0xc0039fbdc0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:26 +0x142 | |
| github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb._Watch_Watch_Handler(0x43577c0, 0xc0000101c8, 0x4d73dc0, 0xc001908780, 0x70524e8, 0xc003854e00) | |
| /go/src/github.com/rancher/k3s/vendor/go.etcd.io/etcd/etcdserver/etcdserverpb/rpc.pb.go:3726 +0xad | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc000703500, 0x4d8a9e0, 0xc0039fec00, 0xc003854e00, 0xc00129d170, 0x6d62ea0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1237 +0xcdd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleStream(0xc000703500, 0x4d8a9e0, 0xc0039fec00, 0xc003854e00, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:1317 +0xccd | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc001c20620, 0xc000703500, 0x4d8a9e0, 0xc0039fec00, 0xc003854e00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:722 +0xa5 | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams.func1 | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:720 +0xa5 | |
| goroutine 1997 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch.func1(0x3, 0x0, 0x0, 0x0, 0x0, 0xc001c2e420, 0xc001c2e2a0, 0xc0039fbc90) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:353 +0xef | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured.(*LogStructured).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/logstructured.go:342 +0x43d | |
| goroutine 2173 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run(0xc0006652b0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:162 +0x1d6 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watcher).Watch | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:122 +0x145 | |
| goroutine 2060 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b12885c0, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0007b2f98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0007b2f80, 0xc00309c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0007b2f80, 0xc00309c000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e0658, 0xc00309c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc001c0d3e0, 0xc000dca9d8, 0x9, 0x9, 0xc00309c027, 0x10000c000600000, 0x7f91b11b6cb0) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc001c0d3e0, 0xc000dca9d8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc003037dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000dca9d8, 0x9, 0x9, 0x4c98f60, 0xc001c0d3e0, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000dca9a0, 0xc00298d7c0, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc001b8d500, 0xc001c4b4a0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc001b8d500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc001b8d500) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 2023 [IO wait]: | |
| internal/poll.runtime_pollWait(0x7f91b1288790, 0x72, 0x4ca6060) | |
| /usr/local/go/src/runtime/netpoll.go:222 +0x55 | |
| internal/poll.(*pollDesc).wait(0xc0007b2b98, 0x72, 0x4ca6000, 0x6da2220, 0x0) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x45 | |
| internal/poll.(*pollDesc).waitRead(...) | |
| /usr/local/go/src/internal/poll/fd_poll_runtime.go:92 | |
| internal/poll.(*FD).Read(0xc0007b2b80, 0xc00303c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5 | |
| net.(*netFD).Read(0xc0007b2b80, 0xc00303c000, 0x8000, 0x8000, 0x203000, 0x800000601, 0x0) | |
| /usr/local/go/src/net/fd_posix.go:55 +0x4f | |
| net.(*conn).Read(0xc0018e05d8, 0xc00303c000, 0x8000, 0x8000, 0x0, 0x0, 0x0) | |
| /usr/local/go/src/net/net.go:182 +0x8e | |
| bufio.(*Reader).Read(0xc000d98840, 0xc000dca8f8, 0x9, 0x9, 0xc00303c027, 0x10000c00009ac00, 0x7f91b11dd418) | |
| /usr/local/go/src/bufio/bufio.go:227 +0x222 | |
| io.ReadAtLeast(0x4c98f60, 0xc000d98840, 0xc000dca8f8, 0x9, 0x9, 0x9, 0x6006d37f, 0xc0029e3dd0, 0x49dca6) | |
| /usr/local/go/src/io/io.go:314 +0x87 | |
| io.ReadFull(...) | |
| /usr/local/go/src/io/io.go:333 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.readFrameHeader(0xc000dca8f8, 0x9, 0x9, 0x4c98f60, 0xc000d98840, 0x0, 0x0, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:237 +0x89 | |
| github.com/rancher/k3s/vendor/golang.org/x/net/http2.(*Framer).ReadFrame(0xc000dca8c0, 0xc001bf9840, 0x7019220, 0x0, 0x0) | |
| /go/src/github.com/rancher/k3s/vendor/golang.org/x/net/http2/frame.go:492 +0xa5 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc00407fe00, 0xc001c4a9c0, 0x47bf5b0) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/internal/transport/http2_server.go:458 +0x98 | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).serveStreams(0xc000703500, 0x4d8a9e0, 0xc00407fe00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:718 +0xdb | |
| github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000703500, 0x4d8a9e0, 0xc00407fe00) | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:679 +0x3f | |
| created by github.com/rancher/k3s/vendor/google.golang.org/grpc.(*Server).handleRawConn | |
| /go/src/github.com/rancher/k3s/vendor/google.golang.org/grpc/server.go:678 +0x55b | |
| goroutine 2525 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc001208040, 0x4cf5ce0, 0xc001b89640) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel | |
| /usr/local/go/src/context/context.go:278 +0x1fb | |
| goroutine 1999 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start.func1(0xc000efdf80, 0x1d, 0x4d56da0, 0xc000efdfc0, 0xc0039b14a0, 0x12, 0xc002956d90) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:74 +0x194 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server.(*watcher).Start | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/server/watch.go:63 +0x346 | |
| goroutine 1985 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc003f51110, 0xc001a34720) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 2000 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe.func1(0x4d56da0, 0xc001c9a040, 0xc0010c0690, 0xc001c2e8a0) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:32 +0x48 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster.(*Broadcaster).Subscribe | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/broadcaster/broadcaster.go:31 +0x125 | |
| goroutine 2001 [chan receive]: | |
| github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch.func1(0xc001c2e840, 0xc001c2e8a0, 0xc001c2e801, 0xc0039b14a0, 0x12) | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:343 +0x85 | |
| created by github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog.(*SQLLog).Watch | |
| /go/src/github.com/rancher/k3s/vendor/github.com/k3s-io/kine/pkg/logstructured/sqllog/sql.go:341 +0x11d | |
| goroutine 2026 [chan receive]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).startWatching(0xc0018f9860, 0xc0013720c0) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:243 +0x245 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:156 +0x7f | |
| goroutine 2027 [select]: | |
| github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).processEvent(0xc0018f9860, 0xc0009dc340) | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:279 +0x139 | |
| created by github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3.(*watchChan).run | |
| /go/src/github.com/rancher/k3s/vendor/k8s.io/apiserver/pkg/storage/etcd3/watcher.go:160 +0xda | |
| goroutine 2028 [select]: | |
| context.propagateCancel.func1(0x4d58160, 0xc0012382f0, 0x4cf5ce0, 0xc0013a1ac0) | |
| /usr/local/go/src/context/context.go:279 +0xda | |
| created by context.propagateCancel |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment