Marathon crash

gistfile1.txt

Jul 02 08:58:58  marathon.sh[27584]: [2019-07-02 08:58:58,262] INFO  172.18.1.62 - - [02/Jul/2019:08:58:58 +0000] "GET /v2/groups?embed=group.groups&embed=group.apps&embed=group.apps.deployments&embed=group.apps.counts&embed=group.apps.readiness HTTP/1.1" 200 35146 "http://172.18.1.62/service/marathon/ui/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/75.0.3770.90 Chrome/75.0.3770.90 Safari/537.36" 2 (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-462)
Jul 02 08:58:58  marathon.sh[27584]: [2019-07-02 08:58:58,900] INFO  44.128.0.2 - - [02/Jul/2019:08:58:58 +0000] "GET /v2/queue HTTP/1.1" 200 12 "-" "python-requests/2.18.4"  (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-462)
Jul 02 08:59:03  marathon.sh[27584]: [2019-07-02 08:59:03,247] INFO  172.18.1.62 - - [02/Jul/2019:08:59:03 +0000] "GET /v2/queue HTTP/1.1" 200 12 "http://172.18.1.62/service/marathon/ui/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/75.0.3770.90 Chrome/75.0.3770.90 Safari/537.36"  (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-458)
Jul 02 08:59:03  marathon.sh[27584]: [2019-07-02 08:59:03,248] INFO  172.18.1.62 - - [02/Jul/2019:08:59:03 +0000] "GET /v2/deployments HTTP/1.1" 200 2 "http://172.18.1.62/service/marathon/ui/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/75.0.3770.90 Chrome/75.0.3770.90 Safari/537.36"  (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-445)
Jul 02 08:59:03  marathon.sh[27584]: [2019-07-02 08:59:03,269] INFO  172.18.1.62 - - [02/Jul/2019:08:59:03 +0000] "GET /v2/groups?embed=group.groups&embed=group.apps&embed=group.apps.deployments&embed=group.apps.counts&embed=group.apps.readiness HTTP/1.1" 200 35146 "http://172.18.1.62/service/marathon/ui/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/75.0.3770.90 Chrome/75.0.3770.90 Safari/537.36" 2 (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-458)
Jul 02 08:59:04  marathon.sh[27584]: [2019-07-02 08:59:04,211] INFO  127.0.0.1 - - [02/Jul/2019:08:59:04 +0000] "GET /v2/apps?embed=apps.tasks&label=DCOS_SERVICE_NAME HTTP/1.1" 200 11 "-" "Master Admin Router"  (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-458)
Jul 02 08:59:04  marathon.sh[27584]: [2019-07-02 08:59:04,212] INFO  127.0.0.1 - - [02/Jul/2019:08:59:04 +0000] "GET /v2/leader HTTP/1.1" 200 29 "-" "Master Admin Router"  (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-445)
Jul 02 08:59:05  marathon.sh[27584]: [2019-07-02 08:59:05,401] INFO  44.128.0.3 - - [02/Jul/2019:08:59:05 +0000] "GET /v2/queue HTTP/1.1" 200 12 "-" "python-requests/2.18.4"  (mesosphere.marathon.api.JettyRequestLog:scala-execution-context-global-445)
Jul 02 08:59:07  marathon.sh[27584]: [2019-07-02 08:59:07,928] WARN  Client session timed out, have not heard from server in 6669ms for sessionid 0x1000051338f0482 (org.apache.zookeeper.ClientCnxn:main-SendThread(leader.mesos:2181))
Jul 02 08:59:07  marathon.sh[27584]: [2019-07-02 08:59:07,929] INFO  Client session timed out, have not heard from server in 6669ms for sessionid 0x1000051338f0482, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn:main-SendThread(leader.mesos:2181))
Jul 02 08:59:08  marathon.sh[27584]: [2019-07-02 08:59:08,030] INFO  State change: SUSPENDED (org.apache.curator.framework.state.ConnectionStateManager:main-EventThread)
Jul 02 08:59:08  marathon.sh[27584]: [2019-07-02 08:59:08,033] INFO  backgroundOperationsLoop exiting (org.apache.curator.framework.imps.CuratorFrameworkImpl:Curator-Framework-0)
Jul 02 08:59:08  marathon.sh[27584]: [2019-07-02 08:59:08,042] INFO  Session: 0x1000051338f0482 closed (org.apache.zookeeper.ZooKeeper:Curator-ConnectionStateManager-0)
Jul 02 08:59:08  marathon.sh[27584]: [2019-07-02 08:59:08,042] INFO  EventThread shut down for session: 0x1000051338f0482 (org.apache.zookeeper.ClientCnxn:main-EventThread)
Jul 02 08:59:08  marathon.sh[27584]: [2019-07-02 08:59:08,050] INFO  shutting down with exit code 101 (mesosphere.marathon.core.base.RichRuntime:scala-execution-context-global-445)
Jul 02 08:59:08  marathon.sh[27584]: I0702 08:59:08.069344 29717 sched.cpp:2008] Asked to stop the driver
Jul 02 08:59:08  marathon.sh[27584]: I0702 08:59:08.069814 27954 sched.cpp:1184] Stopping framework db44b798-6f0e-43e7-aef6-56342d299cca-0001
Jul 02 08:59:08  marathon.sh[27584]: 366.501: [GC (Allocation Failure) [PSYoungGen: 430842K->6126K(591360K)] 492539K->67831K(1118720K), 0.0364574 secs] [Times: user=0.06 sys=0.01, real=0.04 secs]
Jul 02 08:59:08  marathon.sh[27584]: Heap
Jul 02 08:59:08  marathon.sh[27584]:  PSYoungGen      total 591360K, used 21222K [0x0000000718700000, 0x0000000740600000, 0x00000007c0000000)
Jul 02 08:59:08  marathon.sh[27584]:   eden space 579584K, 2% used [0x0000000718700000,0x00000007195be0b0,0x000000073bd00000)
Jul 02 08:59:08  marathon.sh[27584]:   from space 11776K, 52% used [0x000000073fa80000,0x000000074007ba10,0x0000000740600000)
Jul 02 08:59:08  marathon.sh[27584]:   to   space 37376K, 0% used [0x000000073bd00000,0x000000073bd00000,0x000000073e180000)
Jul 02 08:59:08  marathon.sh[27584]:  ParOldGen       total 527360K, used 61705K [0x00000005c9400000, 0x00000005e9700000, 0x0000000718700000)
Jul 02 08:59:08  marathon.sh[27584]:   object space 527360K, 11% used [0x00000005c9400000,0x00000005cd042538,0x00000005e9700000)
Jul 02 08:59:08  marathon.sh[27584]:  Metaspace       used 94892K, capacity 106137K, committed 106368K, reserved 1142784K
Jul 02 08:59:08  marathon.sh[27584]:   class space    used 12443K, capacity 13123K, committed 13184K, reserved 1048576K
Jul 02 08:59:08  systemd[1]: dcos-marathon.service: Main process exited, code=exited, status=101/n/a
Jul 02 08:59:08  systemd[1]: dcos-marathon.service: Failed with result 'exit-code'.
Jul 02 08:59:23  systemd[1]: dcos-marathon.service: Service RestartSec=15s expired, scheduling restart.
Jul 02 08:59:23  systemd[1]: dcos-marathon.service: Scheduled restart job, restart counter is at 83.
Jul 02 08:59:23  systemd[1]: Stopped Marathon: container orchestration engine.
Jul 02 08:59:23  systemd[1]: Starting Marathon: container orchestration engine...
Jul 02 08:59:24  bootstrap[29767]: pid=29767:[INFO] Clearing proxy environment variables
Jul 02 08:59:24  bootstrap[29767]: pid=29767:[INFO] PID 22663 has command line [b'/opt/mesosphere/active/java/usr/java/bin/java', b'-Dzookeeper.log.dir=/var/lib/dcos/exhibitor/zookeeper', b'-Dzookeeper.root.logger=INFO,CONSOLE', b'-cp', b'/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../zookeeper-server/target/classes:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../build/classes:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../zookeeper-server/target/lib/*.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../build/lib/*.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/slf4j-log4j12-1.7.25.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/slf4j-api-1.7.25.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/netty-3.10.6.Final.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/log4j-systemd-journal-appender-1.3.2.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/log4j-jna-4.2.2.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/log4j-1.2.17.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../lib/audience-annotations-0.5.0.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../zookeeper-3.4.14.jar:/opt/mesosphere/active/exhibitor/usr/zookeeper/bin/../zookeeper-server/src/main/resources/lib/*.jar:/var/lib/dcos/exhibitor/conf:', b'-Djna.tmpdir=/var/lib/dcos/exhibitor/tmp', b'-Dcom.sun.management.jmxremote', b'-Dcom.sun.management.jmxremote.local.only=false', b'org.apache.zookeeper.server.quorum.QuorumPeerMain', b'/var/lib/dcos/exhibitor/conf/zoo.cfg']
Jul 02 08:59:24  bootstrap[29767]: pid=29767:[INFO] PID file hasn't been modified. ZK still seems to be at that PID.
Jul 02 08:59:24  bootstrap[29767]: pid=29767:[INFO] Shortcut succeeeded, assuming local zk is in good config state, not waiting for quorum.
Jul 02 08:59:24  bootstrap[29767]: pid=29767:[INFO] bootstrapping dcos-marathon
Jul 02 08:59:24  systemd[1]: Started Marathon: container orchestration engine.
Jul 02 08:59:24  marathon.sh[29773]: No start hook file found ($HOOK_MARATHON_START). Proceeding with the start script.
Jul 02 08:59:26  marathon.sh[29773]: [2019-07-02 08:59:26,523] INFO  Successfully loaded libmesos: version 1.8.1 (mesosphere.marathon.MarathonApp:main)
Jul 02 08:59:27  marathon.sh[29773]: 2.833: [GC (Metadata GC Threshold) [PSYoungGen: 85332K->13154K(150528K)] 85332K->13242K(494592K), 0.0275951 secs] [Times: user=0.04 sys=0.01, real=0.03 secs]
Jul 02 08:59:27  marathon.sh[29773]: 2.862: [Full GC (Metadata GC Threshold) [PSYoungGen: 13154K->0K(150528K)] [ParOldGen: 88K->12562K(225280K)] 13242K->12562K(375808K), [Metaspace: 19380K->19380K(1067008K)], 0.0487887 secs] [Times: user=0.09 sys=0.03, real=0.05 secs]
Jul 02 08:59:27  marathon.sh[29773]: [2019-07-02 08:59:27,943] INFO  Slf4jLogger started (akka.event.slf4j.Slf4jLogger:marathon-akka.actor.default-dispatcher-3)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,060] INFO  Starting heartbeat actor (mesosphere.marathon.core.heartbeat.HeartbeatActor:marathon-akka.actor.default-dispatcher-5)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,382] INFO  Running in ZooKeeper 3.4.x compatibility mode (org.apache.curator.utils.Compatibility:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,438] INFO  Starting (org.apache.curator.framework.imps.CuratorFrameworkImpl:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,448] INFO  Client environment:zookeeper.version=3.4.11-37e277162d567b55a07d1755f0b31c32e93c01a0, built on 11/01/2017 18:06 GMT (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:host.name=leader.mesos (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.version=1.8.0_192 (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.home=/opt/mesosphere/packages/java--29d9286ad4e12183440f56db5ed91c56bac8e7fc/usr/java/jre (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.class.path=/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/mesosphere.marathon.marathon-1.8.194.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/mesosphere.marathon.plugin-interface-1.8.194.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/commons-codec.commons-codec-1.9.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-http-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/net.logstash.logback.logstash-logback-encoder-4.9.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.yetus.audience-annotations-0.5.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scala-lang.scala-reflect-2.12.7.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.module.jackson-module-jaxb-annotations-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scalamacros.resetallattrs_2.12-1.0.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.core.jersey-server-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.netty.netty-3.10.5.Final.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.xml.bind.jaxb-api-2.3.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scala-lang.modules.scala-parser-combinators_2.12-1.1.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.module.jackson-module-paranamer-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.lightbend.akka.akka-stream-alpakka-s3_2.12-0.14.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.module.jackson-module-scala_2.12-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.play.play-json_2.12-2.6.7.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.media.jersey-media-multipart-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-actor_2.12-2.5.14.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.hk2.hk2-api-2.5.0-b42.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-servlet-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.httpcomponents.httpcore-4.4.4.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.inject.javax.inject-1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.getsentry.raven.raven-8.0.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.containers.jersey-container-servlet-core-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.google.guava.guava-20.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.mesos.mesos-1.8.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.media.jersey-media-jaxb-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.hdrhistogram.HdrHistogram-2.1.10.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.commons.commons-compress-1.13.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-io-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.core.jersey-client-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/commons-beanutils.commons-beanutils-1.9.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.amazonaws.aws-java-sdk-core-1.11.243.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/commons-collections.commons-collections-3.2.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.rogach.scallop_2.12-3.1.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.containers.jersey-container-servlet-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.play.play-functional_2.12-2.6.7.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.slf4j.jul-to-slf4j-1.7.21.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-healthchecks-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-jvm-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-http_2.12-10.0.11.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.reactivestreams.reactive-streams-1.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/jline.jline-0.9.94.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-server-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/ch.qos.logback.logback-classic-1.2.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scala-lang.scala-library-2.12.7.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scala-lang.modules.scala-async_2.12-0.9.7.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scala-lang.modules.scala-xml_2.12-1.0.6.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.core.jackson-core-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.config-1.3.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.inject.jersey-hk2-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.8.9.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.curator.curator-x-async-4.0.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-jetty9-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/commons-io.commons-io-2.6.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.scala-lang.modules.scala-java8-compat_2.12-0.9.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/junit.junit-4.12.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-util-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-parsing_2.12-10.0.11.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.hk2.external.aopalliance-repackaged-2.5.0-b42.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-continuation-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-servlets-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/de.heikoseeberger.akka-http-play-json_2.12-1.18.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.getsentry.raven.raven-logback-8.0.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.jvnet.mimepull.mimepull-1.9.6.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.papertrail.profiler-1.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.javassist.javassist-3.22.0-CR2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-stream_2.12-2.5.14.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-http-xml_2.12-10.0.9.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.jersey.core.jersey-common-2.27.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/mesosphere.marathon.ui-1.3.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.thoughtworks.paranamer.paranamer-2.8.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.uuid.java-uuid-generator-3.1.4.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.activation.javax.activation-api-1.2.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-core-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/software.amazon.ion.ion-java-1.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.hamcrest.hamcrest-core-1.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/joda-time.joda-time-2.9.9.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.curator.curator-recipes-4.0.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.8.9.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.lightbend.akka.akka-stream-alpakka-simple-codecs_2.12-0.14.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-http-core_2.12-10.0.11.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.curator.curator-framework-4.0.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-servlets-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.ws.rs.javax.ws.rs-api-2.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-annotation-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.validation.validation-api-1.1.0.Final.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.zookeeper.zookeeper-3.4.11.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.eclipse.jetty.jetty-security-9.4.8.v20171121.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.javabits.jgrapht.jgrapht-core-0.9.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-base-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.wix.accord-api_2.12-0.7.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.slf4j.slf4j-api-1.7.25.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.dataformat.jackson-dataformat-cbor-2.6.7.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.scala-logging.scala-logging_2.12-3.7.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.typelevel.macro-compat_2.12-1.1.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/mesosphere.marathon.api-console-3.0.8-accept.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.hk2.hk2-locator-2.5.0-b42.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/aopalliance.aopalliance-1.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.core.jackson-databind-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/ch.qos.logback.logback-core-1.2.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.wix.accord-core_2.12-0.7.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.hk2.external.javax.inject-2.5.0-b42.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-jersey2-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.curator.curator-client-4.0.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.hk2.hk2-utils-2.5.0-b42.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/io.dropwizard.metrics.metrics-json-4.0.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.annotation.javax.annotation-api-1.3.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.core.jackson-annotations-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.github.vladimir-bukhtoyarov.rolling-metrics-2.0.4.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-slf4j_2.12-2.5.14.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.google.protobuf.protobuf-java-3.5.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.glassfish.hk2.osgi-resource-locator-1.0.1.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.fasterxml.jackson.jaxrs.jackson-jaxrs-json-provider-2.9.5.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.akka.akka-protobuf_2.12-2.5.14.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.typesafe.ssl-config-core_2.12-0.2.3.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/org.apache.httpcomponents.httpclient-4.5.2.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/javax.servlet.javax.servlet-api-3.1.0.jar:/opt/mesosphere/packages/marathon--ab39a287ac85eb8fbfda58f6bc59f5b022c8c561/marathon/lib/com.google.inject.guice-4.1.0.jar (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.library.path=/opt/mesosphere/lib:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:os.version=4.19.43-coreos (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:user.name=dcos_marathon (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:user.home=/opt/mesosphere (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,449] INFO  Client environment:user.dir=/var/lib/dcos/marathon (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,450] INFO  Initiating client connection, connectString=zk-1.zk:2181,zk-2.zk:2181,zk-3.zk:2181,zk-4.zk:2181,zk-5.zk:2181 sessionTimeout=10000 watcher=org.apache.curator.ConnectionState@62a8fd44 (org.apache.zookeeper.ZooKeeper:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,503] INFO  Default schema (org.apache.curator.framework.imps.CuratorFrameworkImpl:main)
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,506] INFO  Opening socket connection to server leader.mesos/172.18.1.62:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn:main-SendThread(leader.mesos:2181))
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,519] INFO  Socket connection established to leader.mesos/172.18.1.62:2181, initiating session (org.apache.zookeeper.ClientCnxn:main-SendThread(leader.mesos:2181))
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,924] INFO  Session establishment complete on server leader.mesos/172.18.1.62:2181, sessionid = 0x1000051338f0494, negotiated timeout = 10000 (org.apache.zookeeper.ClientCnxn:main-SendThread(leader.mesos:2181))
Jul 02 08:59:29  marathon.sh[29773]: [2019-07-02 08:59:29,941] INFO  State change: CONNECTED (org.apache.curator.framework.state.ConnectionStateManager:main-EventThread)
Jul 02 08:59:30  marathon.sh[29773]: 5.393: [GC (Allocation Failure) [PSYoungGen: 129024K->14934K(150528K)] 141586K->27504K(375808K), 0.0807809 secs] [Times: user=0.10 sys=0.02, real=0.08 secs]