Je sais que cela a été demandé avant , alors veuillez me pardonner de demander à nouveau, mais aucune des solutions pointées par ce fil n'a fonctionné pour moi.
J'essaie de configurer Kafka 0.10.20
en suivant les documents. Lorsque je démarre ZooKeeper, j'obtiens les journaux suivants:
$ bin/zookeeper-server-start.sh config/zookeeper.properties
[2017-04-22 12:25:15,810] INFO Reading configuration from: config/zookeeper.properties (org.Apache.zookeeper.server.quorum.QuorumPeerConfig)
[2017-04-22 12:25:15,814] INFO autopurge.snapRetainCount set to 3 (org.Apache.zookeeper.server.DatadirCleanupManager)
[2017-04-22 12:25:15,815] INFO autopurge.purgeInterval set to 0 (org.Apache.zookeeper.server.DatadirCleanupManager)
[2017-04-22 12:25:15,815] INFO Purge task is not scheduled. (org.Apache.zookeeper.server.DatadirCleanupManager)
[2017-04-22 12:25:15,815] WARN Either no config or no quorum defined in config, running in standalone mode (org.Apache.zookeeper.server.quorum.QuorumPeerMain)
[2017-04-22 12:25:15,837] INFO Reading configuration from: config/zookeeper.properties (org.Apache.zookeeper.server.quorum.QuorumPeerConfig)
[2017-04-22 12:25:15,837] INFO Starting server (org.Apache.zookeeper.server.ZooKeeperServerMain)
[2017-04-22 12:25:15,855] INFO Server environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,855] INFO Server environment:Host.name=10.0.0.4 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,855] INFO Server environment:Java.version=1.8.0_121 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,856] INFO Server environment:Java.vendor=Oracle Corporation (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,856] INFO Server environment:Java.home=/usr/lib/jvm/Java-8-Oracle/jre (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,856] INFO Server environment:Java.class.path=:/home/bbanner/kafka-1/bin/../libs/aopalliance-repackaged-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/argparse4j-0.7.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-api-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-file-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-json-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-runtime-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-transforms-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/guava-18.0.jar:/home/bbanner/kafka-1/bin/../libs/hk2-api-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/hk2-locator-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/hk2-utils-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/jackson-annotations-2.8.0.jar:/home/bbanner/kafka-1/bin/../libs/jackson-annotations-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-core-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-databind-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-jaxrs-base-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-jaxrs-json-provider-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-module-jaxb-annotations-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/javassist-3.20.0-GA.jar:/home/bbanner/kafka-1/bin/../libs/javax.annotation-api-1.2.jar:/home/bbanner/kafka-1/bin/../libs/javax.inject-1.jar:/home/bbanner/kafka-1/bin/../libs/javax.inject-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/javax.servlet-api-3.1.0.jar:/home/bbanner/kafka-1/bin/../libs/javax.ws.rs-api-2.0.1.jar:/home/bbanner/kafka-1/bin/../libs/jersey-client-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-common-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-container-servlet-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-container-servlet-core-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-guava-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-media-jaxb-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-server-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jetty-continuation-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-http-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-io-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-security-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-server-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-servlet-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-servlets-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-util-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jopt-simple-5.0.3.jar:/home/bbanner/kafka-1/bin/../libs/kafka_2.11-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka_2.11-0.10.2.0-sources.jar:/home/bbanner/kafka-1/bin/../libs/kafka_2.11-0.10.2.0-test-sources.jar:/home/bbanner/kafka-1/bin/../libs/kafka-clients-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-log4j-appender-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-streams-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-streams-examples-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-tools-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/log4j-1.2.17.jar:/home/bbanner/kafka-1/bin/../libs/lz4-1.3.0.jar:/home/bbanner/kafka-1/bin/../libs/metrics-core-2.2.0.jar:/home/bbanner/kafka-1/bin/../libs/osgi-resource-locator-1.0.1.jar:/home/bbanner/kafka-1/bin/../libs/reflections-0.9.10.jar:/home/bbanner/kafka-1/bin/../libs/rocksdbjni-5.0.1.jar:/home/bbanner/kafka-1/bin/../libs/scala-library-2.11.8.jar:/home/bbanner/kafka-1/bin/../libs/scala-parser-combinators_2.11-1.0.4.jar:/home/bbanner/kafka-1/bin/../libs/slf4j-api-1.7.21.jar:/home/bbanner/kafka-1/bin/../libs/slf4j-log4j12-1.7.21.jar:/home/bbanner/kafka-1/bin/../libs/snappy-Java-1.1.2.6.jar:/home/bbanner/kafka-1/bin/../libs/validation-api-1.1.0.Final.jar:/home/bbanner/kafka-1/bin/../libs/zkclient-0.10.jar:/home/bbanner/kafka-1/bin/../libs/zookeeper-3.4.9.jar (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,857] INFO Server environment:Java.library.path=/usr/Java/packages/lib/AMD64:/usr/lib64:/lib64:/lib:/usr/lib (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,857] INFO Server environment:Java.io.tmpdir=/tmp (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,857] INFO Server environment:Java.compiler=<NA> (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,857] INFO Server environment:os.name=Linux (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,857] INFO Server environment:os.Arch=AMD64 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,857] INFO Server environment:os.version=4.4.0-72-generic (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,858] INFO Server environment:user.name=bbanner (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,858] INFO Server environment:user.home=/home/bbanner (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,858] INFO Server environment:user.dir=/home/bbanner/kafka-1 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,876] INFO tickTime set to 3000 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,876] INFO minSessionTimeout set to -1 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,877] INFO maxSessionTimeout set to -1 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:15,892] INFO binding to port 0.0.0.0/0.0.0.0:2181 (org.Apache.zookeeper.server.NIOServ
Je procède ensuite au démarrage de Kafka, et tout semble OK aussi:
$ bin/kafka-server-start.sh config/server.properties [152/176]
[2017-04-22 12:25:56,342] INFO KafkaConfig values:
advertised.Host.name = null
advertised.listeners = null
advertised.port = null
authorizer.class.name =
auto.create.topics.enable = true
auto.leader.rebalance.enable = true
background.threads = 10
broker.id = 1
broker.id.generation.enable = true
broker.rack = null
compression.type = producer
connections.max.idle.ms = 600000
controlled.shutdown.enable = true
controlled.shutdown.max.retries = 3
controlled.shutdown.retry.backoff.ms = 5000
controller.socket.timeout.ms = 30000
create.topic.policy.class.name = null
default.replication.factor = 1
delete.topic.enable = false
fetch.purgatory.purge.interval.requests = 1000
group.max.session.timeout.ms = 300000
group.min.session.timeout.ms = 6000
Host.name =
inter.broker.listener.name = null
inter.broker.protocol.version = 0.10.2-IV0
leader.imbalance.check.interval.seconds = 300
leader.imbalance.per.broker.percentage = 10
listener.security.protocol.map = SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,TRACE:TRACE,SASL_SSL:SASL_SSL,PLAINTEXT:PLAINTEXT
listeners = PLAINTEXT://:19092
log.cleaner.backoff.ms = 15000
log.cleaner.dedupe.buffer.size = 134217728
log.cleaner.delete.retention.ms = 86400000
log.cleaner.enable = true
log.cleaner.io.buffer.load.factor = 0.9
log.cleaner.io.buffer.size = 524288
log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
log.cleaner.min.cleanable.ratio = 0.5
log.cleaner.min.compaction.lag.ms = 0
log.cleaner.threads = 1
log.cleanup.policy = [delete]
log.dir = /tmp/kafka-logs
log.dirs = /tmp/kafka-logs-1
log.flush.interval.messages = 9223372036854775807
log.flush.interval.ms = null
log.flush.offset.checkpoint.interval.ms = 60000
log.flush.scheduler.interval.ms = 9223372036854775807
log.index.interval.bytes = 4096
log.index.size.max.bytes = 10485760
log.message.format.version = 0.10.2-IV0
log.message.timestamp.difference.max.ms = 9223372036854775807
log.message.timestamp.type = CreateTime
log.preallocate = false
log.retention.bytes = -1
log.retention.check.interval.ms = 300000
log.retention.hours = 168
log.retention.minutes = null
log.retention.ms = null
log.roll.hours = 168
log.roll.jitter.hours = 0
log.roll.jitter.ms = null
log.roll.ms = null
log.segment.bytes = 1073741824
log.segment.delete.delay.ms = 60000
max.connections.per.ip = 2147483647
max.connections.per.ip.overrides =
message.max.bytes = 1000012
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
min.insync.replicas = 1
num.io.threads = 8
num.network.threads = 3
num.partitions = 1
num.recovery.threads.per.data.dir = 1
num.replica.fetchers = 1
offset.metadata.max.bytes = 4096
offsets.commit.required.acks = -1
offsets.commit.timeout.ms = 5000
offsets.load.buffer.size = 5242880
offsets.retention.check.interval.ms = 600000
offsets.retention.minutes = 1440
offsets.topic.compression.codec = 0
offsets.topic.num.partitions = 50
offsets.topic.replication.factor = 3
offsets.topic.segment.bytes = 104857600
port = 9092
principal.builder.class = class org.Apache.kafka.common.security.auth.DefaultPrincipalBuilder
producer.purgatory.purge.interval.requests = 1000
queued.max.requests = 500
quota.consumer.default = 9223372036854775807
quota.producer.default = 9223372036854775807
quota.window.num = 11
quota.window.size.seconds = 1
replica.fetch.backoff.ms = 1000
replica.fetch.max.bytes = 1048576
replica.fetch.min.bytes = 1
replica.fetch.response.max.bytes = 10485760
replica.fetch.wait.max.ms = 500
replica.high.watermark.checkpoint.interval.ms = 5000
replica.lag.time.max.ms = 10000
replica.socket.receive.buffer.bytes = 65536
replica.socket.timeout.ms = 30000
replication.quota.window.num = 11
replication.quota.window.size.seconds = 1
request.timeout.ms = 30000
reserved.broker.max.id = 1000
sasl.enabled.mechanisms = [GSSAPI]
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.principal.to.local.rules = [DEFAULT]
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.mechanism.inter.broker.protocol = GSSAPI
security.inter.broker.protocol = PLAINTEXT
socket.receive.buffer.bytes = 102400
socket.request.max.bytes = 104857600
socket.send.buffer.bytes = 102400
ssl.cipher.suites = null
ssl.client.auth = none
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = null
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
unclean.leader.election.enable = true
zookeeper.connect = localhost:2181
zookeeper.connection.timeout.ms = 6000
zookeeper.session.timeout.ms = 6000
zookeeper.set.acl = false
zookeeper.sync.time.ms = 2000
(kafka.server.KafkaConfig)
[2017-04-22 12:25:56,419] INFO starting (kafka.server.KafkaServer)
[2017-04-22 12:25:56,422] INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer)
[2017-04-22 12:25:56,437] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread)
[2017-04-22 12:25:56,448] INFO Client environment:zookeeper.version=3.4.9-1757313, built on 08/23/2016 06:50 GMT (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,448] INFO Client environment:Host.name=10.0.0.4 (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,449] INFO Client environment:Java.version=1.8.0_121 (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,449] INFO Client environment:Java.vendor=Oracle Corporation (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,449] INFO Client environment:Java.home=/usr/lib/jvm/Java-8-Oracle/jre (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,449] INFO Client environment:Java.class.path=:/home/bbanner/kafka-1/bin/../libs/aopalliance-repackaged-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/argparse4j-0.7.0.jar:/home/bbanner/kafka-1/bin/../libs/con
nect-api-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-file-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-json-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/connect-runtime-0.10.2.0.jar:/home/bbanner/kafka-1/
bin/../libs/connect-transforms-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/guava-18.0.jar:/home/bbanner/kafka-1/bin/../libs/hk2-api-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/hk2-locator-2.5.0-b05.jar:/home/bbanner/kafk
a-1/bin/../libs/hk2-utils-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/jackson-annotations-2.8.0.jar:/home/bbanner/kafka-1/bin/../libs/jackson-annotations-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-core-2.8.5.jar:/home
/bbanner/kafka-1/bin/../libs/jackson-databind-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-jaxrs-base-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/jackson-jaxrs-json-provider-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/ja
ckson-module-jaxb-annotations-2.8.5.jar:/home/bbanner/kafka-1/bin/../libs/javassist-3.20.0-GA.jar:/home/bbanner/kafka-1/bin/../libs/javax.annotation-api-1.2.jar:/home/bbanner/kafka-1/bin/../libs/javax.inject-1.jar:/home/bbanner
/kafka-1/bin/../libs/javax.inject-2.5.0-b05.jar:/home/bbanner/kafka-1/bin/../libs/javax.servlet-api-3.1.0.jar:/home/bbanner/kafka-1/bin/../libs/javax.ws.rs-api-2.0.1.jar:/home/bbanner/kafka-1/bin/../libs/jersey-client-2.24.jar:/ho
me/bbanner/kafka-1/bin/../libs/jersey-common-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-container-servlet-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-container-servlet-core-2.24.jar:/home/bbanner/kafka-1/bin/../lib
s/jersey-guava-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-media-jaxb-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jersey-server-2.24.jar:/home/bbanner/kafka-1/bin/../libs/jetty-continuation-9.2.15.v20160210.jar:/home/bmcustod
io/kafka-1/bin/../libs/jetty-http-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-io-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-security-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-s
erver-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-servlet-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-servlets-9.2.15.v20160210.jar:/home/bbanner/kafka-1/bin/../libs/jetty-util-9.2.15.v20160210.ja
r:/home/bbanner/kafka-1/bin/../libs/jopt-simple-5.0.3.jar:/home/bbanner/kafka-1/bin/../libs/kafka_2.11-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka_2.11-0.10.2.0-sources.jar:/home/bbanner/kafka-1/bin/../libs/kafka_2.11-
0.10.2.0-test-sources.jar:/home/bbanner/kafka-1/bin/../libs/kafka-clients-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-log4j-appender-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-streams-0.10.2.0.jar:/home/bmcustod
io/kafka-1/bin/../libs/kafka-streams-examples-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/kafka-tools-0.10.2.0.jar:/home/bbanner/kafka-1/bin/../libs/log4j-1.2.17.jar:/home/bbanner/kafka-1/bin/../libs/lz4-1.3.0.jar:/home/bmcusto
dio/kafka-1/bin/../libs/metrics-core-2.2.0.jar:/home/bbanner/kafka-1/bin/../libs/osgi-resource-locator-1.0.1.jar:/home/bbanner/kafka-1/bin/../libs/reflections-0.9.10.jar:/home/bbanner/kafka-1/bin/../libs/rocksdbjni-5.0.1.jar:/home
/bbanner/kafka-1/bin/../libs/scala-library-2.11.8.jar:/home/bbanner/kafka-1/bin/../libs/scala-parser-combinators_2.11-1.0.4.jar:/home/bbanner/kafka-1/bin/../libs/slf4j-api-1.7.21.jar:/home/bbanner/kafka-1/bin/../libs/slf4j-log4
j12-1.7.21.jar:/home/bbanner/kafka-1/bin/../libs/snappy-Java-1.1.2.6.jar:/home/bbanner/kafka-1/bin/../libs/validation-api-1.1.0.Final.jar:/home/bbanner/kafka-1/bin/../libs/zkclient-0.10.jar:/home/bbanner/kafka-1/bin/../libs/Zoo
keeper-3.4.9.jar (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,450] INFO Client environment:Java.library.path=/usr/Java/packages/lib/AMD64:/usr/lib64:/lib64:/lib:/usr/lib (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,450] INFO Client environment:Java.io.tmpdir=/tmp (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:Java.compiler=<NA> (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:os.name=Linux (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:os.Arch=AMD64 (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:os.version=4.4.0-72-generic (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:user.name=bbanner (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:user.home=/home/bbanner (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,451] INFO Client environment:user.dir=/home/bbanner/kafka-1 (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,453] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@333291e3 (org.Apache.zookeeper.ZooKeeper)
[2017-04-22 12:25:56,471] INFO Waiting for keeper state SyncConnected (org.I0Itec.zkclient.ZkClient)
[2017-04-22 12:25:56,475] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.Apache.zookeeper.ClientCnxn)
[2017-04-22 12:25:56,484] INFO Socket connection established to localhost/127.0.0.1:2181, initiating session (org.Apache.zookeeper.ClientCnxn)
[2017-04-22 12:25:56,522] INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x15b959f978b0000, negotiated timeout = 6000 (org.Apache.zookeeper.ClientCnxn)
[2017-04-22 12:25:56,525] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient)
[2017-04-22 12:25:56,694] INFO Cluster ID = i_Ld0g3xSsS-FviO2qg05A (kafka.server.KafkaServer)
[2017-04-22 12:25:56,698] WARN No meta.properties file under dir /tmp/kafka-logs-1/meta.properties (kafka.server.BrokerMetadataCheckpoint)
[2017-04-22 12:25:56,721] INFO [ThrottledRequestReaper-Fetch], Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2017-04-22 12:25:56,724] INFO [ThrottledRequestReaper-Produce], Starting (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2017-04-22 12:25:56,760] INFO Log directory '/tmp/kafka-logs-1' not found, creating it. (kafka.log.LogManager)
[2017-04-22 12:25:56,770] INFO Loading logs. (kafka.log.LogManager)
[2017-04-22 12:25:56,778] INFO Logs loading complete in 8 ms. (kafka.log.LogManager)
[2017-04-22 12:25:56,855] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager)
[2017-04-22 12:25:56,857] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager)
[2017-04-22 12:25:56,905] INFO Awaiting socket connections on 0.0.0.0:19092. (kafka.network.Acceptor)
[2017-04-22 12:25:56,918] INFO [Socket Server on Broker 1], Started 1 acceptor threads (kafka.network.SocketServer)
[2017-04-22 12:25:56,938] INFO [ExpirationReaper-1], Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2017-04-22 12:25:56,939] INFO [ExpirationReaper-1], Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2017-04-22 12:25:56,983] INFO Creating /controller (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-04-22 12:25:56,993] INFO Result of znode creation is: OK (kafka.utils.ZKCheckedEphemeral)
[2017-04-22 12:25:56,993] INFO 1 successfully elected as leader (kafka.server.ZookeeperLeaderElector)
[2017-04-22 12:25:57,104] INFO [ExpirationReaper-1], Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2017-04-22 12:25:57,106] INFO [ExpirationReaper-1], Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2017-04-22 12:25:57,113] INFO [ExpirationReaper-1], Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2017-04-22 12:25:57,120] INFO [GroupCoordinator 1]: Starting up. (kafka.coordinator.GroupCoordinator)
[2017-04-22 12:25:57,134] INFO [GroupCoordinator 1]: Startup complete. (kafka.coordinator.GroupCoordinator)
[2017-04-22 12:25:57,135] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 2 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2017-04-22 12:25:57,215] INFO Will not load MX4J, mx4j-tools.jar is not in the classpath (kafka.utils.Mx4jLoader$)
[2017-04-22 12:25:57,271] INFO New leader is 1 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2017-04-22 12:25:57,277] INFO Creating /brokers/ids/1 (is it secure? false) (kafka.utils.ZKCheckedEphemeral)
[2017-04-22 12:25:57,290] INFO Result of znode creation is: OK (kafka.utils.ZKCheckedEphemeral)
[2017-04-22 12:25:57,302] INFO Registered broker 1 at path /brokers/ids/1 with addresses: EndPoint(10.0.0.4,19092,ListenerName(PLAINTEXT),PLAINTEXT) (kafka.utils.ZkUtils)
[2017-04-22 12:25:57,303] WARN No meta.properties file under dir /tmp/kafka-logs-1/meta.properties (kafka.server.BrokerMetadataCheckpoint)
[2017-04-22 12:25:57,347] INFO Kafka version : 0.10.2.0 (org.Apache.kafka.common.utils.AppInfoParser)
[2017-04-22 12:25:57,347] INFO Kafka commitId : 576d93a8dc0cf421 (org.Apache.kafka.common.utils.AppInfoParser)
[2017-04-22 12:25:57,348] INFO [Kafka Server 1], started (kafka.server.KafkaServer)
Cependant, j'obtiens les entrées suivantes dans les journaux de ZooKeeper:
[2017-04-22 12:25:56,483] INFO Accepted socket connection from /127.0.0.1:55376 (org.Apache.zookeeper.server.NIOServerCnxnFactory)
[2017-04-22 12:25:56,494] INFO Client attempting to establish new session at /127.0.0.1:55376 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:56,497] INFO Creating new log file: log.1 (org.Apache.zookeeper.server.persistence.FileTxnLog)
[2017-04-22 12:25:56,520] INFO Established session 0x15b959f978b0000 with negotiated timeout 6000 for client /127.0.0.1:55376 (org.Apache.zookeeper.server.ZooKeeperServer)
[2017-04-22 12:25:56,566] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x5 zxid:0x3 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for /brokers (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:56,599] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0xb zxid:0x7 txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for /config (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:56,624] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x13 zxid:0xc txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = NoNode for /admin (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:56,683] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x1b zxid:0x11 txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode = NoNode for /cluster (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:56,999] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:setData cxid:0x25 zxid:0x15 txntype:-1 reqpath:n/a Error Path:/controller_Epoch Error:KeeperErrorCode = NoNode for /controller_Epoch (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:57,088] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:delete cxid:0x36 zxid:0x17 txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:57,278] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x41 zxid:0x18 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NodeExists for /brokers (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:25:57,279] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x42 zxid:0x19 txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode = NodeExists for /brokers/ids (org.Apache.zookeeper.server.PrepRequestProcessor)
Bien qu'il n'y ait aucune erreur dans Kafka, je ne sais pas ce que ces
Obtention de KeeperException au niveau utilisateur lors du traitement (...)
les messages signifient, et je ne suis pas sûr de la configuration. Que signifient ces messages? Ai-je mal configuré quelque chose?
PS — En cours d'exécution bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test
selon la documentation est également à l'origine de ce type de messages:
(...)
[2017-04-22 12:48:10,001] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0001 type:setData cxid:0x4 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/config/topics/test Error:KeeperErrorCode = NoNode for /config/topics/test (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:48:10,014] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0001 type:create cxid:0x6 zxid:0x1d txntype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics (org.Apache.zookeeper.server.PrepRequestProcessor)
(...)
[2017-04-22 12:48:10,077] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x4c zxid:0x21 txntype:-1 reqpath:n/a Error Path:/brokers/topics/test/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/test/partitions/0 (org.Apache.zookeeper.server.PrepRequestProcessor)
[2017-04-22 12:48:10,080] INFO Got user-level KeeperException when processing sessionid:0x15b959f978b0000 type:create cxid:0x4d zxid:0x22 txntype:-1 reqpath:n/a Error Path:/brokers/topics/test/partitions Error:KeeperErrorCode = NoNode for /brokers/topics/test/partitions (org.Apache.zookeeper.server.PrepRequestProcessor)
Le message que vous voyez n'est pas encore une erreur. C'est une exception potentielle soulevée par Zookeeper que l'objet original faisant une demande doit gérer.
Lorsque vous démarrez un nouveau Kafka, il reçoit un tas de messages NoNode
. C'est normal car certains chemins n'existent pas encore. En même temps, vous obtenez également des messages NodeExists
car le chemin existe déjà.
Exemple: Error:KeeperErrorCode = NoNode for /config/topics/test
C'est parce que Kafka envoie une demande à Zookeeper pour ce chemin. Mais il n'existe pas. C'est OK, parce que vous essayez de le créer. Donc, vous voyez "INFO" de Zookeeper mais aucune erreur de Kafka. Une fois Kafka reçoit ce message, il essaie de créer votre sujet. Pour ce faire, il doit accéder à un chemin d'accès dans Zookeeper pour les sujets. Donc, il envoie une demande et obtient une erreur NodeExists for /config/topics
. Encore une fois, c'est normal et Kafka ignore le message.
Pour faire court, ce sont tous des messages qui ne sont pas des problèmes et vous devez les ignorer. Si cela vous dérange, modifiez la configuration de journalisation de Zookeeper (ce n'est cependant pas recommandé).