Does not handle a single down broker

[skandragon]

I have two brokers, and am configuring a partition producer as such:

I am getting this error when broker1 is down:

brokers = [ 'broker1.example.com:9092', 'broker2.example.com:9092' ]

end

gems/poseidon-0.0.5/lib/poseidon/sync_producer.rb:66:in `send_messages': Failed to send all messages: [list]

Any idea how to make this resilient against a broker being down?

[skandragon]

Oddly enough, it also does not send to broker2 at all, although other clients can which are written in C++ or Java.

[skandragon]

D, [2015-11-03T04:27:42.601867 #8579] DEBUG -- : Fetched metadata #<struct Poseidon::Protocol::MetadataResponse common=#<struct Poseidon::Protocol::ResponseCommon correlation_id=1>, brokers=[#<struct Poseidon::Protocol::Broker id=2, host="broker2.example.com", port=9092>], topics=[#<Poseidon::TopicMetadata:0x007f69d43e4820 @struct=#<struct Poseidon::Protocol::TopicMetadataStruct error=0, name="telemetry", partitions=[#<struct Poseidon::Protocol::PartitionMetadata error=9, id=0, leader=2, replicas=[2], isr=[2]>]>>]>
D, [2015-11-03T04:27:42.730799 #8579] DEBUG -- : Fetched metadata #<struct Poseidon::Protocol::MetadataResponse common=#<struct Poseidon::Protocol::ResponseCommon correlation_id=1>, brokers=[#<struct Poseidon::Protocol::Broker id=2, host="broker2.example.com", port=9092>], topics=[#<Poseidon::TopicMetadata:0x007f69d43bd6a8 @struct=#<struct Poseidon::Protocol::TopicMetadataStruct error=0, name="telemetry", partitions=[#<struct Poseidon::Protocol::PartitionMetadata error=9, id=0, leader=2, replicas=[2], isr=[2]>]>>]>
D, [2015-11-03T04:27:42.837605 #8579] DEBUG -- : Fetched metadata #<struct Poseidon::Protocol::MetadataResponse common=#<struct Poseidon::Protocol::ResponseCommon correlation_id=1>, brokers=[#<struct Poseidon::Protocol::Broker id=2, host="broker2.example.com", port=9092>], topics=[#<Poseidon::TopicMetadata:0x007f69d439a540 @struct=#<struct Poseidon::Protocol::TopicMetadataStruct error=0, name="telemetry", partitions=[#<struct Poseidon::Protocol::PartitionMetadata error=9, id=0, leader=2, replicas=[2], isr=[2]>]>>]>
D, [2015-11-03T04:27:42.944320 #8579] DEBUG -- : Fetched metadata #<struct Poseidon::Protocol::MetadataResponse common=#<struct Poseidon::Protocol::ResponseCommon correlation_id=1>, brokers=[#<struct Poseidon::Protocol::Broker id=2, host="broker2.example.com", port=9092>], topics=[#<Poseidon::TopicMetadata:0x007f69d437ec78 @struct=#<struct Poseidon::Protocol::TopicMetadataStruct error=0, name="telemetry", partitions=[#<struct Poseidon::Protocol::PartitionMetadata error=9, id=0, leader=2, replicas=[2], isr=[2]>]>>]>
D, [2015-11-03T04:27:43.050838 #8579] DEBUG -- : Fetched metadata #<struct Poseidon::Protocol::MetadataResponse common=#<struct Poseidon::Protocol::ResponseCommon correlation_id=1>, brokers=[#<struct Poseidon::Protocol::Broker id=2, host="broker2.example.com", port=9092>], topics=[#<Poseidon::TopicMetadata:0x007f69d436b560 @struct=#<struct Poseidon::Protocol::TopicMetadataStruct error=0, name="telemetry", partitions=[#<struct Poseidon::Protocol::PartitionMetadata error=9, id=0, leader=2, replicas=[2], isr=[2]>]>>]>

[skandragon]

See #105 for a fix for this.

[sabelo-iris]

@skandragon
Note this edge case:
#105 (comment)

[skandragon]

I'm not sure what you mean here.