189 8069 5689
本篇内容主要讲解“Flume的failover和load balance怎么使用”，感兴趣的朋友不妨来看看。本文介绍的方法操作简单快捷，实用性强。下面就让小编来带大家学习“Flume的failover和load balance怎么使用”吧!
我们提供的服务有：成都网站建设、成都网站设计、微信公众号开发、网站优化、网站认证、昌图ssl等。为超过千家企事业单位解决了网站和推广的问题。提供周到的售前咨询和贴心的售后服务，是有科学管理、有技术的昌图网站制作公司
一、Load Balancing Sink Processor
===> agent_2
source ==> agent_1 ===> agent_3 ==> Sink
===> agent_4
agent_2,agent_3,agent_4 分担agent_1的数据压力
[root@hftest0001 conf]# pwd
/opt/apache-flume-1.6.0-bin/conf
[root@hftest0001 conf]# vi s-exec_c-m_s-avro_sp-lb.conf
agent.sinkgrous.lb-1.sinks = 155-avroSink 154-avroSink
agent.sinkgrous.lb-1.processor.type = load_balance
#agent.sinkgrous.lb-1.processor.backoff = true
agent.sinkgrous.lb-1.processor.selector = round_robin
#agent.sinkgrous.lb-1.processor.selector.maxTimeOut = 3000
agent.sinks.155-avroSink.type = avro
agent.sinks.155-avroSink.hostname = ${ip-155}
agent.sinks.155-avroSink.port = 55555
agent.sinks.155-avroSink.channel = memoryChannel
agent.sinks.154-avroSink.type = avro
agent.sinks.154-avroSink.hostname = ${ip-154}
agent.sinks.154-avroSink.port = 55555
agent.sinks.154-avroSink.channel = memoryChannel
agent.channels.memoryChannel.type = memory
agent.channels.memoryChannel.capacity = 100二、Failover Sink Processor
[root@hftest0001 conf]# vi s-exec_c-m_s-avro_sp-fo.conf
agent.sinkgrous.lb-1.sinks = 155-avroSink 154-avroSink
agent.sinkgrous.lb-1.processor.type = failover
agent.sinkgrous.lb-1.processor.priority.155-avroSink = 5
agent.sinkgrous.lb-1.processor.priority.154-avroSink = 10 => 设置权重
agent.sinkgrous.lb-1.processor.maxpenalty = 10000
agent.sinks.155-avroSink.type = avro
agent.sinks.155-avroSink.hostname = ${ip-155}
agent.sinks.155-avroSink.port = 55555
agent.sinks.155-avroSink.channel = memoryChannel
agent.sinks.154-avroSink.type = avro
agent.sinks.154-avroSink.hostname = ${ip-154}
agent.sinks.154-avroSink.port = 55555
agent.sinks.154-avroSink.channel = memoryChannel
agent.channels.memoryChannel.type = memory
agent.channels.memoryChannel.capacity = 100到此，相信大家对“Flume的failover和load balance怎么使用”有了更深的了解，不妨来实际操作一番吧！这里是创新互联网站，更多相关内容可以进入相关频道进行查询，关注我们，继续学习！