flume设置java_配置flume来查看新日志的目录

是的，实际上假脱机源将完成这项工作 . 这是一个示例配置：

SpoolAgent.sources = MySpooler

SpoolAgent.channels = MemChannel

SpoolAgent.sinks = HDFS

SpoolAgent.channels.MemChannel.type = memory

SpoolAgent.channels.MemChannel.capacity = 500

SpoolAgent.channels.MemChannel.transactionCapacity = 200

SpoolAgent.sources.MySpooler.channels = MemChannel

SpoolAgent.sources.MySpooler.type = spooldir

SpoolAgent.sources.MySpooler.spoolDir = /var/log/hadoop/

SpoolAgent.sources.MySpooler.fileHeader = true

SpoolAgent.sinks.HDFS.channel = MemChannel

SpoolAgent.sinks.HDFS.type = hdfs

SpoolAgent.sinks.HDFS.hdfs.path = hdfs://cluster/logs/%{file}

SpoolAgent.sinks.HDFS.hdfs.fileType = DataStream

SpoolAgent.sinks.HDFS.hdfs.writeFormat = Text

SpoolAgent.sinks.HDFS.hdfs.batchSize = 100

SpoolAgent.sinks.HDFS.hdfs.rollSize = 0

SpoolAgent.sinks.HDFS.hdfs.rollCount = 0

SpoolAgent.sinks.HDFS.hdfs.rollInterval = 3000

fileHeader prop将设置一个带有文件名的标头，该标头在HDFS-Sink路径中引用 . 这会将事件路由到HDFS中的相应文件 .