ES 当天数据按小时统计

最新推荐文章于 2024-08-04 07:47:17 发布

zhangMY12138

最新推荐文章于 2024-08-04 07:47:17 发布

阅读量901

点赞数

CC 4.0 BY-SA版权

分类专栏： ES 文章标签： elasticsearch 大数据 big data

本文链接：https://blog.csdn.net/zhangMY12138/article/details/122000307

ES 专栏收录该内容

1 篇文章

订阅专栏

本文介绍了一种使用Elasticsearch进行日志数据聚合分析的方法。通过构造查询条件并利用日期直方图聚合功能，实现了按小时统计指定索引中特定字段（如checkTime）的数据分布情况。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

//存放时间及统计数据
Map<Object, Long> tempMap = this.getTimeMap();   

String esIndex = "log_app_2021-12-16";
        //构造检索条件
        SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
        //测试代码 我将数据写死了
searchSourceBuilder.query(QueryBuilders.queryStringQuery("console").field("name"));
        DateHistogramAggregationBuilder dateHistogramAggregationBuilder = AggregationBuilders.dateHistogram("aggs").field("checkTime").dateHistogramInterval(DateHistogramInterval.hours(1));

        searchSourceBuilder.aggregation(dateHistogramAggregationBuilder);
        Search sb = new Search.Builder(searchSourceBuilder.toString()).addIndex(esIndex).build();
        try {
            SearchResult result = jestClient.execute(sb);
            if (result != null && result.isSucceeded()) {
                TermsAggregation aggregation = result.getAggregations().getAggregation("aggs", TermsAggregation.class);
                if (aggregation != null && aggregation.getBuckets() != null) {
                    aggregation.getBuckets().forEach(entry -> {
//我用的是自己的时间进行计算的所以时区要修改一下
                                long temp = 8*60*60*1000;
                                String timestamp = (Long.parseLong(entry.getKey())-temp)+"";
                                String key = DateUtils.getYearMonthDay(new Date(Long.parseLong(timestamp)), "HH:mm");
                                tempMap.put(key, entry.getCount());
                    });
                }
            }
        }catch (Exception ex){
            ex.printStackTrace();
        }

   public static String getYearMonthDay(Date date,String formatPatten){
        try {
            formatPatten = org.springframework.util.StringUtils.isEmpty(formatPatten)? YYYY_MM_DD : formatPatten;
            return new SimpleDateFormat(formatPatten).format(date);
        }catch (Exception e){
            e.printStackTrace();
            return null;
        }
    }

   private Map<Object,Long> getTimeMap(){
        Map<Object,Long> map = new LinkedHashMap<>();
        LocalDateTime of = LocalDateTime.of(LocalDate.now(), LocalTime.MIN);
        long l = of.toInstant(ZoneOffset.of("+8")).toEpochMilli();
        while(l<=System.currentTimeMillis()){
            map.put(DateUtils.getYearMonthDay(new Date(l), "HH:mm"),0L);
            l+=60*60*1000;
        }
        return map;
    }