[1]CarbonData Introduction And Docs 笔记

hjw199089

于 2019-03-18 12:27:40 发布

阅读量278

点赞数

CC 4.0 BY-SA版权

分类专栏： [28]CarbonData

3 篇文章

订阅专栏

Apache CarbonData是一种新的大数据文件格式，采用先进的列存储、索引、压缩和编码技术，可提升计算效率，加速查询。它具有独特的数据组织方式、多级索引，能与大数据生态系统无缝集成，支持更新和删除操作，文档包含使用案例等内容。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

在这里插入图片描述
Apache CarbonData is a new big data file format for faster interactive query using：

techniques to improve computing efficiency, which helps in speeding up queries by an order of magnitude faster over PetaBytes of data.

Unique Data Organization
(1) Stores data in Columnar format.
(2) with each Data Block(row group) sorted independent of the other to allow faster filtering and better compression
Multi Level Indexing
Utilizes multiple indices at various levels to enable faster search and speeding up query processing.
Seamless Integration with Big Data Eco-System.
Deep Spark Integration with DataFrame & SQL compliance
Advanced PushDown Optimizations.
Pushes much of query processing close to the data to minimize the amount of data being read, processed, converted, transmitted and shuffled.
Dictionary Encoding.
Encoded data for reduced storage space and faster processing.
Update and Delete Support