Docs: Add blog post about File Format API#15380
Conversation
kevinjqliu
left a comment
kevinjqliu
left a comment
There was a problem hiding this comment.
LGTM! mostly nit comments
|
|
||
| ## Conclusion | ||
|
|
||
| Finalizing the File Format API marks a major milestone for Apache Iceberg. It enables clean extensibility, encourages innovation across file formats, and prepares Iceberg for the next generation of analytics and AI workloads. Work on the TCK and Vortex integration is already underway, and we are excited to see what the community builds next. |
There was a problem hiding this comment.
is there a tracking issues we can link here?
| categories: | ||
| - announcement | ||
| --- | ||
|
|
There was a problem hiding this comment.
we should probably add a sentence about how the API will be included in the upcoming 1.11 release
| --- | ||
| date: 2026-02-20 | ||
| title: Finalizing the Apache Iceberg File Format API | ||
| slug: apache-iceberg-file-format-api-finalization |
There was a problem hiding this comment.
| slug: apache-iceberg-file-format-api-finalization | |
| slug: apache-iceberg-file-format-api |
|
|
||
| The community welcomes all contributors. You can help by testing integrations, participating in TCK development, or experimenting with new formats. | ||
|
|
||
| ## Conclusion |
There was a problem hiding this comment.
i like this video explanation, maybe we can include it in the article somehow, https://www.youtube.com/watch?v=aERM4rjBDhY
singhpk234
left a comment
singhpk234
left a comment
There was a problem hiding this comment.
Nice write up @pvary !
| ### **2. Column Families** | ||
| The API enables vertically split storage layouts—column families—which support: |
There was a problem hiding this comment.
do we have a proposal for this already ?
|
|
||
| The Technology Compatibility Kit (TCK) is one of the most important next steps. It will validate correctness, semantics, feature completeness, type support, and compatibility for new format implementations. | ||
|
|
||
| ## Next Steps |
There was a problem hiding this comment.
do we wanna mention comet too ?
|
|
||
| ## What the File Format API Provides | ||
|
|
||
| The File Format API introduces a well‑defined, pluggable interface for integrating new formats into Iceberg. It allows engines to interact with formats through a standardized set of builders and metadata structures. |
There was a problem hiding this comment.
optional :
| The File Format API introduces a well‑defined, pluggable interface for integrating new formats into Iceberg. It allows engines to interact with formats through a standardized set of builders and metadata structures. | |
| The File Format API introduces a well‑defined, pluggable interface for integrating new data file formats into Iceberg. It allows engines to interact with formats through a standardized set of builders and metadata structures. |
There was a problem hiding this comment.
i think its for both data and delete files
Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>
Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>
Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>
Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>
Co-authored-by: Kevin Liu <kevinjqliu@users.noreply.github.com>
Co-authored-by: Prashant Singh <35593236+singhpk234@users.noreply.github.com>
kevinjqliu
left a comment
kevinjqliu
left a comment
There was a problem hiding this comment.
LGTM.
I noticed you accepted the change for the title to "Introducing the Apache Iceberg File Format API". Do you want to accept the change for the url slug to remove the word "finalization"?
All my other comments are nits. feel free to ignore.
Heres a local rendering:
3 participants
No description provided.