Skip to content

Commit

Permalink
Docs: Update compatibility table (apache#3761)
Browse files Browse the repository at this point in the history
  • Loading branch information
@hililiwei
hililiwei authored Dec 29, 2021
1 parent da712ea commit 1474f84
Show file tree
Hide file tree
Showing 2 changed files with 37 additions and 26 deletions.
25 changes: 18 additions & 7 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -79,11 +79,22 @@ This project Iceberg also has modules for adding Iceberg support to processing e

### Compatibility

Iceberg's Spark integration is compatible with Spark 2.4 and Spark 3.0 using the modules in the following table:

| Iceberg version | Spark 2.4.x | Spark 3.0.x |
| --------------- | ------------- | -------------- |
| master branch | spark-runtime | spark3-runtime |
| 0.9.0 | spark-runtime | spark3-runtime |
| 0.8.0 | spark-runtime | |
Iceberg's Spark integration is compatible with Spark using the modules in the following table:

| Iceberg version | Spark 2.4.x | Spark 3.0.x | Spark 3.1.x | Spark 3.2.x |
| --------------- | --------------------- | ---------------------- | ------------------------------ | ------------------------------ |
| master branch | iceberg-spark-runtime | iceberg-spark3-runtime | iceberg-spark-runtime-3.1_2.12 | iceberg-spark-runtime-3.2_2.12 |
| 0.12.x | iceberg-spark-runtime | iceberg-spark3-runtime | iceberg-spark-runtime-3.1_2.12 | |
| 0.11.x | iceberg-spark-runtime | iceberg-spark3-runtime | | |
| 0.10.x | iceberg-spark-runtime | iceberg-spark3-runtime | | |
| 0.9.x | iceberg-spark-runtime | iceberg-spark3-runtime | | |

Iceberg's Flink integration is compatible with Flink using the modules in the following table:

| Iceberg version | Flink 1.11.x | Flink 1.12.x | Flink 1.13.x | Flink 1.14.x |
| --------------- | --------------------- | -------------------------- | -------------------------- | -------------------------- |
| master branch | | iceberg-flink-runtime-1.12 | iceberg-flink-runtime-1.13 | iceberg-flink-runtime-1.14 |
| 0.12.x | | iceberg-flink-runtime | | |
| 0.11.x | iceberg-flink-runtime | | | |
| 0.10.x | iceberg-flink-runtime | | | |

38 changes: 19 additions & 19 deletions site/docs/flink.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,25 +17,25 @@

# Flink

Apache Iceberg supports both [Apache Flink](https://flink.apache.org/)'s DataStream API and Table API to write records into an Iceberg table. Currently,
we only integrate Iceberg with Apache Flink 1.11.x.

| Feature support | Flink 1.11.0 | Notes |
|------------------------------------------------------------------------|--------------------|--------------------------------------------------------|
| [SQL create catalog](#creating-catalogs-and-using-catalogs) | ✔️ | |
| [SQL create database](#create-database) | ✔️ | |
| [SQL create table](#create-table) | ✔️ | |
| [SQL create table like](#create-table-like) | ✔️ | |
| [SQL alter table](#alter-table) | ✔️ | Only support altering table properties, Columns/PartitionKey changes are not supported now|
| [SQL drop_table](#drop-table) | ✔️ | |
| [SQL select](#querying-with-sql) | ✔️ | Support both streaming and batch mode |
| [SQL insert into](#insert-into) | ✔️ ️ | Support both streaming and batch mode |
| [SQL insert overwrite](#insert-overwrite) | ✔️ ️ | |
| [DataStream read](#reading-with-datastream) | ✔️ ️ | |
| [DataStream append](#appending-data) | ✔️ ️ | |
| [DataStream overwrite](#overwrite-data) | ✔️ ️ | |
| [Metadata tables](#inspecting-tables) | ️ | Support Java API but does not support Flink SQL |
| [Rewrite files action](#rewrite-files-action) | ✔️ ️ | |
Apache Iceberg supports both [Apache Flink](https://flink.apache.org/)'s DataStream API and Table API. Currently,
Iceberg integration for Apache Flink is available for Flink versions 1.12, 1.13, and 1.14. Previous versions of Iceberg also support Flink 1.11.

| Feature support | Flink | Notes |
| ----------------------------------------------------------- | ----- | ------------------------------------------------------------ |
| [SQL create catalog](#creating-catalogs-and-using-catalogs) | ✔️ | |
| [SQL create database](#create-database) | ✔️ | |
| [SQL create table](#create-table) | ✔️ | |
| [SQL create table like](#create-table-like) | ✔️ | |
| [SQL alter table](#alter-table) | ✔️ | Only support altering table properties, column and partition changes are not supported |
| [SQL drop_table](#drop-table) | ✔️ | |
| [SQL select](#querying-with-sql) | ✔️ | Support both streaming and batch mode |
| [SQL insert into](#insert-into) | ✔️ ️ | Support both streaming and batch mode |
| [SQL insert overwrite](#insert-overwrite) | ✔️ ️ | |
| [DataStream read](#reading-with-datastream) | ✔️ ️ | |
| [DataStream append](#appending-data) | ✔️ ️ | |
| [DataStream overwrite](#overwrite-data) | ✔️ ️ | |
| [Metadata tables](#inspecting-tables) | ️ | Support Java API but does not support Flink SQL |
| [Rewrite files action](#rewrite-files-action) | ✔️ ️ | |

## Preparation when using Flink SQL Client

Expand Down

0 comments on commit 1474f84

Please sign in to comment.