Skip to content

Commit ef1d032

Browse files
authored
Revert "Update iceberg to 1.9.2 (#35981)"
This reverts commit 32f5be6.
1 parent 1da37bc commit ef1d032

30 files changed

Lines changed: 44 additions & 274 deletions

File tree

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
11
{
22
"comment": "Modify this file in a trivial way to cause this test suite to run.",
3-
"modification": 4
3+
"modification": 3
44
}
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
11
{
22
"comment": "Modify this file in a trivial way to cause this test suite to run.",
3-
"modification": 1
3+
"modification": 5
44
}
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
11
{
22
"comment": "Modify this file in a trivial way to cause this test suite to run.",
3-
"modification": 1
3+
"modification": 5
44
}
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
11
{
22
"comment": "Modify this file in a trivial way to cause this test suite to run ",
3-
"modification": 2
3+
"modification": 4
44
}

CHANGES.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -103,7 +103,6 @@
103103
## I/Os
104104

105105
* Support for X source added (Java/Python) ([#X](https://github.com/apache/beam/issues/X)).
106-
* Upgraded Iceberg dependency to 1.9.2 ([#35981](https://github.com/apache/beam/pull/35981))
107106

108107
## New Features / Improvements
109108

@@ -132,7 +131,6 @@
132131
significant digits related to casting.
133132
* (Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option `--update_compatibility_version=2.67.0` ([35725](https://github.com/apache/beam/pull/35725)). Report any pickling related issues to [#34903](https://github.com/apache/beam/issues/34903)
134133
* (Python) Prism runner now enabled by default for most Python pipelines using the direct runner ([#34612](https://github.com/apache/beam/pull/34612)). This may break some tests, see https://github.com/apache/beam/pull/34612 for details on how to handle issues.
135-
* Dropped Java 8 support for [IO expansion-service](https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service). Cross-language pipelines using this expansion service will need a Java11+ runtime ([#35981](https://github.com/apache/beam/pull/35981).
136134

137135
## Deprecations
138136

build.gradle.kts

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -253,7 +253,6 @@ tasks.register("javaPreCommit") {
253253
dependsOn(":examples:java:sql:preCommit")
254254
dependsOn(":examples:java:twitter:build")
255255
dependsOn(":examples:java:twitter:preCommit")
256-
dependsOn(":examples:java:iceberg:build")
257256
dependsOn(":examples:multi-language:build")
258257
dependsOn(":model:fn-execution:build")
259258
dependsOn(":model:job-management:build")
@@ -381,7 +380,6 @@ tasks.register("sqlPreCommit") {
381380
dependsOn(":sdks:java:extensions:sql:datacatalog:build")
382381
dependsOn(":sdks:java:extensions:sql:expansion-service:build")
383382
dependsOn(":sdks:java:extensions:sql:hcatalog:build")
384-
dependsOn(":sdks:java:extensions:sql:iceberg:build")
385383
dependsOn(":sdks:java:extensions:sql:jdbc:build")
386384
dependsOn(":sdks:java:extensions:sql:jdbc:preCommit")
387385
dependsOn(":sdks:java:extensions:sql:perf-tests:build")
@@ -428,7 +426,6 @@ tasks.register("sqlPostCommit") {
428426
dependsOn(":sdks:java:extensions:sql:postCommit")
429427
dependsOn(":sdks:java:extensions:sql:jdbc:postCommit")
430428
dependsOn(":sdks:java:extensions:sql:datacatalog:postCommit")
431-
dependsOn(":sdks:java:extensions:sql:iceberg:integrationTest")
432429
dependsOn(":sdks:java:extensions:sql:hadoopVersionsTest")
433430
}
434431

examples/java/build.gradle

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -71,6 +71,9 @@ dependencies {
7171
implementation project(":sdks:java:extensions:python")
7272
implementation project(":sdks:java:io:google-cloud-platform")
7373
implementation project(":sdks:java:io:kafka")
74+
runtimeOnly project(":sdks:java:io:iceberg")
75+
runtimeOnly project(":sdks:java:io:iceberg:bqms")
76+
implementation project(":sdks:java:managed")
7477
implementation project(":sdks:java:extensions:ml")
7578
implementation library.java.avro
7679
implementation library.java.bigdataoss_util

examples/java/iceberg/build.gradle

Lines changed: 0 additions & 89 deletions
This file was deleted.

examples/java/iceberg/src/main/java/org/apache/beam/examples/iceberg/IcebergBatchWriteExample.java renamed to examples/java/src/main/java/org/apache/beam/examples/cookbook/IcebergBatchWriteExample.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@
1515
* See the License for the specific language governing permissions and
1616
* limitations under the License.
1717
*/
18-
package org.apache.beam.examples.iceberg;
18+
package org.apache.beam.examples.cookbook;
1919

2020
import java.io.IOException;
2121
import java.util.Map;

examples/java/iceberg/src/main/java/org/apache/beam/examples/iceberg/IcebergRestCatalogCDCExample.java renamed to examples/java/src/main/java/org/apache/beam/examples/cookbook/IcebergRestCatalogCDCExample.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@
1515
* See the License for the specific language governing permissions and
1616
* limitations under the License.
1717
*/
18-
package org.apache.beam.examples.iceberg;
18+
package org.apache.beam.examples.cookbook;
1919

2020
import static org.apache.beam.sdk.managed.Managed.ICEBERG_CDC;
2121

0 commit comments

Comments
 (0)