Skip to content

[python] Introduce 'nested_partial_update' aggregator function#8578

Open
PyRSA wants to merge 17 commits into
apache:masterfrom
PyRSA:feature/pypaimon-nested-partial-update-impl
Open

[python] Introduce 'nested_partial_update' aggregator function#8578
PyRSA wants to merge 17 commits into
apache:masterfrom
PyRSA:feature/pypaimon-nested-partial-update-impl

Conversation

@PyRSA

@PyRSA PyRSA commented Jul 12, 2026

Copy link
Copy Markdown
Contributor

Purpose

Introduce nested_partial_update aggregator function

This change adds support for the nested_partial_update aggregation function in the Python reader, aligning its behavior with the Java implementation. It supports nested-key based partial updates, where only non-null fields overwrite existing values, while configurable nested-key null handling ensures consistent behavior with the Java implementation.

Dependency

This PR depends on #8577 and reuses several shared utility methods introduced there. Please review and merge #8577 first.

Tests

  • python -m pytest pypaimon/tests/test_field_aggregators.py::FieldNestedPartialUpdateAggTest -q
  • git diff --check

@JingsongLi

Copy link
Copy Markdown
Contributor

nested_partial_update is also unable to handle the dict output by the actual reader, directly reproducing the same exception; furthermore, the dependent issue #8577 also has the same problem.

FashGirl added 5 commits July 15, 2026 20:11
…impl

# Conflicts:
#	paimon-python/pypaimon/common/options/core_options.py
#	paimon-python/pypaimon/read/reader/aggregate/aggregators.py
#	paimon-python/pypaimon/tests/test_field_aggregators.py
…mon-nested-partial-update-impl

# Conflicts:
#	paimon-python/pypaimon/read/reader/aggregate/aggregators.py
#	paimon-python/pypaimon/tests/test_field_aggregators.py
@PyRSA

PyRSA commented Jul 15, 2026

Copy link
Copy Markdown
Contributor Author

nested_partial_update is also unable to handle the dict output by the actual reader, directly reproducing the same exception; furthermore, the dependent issue #8577 also has the same problem.

Thank you for pointing that out. It has been adjusted.

AuroraVoyage added 2 commits July 16, 2026 13:57
@PyRSA

PyRSA commented Jul 18, 2026

Copy link
Copy Markdown
Contributor Author

Resolved the merge conflicts and updated the branch. Thanks for the review!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants