Skip to content

[MINOR][VL] Remove stale Delta nested-map MERGE known failures - #13508

Merged
rui-mo merged 1 commit into
apache:mainfrom
felipepessoto:felipepessoto-delta-baseline-cleanup
Nov 3, 2026
Merged

rui-mo merged 1 commit into
apache:mainfrom
felipepessoto:felipepessoto-delta-baseline-cleanup

Conversation

@felipepessoto

@felipepessoto felipepessoto commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

What changes are proposed in this pull request?

Remove 14 stale Delta nested-map MERGE entries from known-failures.txt (485 to 471). They were fixed by #13490: Spark transform_keys permits null fields inside a non-null struct map key, unlike the Presto implementation.

Baseline-only and independent of #13502; existing comments and unrelated entries are unchanged.

How was this patch tested?

Compared saved before and after CI reports: all 14 cases changed from indeterminate-key failures to passes, with no skips. Replaying the unchanged compare-test-results.py --fail-on-fixed true against the updated baseline passes all eight affected suites (256 tests).

The full borrowed-report replay still reports the same ten unrelated native-write failures baselined only in #13502; they are untouched here. This was a replay, not a new full-suite run.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: GitHub Copilot 1.0.102-0.unstable.r40949665530.gab1eef5 (gpt-6-astra)

Remove 14 entries fixed by the merged Spark transform_keys implementation in apache#13490. Preserve all existing comments and unrelated known failures.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI balanced review requested due to automatic review settings October 31, 2026 05:12
@github-actions github-actions Bot added the INFRA label Oct 31, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues block the cleanup of stale Delta test failure expectations.

No open issues 🎉

What changed in this PR

Cleans up the Delta test failure baseline after the merged transform_keys fix in #13490, so the CI gate expects the affected nested-map MERGE tests to pass.

Changes:

  • Removes 14 stale expected-failure entries across eight generated suites, reducing the baseline from 485 to 471.
  • Preserves all comments and other entries, with no production changes or new test exclusions.
File Description
.github/​workflows/​util/​delta-spark-ut/​known-failures.txt Removes expected failures for two nested-map struct-key schema-evolution scenarios.

Review effort: Balanced

@felipepessoto

Copy link
Copy Markdown
Contributor Author

Hi @philo-he @rui-mo, could you review #13508? It removes 14 stale Delta nested-map MERGE known-failure entries fixed by #13490. This is a baseline-only cleanup. Thanks!

felipepessoto added a commit to felipepessoto/gluten that referenced this pull request Oct 31, 2026
All seven DATE-to-TIMESTAMP_NTZ cases executed and passed in Delta 4.4.1 run 41243077329 with the merged Velox reader patch. Keep the unrelated fourteen nested-map entries for PR apache#13508 and preserve strict gate behavior.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@felipepessoto

Copy link
Copy Markdown
Contributor Author

@philo-he @rui-mo this has been incorporated into #13514, we could merge it instead to unblock Delta development (currently Delta CI is always failing).

@rui-mo
rui-mo merged commit 1ac8f88 into apache:main Nov 3, 2026
17 checks passed
@felipepessoto
felipepessoto deleted the felipepessoto-delta-baseline-cleanup branch November 3, 2026 00:35
felipepessoto added a commit to felipepessoto/gluten that referenced this pull request Nov 3, 2026
All seven DATE-to-TIMESTAMP_NTZ cases executed and passed in Delta 4.4.1 run 41243077329 with the merged Velox reader patch. Keep the unrelated fourteen nested-map entries for PR apache#13508 and preserve strict gate behavior.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants