Repository navigation
Conversation
…3-only distribution Port the license/attribution work that shipped in 0.9.0-incubating (RC14) so 1.0.0 does not cut its RC from pre-RC13 LICENSE files: - #4456 Fill license attribution gaps in 0.9.x artifacts - #4473 Complete licenses in source and Maven distributions Adapted to master, which builds only the Hadoop 3 convenience binary (the hadoop2 profile is gone): - drop the hadoop2 Maven profile and the orphan NOTICE-binary-hadoop2 - remove Hadoop 2-only attributions: xmlenc, javax.activation:activation, jaxb-api 2.2.2, stax-api, mssql-jdbc, snappy-java 1.1.8.4, httpclient 4.5.13, xbean-asm9-shaded 4.20, spark-core 3.3.4 web resources (JSON formatter, vis.js, DataTables 1.10.25) and hadoop-yarn-common 2.10.2 web resources (DataTables 1.9.4) - reconcile versions with master's dependency set: Iceberg 1.8.1 -> 1.10.2, commons-compress 1.23.0 -> 1.26.2, postgresql 42.7.2 -> 42.7.14, amoro-web jar placeholder - keep licenses-binary/LICENSE.snappy-java byte-identical (hash-pinned by tools/releasing; its dual recipe targets describe prebuilts retained inside snappy-java 1.1.10.5 itself) - update the releasing regression checks to single-distribution semantics License-motivated code changes from #4473 come along: - replace Lucene RamUsageEstimator usage with an adapted in-house ObjectSizeEstimator; Lucene moves to test-only scope and NOTICE retains the adapted-code attribution - add Apache headers and Presto provenance to the Spark SQL grammar files (.g4 plus regenerated parsers) Verified: tools/releasing suite 11/11 (mutation-tested), mvn validate, amoro-common/amoro-format-iceberg test-compile, TestObjectSizeEstimator 3/3, all 38 licenses/ references resolve, zero Hadoop 2 residue.
Record the resolved Hadoop 3 distribution dependencies after the license port pins jsr305 to 3.0.2 and moves Lucene to test scope.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Ports the license/attribution work that shipped in
0.9.0-incubating(RC14) to master, so 1.0.0 does not cut its RC from pre-RC13 LICENSE files:Adaptation to master (single commit = cherry-picks + adaptation)
Master builds only the Hadoop 3 convenience binary (the
hadoop2profile was removed), so beyond the clean cherry-picks:hadoop2Maven profile (conflict resolution) and the orphanNOTICE-binary-hadoop2,LICENSE.xmlenc-0.52,LICENSE.mssql-jdbcLICENSE-binary/README-LICENSES/licenses-binary/: xmlenc,javax.activation:activation, jaxb-api 2.2.2, stax-api, mssql-jdbc, snappy-java 1.1.8.4, httpclient 4.5.13, xbean-asm9-shaded 4.20, spark-core 3.3.4 web resources (JSON formatter, vis.js, DataTables 1.10.25), hadoop-yarn-common 2.10.2 web resources (DataTables 1.9.4)1.8.1→1.10.2, commons-compress1.23.0→1.26.2, postgresql42.7.2→42.7.14, amoro-web jar placeholder (<version>)licenses-binary/LICENSE.snappy-javakept byte-identical (hash-pinned bytools/releasing; its dual recipe targets describe prebuilts retained inside snappy-java 1.1.10.5 itself)tools/releasingregression checks to single-distribution semantics (removed the xmlenc branch, simplified the JTA assertion)License-motivated code changes (from #4473)
RamUsageEstimatorusage with an adapted in-houseObjectSizeEstimator; Lucene moves to test-only scope andNOTICEretains the adapted-code attribution.g4+ regenerated parsers)Verification
tools/releasingpython suite: 11/11 (mutation-tested — corrupted snappy hash and JTA window were both caught)mvn validate(checkstyle + spotless): passamoro-common+amoro-format-icebergtest-compile;TestObjectSizeEstimator3/3; zero remainingorg.apache.luceneimports in main codelicenses/references resolve (repo file / jar-internal path / URL — no dangling pointers)spark-core_2.12-3.5.8.jarui/static/inventoryHadoop 2residue outside intentionally kept spots (snappy recipe label — hash-pinned; Hudi pom comment describing Hudi's own transitive stack; site download archive links)Note
licenses/maven/per-artifact NOTICE inventories are ported snapshots with version reconciliation; they should be regenerated against master's dependency trees at the 1.0.0 RC audit (that is whattools/releasingis for).