Skip to content

HDDS-15559. Enable cross platform hadoop native library download#10513

Open
ChenSammi wants to merge 1 commit into
apache:HDDS-10685from
ChenSammi:HDDS-15559
Open

HDDS-15559. Enable cross platform hadoop native library download#10513
ChenSammi wants to merge 1 commit into
apache:HDDS-10685from
ChenSammi:HDDS-15559

Conversation

@ChenSammi

@ChenSammi ChenSammi commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

  1. support cross platform hadoop native library donwload, with profile -Plinux-aarch64, -Plinux-x86_64, so build on macos, run on linux docker.
  2. export native hadoop library path as DYLD_LIBRARY_PATH/LD_LIBRARY_PATH, so that ozone docker image doesn't requires include hadoop native library anymore.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-15559

How was this patch tested?

Tested locally for aarch64 platform, and CI for x86_64 platform.

// use ozone docker image hadoop native library under /usr/lib

bash-5.1$ ozone debug checknative
Native library checking:
     hadoop:  true   /usr/lib/libhadoop.so.1.0.0
      ISA-L:  false  libhadoop was built without ISA-L support
    OpenSSL:  false  Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)!
rocks-tools:  false 

// mvn clean package -DskipTests -Dmaven.javadoc.skip=true -Pdist -Plinux-aarch64 // on MacOS M1
// use ozone package hadoop native library under ./lib/native/

bash-5.1$ ozone debug checknative
Native library checking:
     hadoop:  true   /opt/hadoop/lib/native/libhadoop_linux_aarch_64.so
      ISA-L:  false  libhadoop was built without ISA-L support
    OpenSSL:  false  Cannot load libcrypto.so (libcrypto.so: cannot open shared object file: No such file or directory)!
rocks-tools:  false

@ChenSammi ChenSammi requested a review from adoroszlai June 15, 2026 07:23
@ChenSammi

Copy link
Copy Markdown
Contributor Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant