Currently, the .dylib shared libraries built on macOS are platform-dependent, so they need generated for both x86_64 and ARM64.
This issue requests building the libmonero-cpp.dylib and libmonero-java.dylib as universal shared libraries which work on either architecture.
See the build instructions to build the dylibs.