The Github Actions configuration currently has to specify the jar by name, which includes the CLI version. https://github.com/amzn/ion-java-benchmark-cli/blob/master/.github/workflows/maven.yml#L26
Ideally, we wouldn't have to change the Github Actions configuration every time the CLI version changes.