Support for arbitrary URLs?

[dradtke]

Is there any plan to support arbitrary URLs, alongside Github and Gitlab?

For instance, Elvish has a custom URL structure that would be easy enough to parameterize, but its binaries are self-hosted.

[autarch]

There's already a --url flag that would do most of this. I think there would just need to be some tweaks to allow the URL to not be a GitHub or GitLab URL, but that should be fairly easy.

[autarch]

I would note that at this point I'm not sure that ubi is doing much. The main point of it, IMO, is that it finds the right thing to download for your platform. The --url is there as a backdoor for certain CI use cases where you want to avoid GitHub/Lab rate limits.

So without the "pick the right thing", it's not much different than curl $url | tar -xvzf -.

[autarch]

I just looked a the Elvish site and I thought it was kind of funny that their recommended install mechanism is ...

curl -so - https://dl.elv.sh/linux-amd64/elvish-v0.21.0.tar.gz | sudo tar -xzvC /usr/local/bin

[dradtke]

My motivation for opening this issue is to be able to install something like Elvish using the ubi backend in Mise, and having that feature in ubi I think is the first step. ubi itself may not be doing much more than curl, but if the feature is there then I think Mise could be updated to support it.

[autarch]

I see. Thanks for the context. I've been switching my own projects to mise recently.

I think in this case, it might make more sense to submit a PR to add this to aqua - https://github.com/aquaproj/aqua-registry

From what I can see, aqua already supports installing from an arbitrary URL.

[autarch]

Although looking at aqua more closely, it seems like it only supports one version of a package at a time in its registry, which is a bit odd.

[dradtke]

The benefit of ubi is that it lets you install arbitrary binaries, even if they are not in a registry. It may make sense to add Elvish to aqua, but I still think extending ubi or Mise to support downloading binaries from a known path would be a good feature.

From an end-user perspective, it's odd to me that binaries can only be downloaded from Github or Gitlab. Having knowledge of those platforms to ease installation in most cases is great, but it seems like a natural extension to allow any URL. It already kind of does here, but that fails if you try to use any non-Github URL:

$ mise use 'ubi:https://dl.elv.sh/linux-amd64/elvish-v0.21.0.tar.gz'
mise ERROR failed to install ubi:https://dl.elv.sh/linux-amd64/elvish-v0.21.0.tar.gz@latest
mise ERROR Failed to install with ubi 'ubi:https://dl.elv.sh/linux-amd64/elvish-v0.21.0.tar.gz@latest': HTTP status client error (404 Not Found) for url (https://api.github.com/repos/linux-amd64/elvish-v0.21.0.tar.gz/releases/tags/vlatest)
mise ERROR Run with --verbose or MISE_VERBOSE=1 for more information

It also would need to be extended to be more templated, mainly to allow for substitution of the platform name.

[neongreen]

Makes 100% sense, I also filed jdx/mise#4394

[autarch]

Ironically, I also noticed that scorecard accepted a PR from you to make all their binary names scorecard. Fortunately, I can do integration tests against their earlier releases.

[jayvdb]

It would be great to be able to do ubi --url https://ziglang.org/download/ , as they dont upload binaries to Github Releases.

[autarch]

It would be great to be able to do ubi --url https://ziglang.org/download/ , as they dont upload binaries to Github Releases.

I don't think I will ever implement some sort of HTML parsing to try to extract links. That just seems way too difficult to get right, and it's easily broken by small changes in the HTML page.