Nvidia Graph API support

[hackey]

When to expect Nvidia Graph API support?
I see that the ancient llama.cpp branch is still used in the examples: https://github.com/ggerganov/llama.cpp b1500
Colleagues, please tell me, is support for more recent llama.cpp builds expected? For me, this is like a trigger for more complete support for Nvidia Graph API.

[ChrisKitching]

Hi! The release that came out two days ago actually adds support for a chunk of the graph API. Perhaps enough to satisfy your needs! The example scripts still haven't been updated, but it's highly lightly that at least a new-er version of llama works now!

You can see the full API compatibility report (we publish those now) here:
https://docs.scale-lang.com/stable/manual/api-runtime/#630-graph-management