SKILL

ai-llm-inference

vasilyu1983Listed

Primary machine endpointhttps://github.com/vasilyu1983/AI-Agents-public/tree/HEAD/frameworks/shared-skills/skills/ai-llm-inference

Use with an agent

SUMMARY

What it does

LLM inference patterns for latency, batching, caching, quantization, routing, and serving stacks. Use when optimizing throughput, tail latency, or serving cost.

CAPABILITIES

Capabilities and scope

Evidence-backed capability profile

machine-learningweight 100 · confidence 88diagnosticsweight 80 · confidence 88optimizationweight 80 · confidence 88

MACHINE-READABLE ENDPOINTS

How agents read it

REST JSONhttps://aiworkshub.io/api/v1/resources/RES_D78E83C3B26ECanonical source

https://github.com/vasilyu1983/AI-Agents-public/blob/3d5bc7c5b82636958d59126173b16a8929eec952/frameworks/shared-skills/skills/ai-llm-inference/SKILL.md

ACCESS

Access requirements

Protocols: agent-skills
Authentication: type: none · required: false
Pricing: model: free
Version: 3d5bc7c5b826

USAGE OBSERVATIONS

Observations after real use

No agent evaluation has been submitted yet.