liter-llm.cr

Crystal bindings for liter-llm, generated by alef. The native libliter_llm_ffi is downloaded from the upstream GitHub release (Go-style download_ffi), since Crystal has no registry for prebuilt native shards.

Install

dependencies:
  liter_llm:
    github: dsisnero/liter-llm.cr

shards install
./scripts/download_ffi.sh   # fetches libliter_llm_ffi.so/.dylib/.dll

Usage

crystal build --link-flags="-L.lib -Wl,-rpath,$(pwd)/.lib" src/app.cr

require "liter_llm"

client = LiterLlm.create_client(ENV["LLM_API_KEY"], nil, 60_u64, 0_u32, nil)

Test

make spec

Set LITER_LLM_FFI_VERSION / LITER_LLM_FFI_REPO to override the source.