João Galego

LLM Goblet 🍷

LLM proxy application powered by AWS Chalice and LiteLLM.

👨‍💻 All code and documentation is available at github.com/JGalego/LLM-Goblet.

Prerequisites

Conda (preferred) or Python (version >=3.9) 🐍
(Optional) just and jq

Getting Started

Install dependencies
```
 pip install -r requirements.txt
```
Build and deploy the application
```
 chalice deploy --stage dev
```

Test it out!

 curl -s -X POST `chalice url --stage dev`/images/generations \
     --user "$AWS_ACCESS_KEY_ID":"$AWS_SECRET_ACCESS_KEY" \
     --aws-sigv4 "aws:amz:$AWS_DEFAULT_REGION:execute-api" \
     -H "x-amz-security-token: $AWS_SESSION_TOKEN" \
     -H "Accept: application/json" \
     -H "Content-Type: application/json" \
     -d @assets/goblet.json | jq -r .data[0].b64_json | base64 -d > assets/goblet.jpg

But wait, there’s more!

This project includes a justfile that simplifies the process of building, deploying and testing the application.

# Run 🛠️
just local
just deploy

# Check ✅
just check

# Test 🚀
just talk "What is the meaning of life?"
just embed "So long and thanks for all the fish"
just image "An astronaut riding a horse on Mars"

# Clean 🧹
just destroy

Want to learn more about just? Check out the Just Programmer’s Manual 📖