Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions .github/workflows/llama-container-preview.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ on:
pull_request:
types: [opened, synchronize, reopened, closed]
paths:
- 'wrongsecret-lama-resources'
- 'wrongsecret-lama-resources/*'
- 'Dockerfile_llamaserver1'

permissions:
Expand Down Expand Up @@ -43,7 +43,7 @@ jobs:
id: meta
uses: docker/metadata-action@v5
with:
images: ghcr.io/${{ github.repository }}/wrongsecrets-pr
images: ghcr.io/${{ github.repository }}/wrongsecrets-llamaserver-pr
tags: |
type=ref,event=pr,suffix=-{{sha}}
type=ref,event=pr
Expand All @@ -67,19 +67,19 @@ jobs:
header: llama-preview-instructions
message: |
### 🦙 Llama Container Preview Ready!

You can test this container preview locally using the following commands:

```bash
# 1. Log in to GitHub Container Registry (if not already authenticated)
echo "YOUR_GITHUB_TOKEN" | docker login ghcr.io -u \${{ github.actor }} --password-stdin

# 2. Run the preview container
docker run --rm \
--name wrongsecrets-llama \
--memory=2g \
-p 1234:1234 \
ghcr.io/ github.repository /wrongsecrets-pr:pr-{{ github.event.pull_request.number }}
ghcr.io/github.repository/wrongsecrets-llamaserver-pr:pr-{{ github.event.pull_request.number }}
```

*Note: The specific tag for this specific commit is also available using the commit-SHA suffix if needed.*
1 change: 1 addition & 0 deletions Dockerfile_llamaserver1
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ RUN mkdir -p /models /config \
-o /models/model.gguf \
&& chmod 0444 /models/model.gguf

RUN echo 123
COPY wrongsecret-lama-resources/llama-prompt.txt /config/personality.txt

RUN chmod 0444 /config/personality.txt
Expand Down
1 change: 1 addition & 0 deletions wrongsecret-lama-resources/llama-entrypoint.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ exec /app/llama-server \
-m /models/model.gguf \
--host 0.0.0.0 \
--port 1234 \
--system-prompt "$SYSTEM_PROMPT" \
-c 512 \
-n 128 \
-np 1 \
Expand Down
Loading