Code

Adding a llama.cpp LLM Component#1052

Code

Open

edlee123 wants to merge 49 commits intoopea-project:mainopea-project/GenAIComps:mainfrom edlee123:llamacppedlee123/GenAIComps:llamacppCopy head branch name to clipboard

+350-28

Commits

Commits on Dec 20, 2024

• First commit of llamacpp Opea component

  Show description for 397f7b8
  edlee123

  committed
  397f7b8

  Copy full SHA for 397f7b8

• Removed unneeded requirements file

  Show description for cb4f5e5
  edlee123

  committed
  cb4f5e5

  Copy full SHA for cb4f5e5

• Merge branch 'main' into llamacpp

  edlee123

  authored
  df3d943

  Copy full SHA for df3d943

Commits on Dec 28, 2024

• Merge branch 'main' into llamacpp

  edlee123

  authored
  8893f38

  Copy full SHA for 8893f38

Commits on Jan 6, 2025

• Pin the llama.cpp server version, and fix small typo

  Show description for 2a48bae
  edlee123

  committed
  2a48bae

  Copy full SHA for 2a48bae

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  644ecce

  Copy full SHA for 644ecce

• Update README.md to describe hardware support, and provide reference.

  Show description for 4e82152
  edlee123

  committed
  4e82152

  Copy full SHA for 4e82152

• Updated docker_compose_llm.yaml so that the llamacpp-server so the pulled image has specific tag.

  Show description for baf381d
  edlee123

  committed
  baf381d

  Copy full SHA for baf381d

• Merge branch 'main' into llamacpp

  edlee123

  authored
  7bab970

  Copy full SHA for 7bab970

Commits on Jan 7, 2025

• Merge branch 'main' into llamacpp

  edlee123

  authored
  e4f4b70

  Copy full SHA for e4f4b70

• Small adjustments to README.md

  Show description for 9d7539d
  edlee123

  committed
  9d7539d

  Copy full SHA for 9d7539d

Commits on Jan 8, 2025

• Merge branch 'main' into llamacpp

  edlee123

  authored
  2cf25e5

  Copy full SHA for 2cf25e5

Commits on Jan 10, 2025

• This removes unneeded dependencies in the Dockerfile, unneeded entrypoint.sh

  Show description for fd15ee7
  edlee123

  committed
  fd15ee7

  Copy full SHA for fd15ee7

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  666196c

  Copy full SHA for 666196c

• Merge branch 'main' into llamacpp

  edlee123

  authored
  104527a

  Copy full SHA for 104527a

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for c931902
  pre-commit-ci[bot]

  committed
  c931902

  Copy full SHA for c931902

Commits on Jan 24, 2025

• Merge branch 'main' into llamacpp

  edlee123

  authored
  6b98403

  Copy full SHA for 6b98403

Commits on Feb 3, 2025

• Merge branch 'main' into llamacpp

  edlee123

  authored
  240d3d1

  Copy full SHA for 240d3d1

Commits on Feb 14, 2025

• Merge branch 'main' into llamacpp

  edlee123

  authored
  91e0fd4

  Copy full SHA for 91e0fd4

• Refactored llama cpp and text-generation README_llamacpp.md

  Show description for a75d28d
  edlee123

  committed
  a75d28d

  Copy full SHA for a75d28d

• Delete unrefactored files

  Show description for 830da58
  edlee123

  committed
  830da58

  Copy full SHA for 830da58

• Adding llama.cpp backend include in the compose_text-genearation.yaml

  Show description for 8d058bb
  edlee123

  committed
  8d058bb

  Copy full SHA for 8d058bb

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  a0294a5

  Copy full SHA for a0294a5

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for a6740b6
  pre-commit-ci[bot]

  committed
  a6740b6

  Copy full SHA for a6740b6

Commits on Feb 21, 2025

• Fix service name

  Show description for d0e27bf
  edlee123

  committed
  d0e27bf

  Copy full SHA for d0e27bf

• Revise llamacpp, using smaller Qwen model and remove unnecessary curl model argument

  Show description for 91324af
  edlee123

  committed
  91324af

  Copy full SHA for 91324af

• Update llamacpp thirdparty readme to use smaller model

  Show description for f295e29
  edlee123

  committed
  f295e29

  Copy full SHA for f295e29

• Fix healthcheck in llamacpp deployment compose.yaml

  Show description for 480cb69
  edlee123

  committed
  480cb69

  Copy full SHA for 480cb69

• Wrote a test and tested for llamacpp text gen service

  Show description for 2c9f877
  edlee123

  committed
  2c9f877

  Copy full SHA for 2c9f877

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  f3147f1

  Copy full SHA for f3147f1

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 7310d6a
  pre-commit-ci[bot]

  committed
  7310d6a

  Copy full SHA for 7310d6a

• Merge branch 'main' into llamacpp

  edlee123

  authored
  80ed9b0

  Copy full SHA for 80ed9b0

• Increase the llamacpp-server wait time

  Show description for efde309
  edlee123

  committed
  efde309

  Copy full SHA for efde309

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  1a7db52

  Copy full SHA for 1a7db52

• Fixed typos on http environment variables, and volumes

  Show description for c474a64
  edlee123

  committed
  c474a64

  Copy full SHA for c474a64

• Splitting the llama.cpp test to use compose up on the llama.cpp third-party service first.

  Show description for 712f575
  edlee123

  committed
  712f575

  Copy full SHA for 712f575

Commits on Feb 22, 2025

• add alternate command to stop and remove docker containers from previous tests

  Show description for 68cc00f
  edlee123

  committed
  68cc00f

  Copy full SHA for 68cc00f

• Modifying tear down of stop_docker in llamacpp tests to try to remove all containers.

  Show description for 2dd2064
  edlee123

  committed
  2dd2064

  Copy full SHA for 2dd2064

• Adding some logs output to debug llamacpp test

  Show description for dbff6fc
  edlee123

  committed
  dbff6fc

  Copy full SHA for dbff6fc

• Found model path bug and fixed it to run llama.cpp test

  Show description for f184897
  edlee123

  committed
  f184897

  Copy full SHA for f184897

• Adjusted LLM_ENDPOINT env variable

  Show description for ea4ea38
  edlee123

  committed
  ea4ea38

  Copy full SHA for ea4ea38

• Cleaned up test file

  Show description for 01fca03
  edlee123

  committed
  01fca03

  Copy full SHA for 01fca03

• Adjust host_ip env variable in scope of start_service

  Show description for dfd5057
  edlee123

  committed
  dfd5057

  Copy full SHA for dfd5057

Commits on Feb 24, 2025

• Merge branch 'main' into llamacpp

  edlee123

  authored
  a741320

  Copy full SHA for a741320

• Docker ps to debug orphaned containers.

  Show description for 4a965da
  edlee123

  committed
  4a965da

  Copy full SHA for 4a965da

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  25240da

  Copy full SHA for 25240da

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 32b06e9
  pre-commit-ci[bot]

  committed
  32b06e9

  Copy full SHA for 32b06e9

• Adding output to debug orphaned docker containers

  Show description for 3363504
  edlee123

  committed
  3363504

  Copy full SHA for 3363504

• Merge branch 'llamacpp' of github.com:edlee123/GenAIComps into llamacpp

  edlee123

  committed
  421b1ab

  Copy full SHA for 421b1ab