Skip to content

feat: package llama.cpp OpenCL backend for Qualcomm midstream - #1

Merged
RadxaYuntian merged 1 commit into
radxa-pkg:mainfrom
chenchongbiao:20260720-init
Jul 27, 2026
Merged

feat: package llama.cpp OpenCL backend for Qualcomm midstream#1
RadxaYuntian merged 1 commit into
radxa-pkg:mainfrom
chenchongbiao:20260720-init

Conversation

@chenchongbiao

@chenchongbiao chenchongbiao commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Build llama.cpp for Q6A and Q8B with the Adreno-optimized OpenCL backend.
Cross-compile directly in the Debian 12 devcontainer with the GNU AArch64 toolchain so standard x86 GitHub runners do not need a nested Docker build. Keep GGML_NATIVE disabled, target OpenCL 2.0, embed the OpenCL kernels, and disable the Hexagon backend.
Lock the source submodule to upstream tag b7992 and depend on qcom-adreno-opencl-midstream.

@chenchongbiao

Copy link
Copy Markdown
Contributor Author
image

@RadxaYuntian RadxaYuntian left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

模板改动之后单独提交

@chenchongbiao

Copy link
Copy Markdown
Contributor Author

RadxaOS-SDK/rsdk#174

提交过了。

@RadxaYuntian

Copy link
Copy Markdown
Member

模板PR还没有合并,这个PR不要包含未合并PR的内容。后续模板PR合并了这边再通过rsdk-infra-package-update去更新

@chenchongbiao
chenchongbiao force-pushed the 20260720-init branch 3 times, most recently from 771fa8a to 21cbbc4 Compare July 24, 2026 03:04
@chenchongbiao chenchongbiao changed the title feat: initial packaging for llama.cpp-qcom-midstream feat: package llama.cpp OpenCL backend for Qualcomm midstream Jul 24, 2026
@chenchongbiao

Copy link
Copy Markdown
Contributor Author

验证交叉编译可以可以通过。

Comment thread debian/changelog
Comment thread src
Comment thread .github/local/Makefile.local
Comment thread .github/local/Makefile.local
Comment thread .github/local/Makefile.local
Comment thread .github/local/Makefile.local Outdated
Build llama.cpp for Q6A and Q8B with the Adreno-optimized OpenCL backend.
Cross-compile directly in the Debian 12 devcontainer with the GNU AArch64 toolchain so standard x86 GitHub runners do not need a nested Docker build. Keep GGML_NATIVE disabled, target OpenCL 2.0, embed the OpenCL kernels, and disable the Hexagon backend.
Lock the source submodule to upstream tag b7992 and depend on qcom-adreno-opencl-midstream.

Signed-off-by: Chongbiao Chen <chenchongbiao@radxa.com>
@RadxaYuntian
RadxaYuntian merged commit 8601625 into radxa-pkg:main Jul 27, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants