You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+2-1Lines changed: 2 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,8 @@
2
2
3
3
To install, run
4
4
```make LLAMA_HIPBLAS=1```
5
-
To use ROCM, set GPU layers with --gpulayers when starting koboldcpp
5
+
To use ROCM, set GPU layers with --gpulayers when starting koboldcpp
6
+
Original [llama.cpp rocm port](https://github.com/ggerganov/llama.cpp/pull/1087) by SlyEcho, ported to koboldcpp by yellowrosecx
6
7
7
8
Comparison with OpenCL using 6800xt
8
9
| Model | Offloading Method | Time Taken - Processing 593 tokens| Time Taken - Generating 200 tokens| Total Time | Perf. Diff.
0 commit comments