Skip to content

Commit dc2fce7

Browse files
committed
Release 1.0.0-beta2
Signed-off-by: deadprogram <[email protected]>
1 parent 9d1f54f commit dc2fce7

File tree

2 files changed

+21
-2
lines changed

2 files changed

+21
-2
lines changed

README.md

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -149,7 +149,26 @@ Whenever there is a new release of `llama.cpp`, the tests for `yzma` are run aut
149149

150150
## Benchmarks
151151

152-
Want to see some benchmarks? Take a look at the [BENCHMARKS.md](./BENCHMARKS.md) document.
152+
`yzma` is fast because it calls `llama.cpp` in the same process. No external servers needed!
153+
154+
155+
```shell
156+
$ go test -bench=BenchmarkInference -benchtime=10s -count=5 -v -run=nada ./pkg/llama
157+
goos: darwin
158+
goarch: arm64
159+
pkg: github.com/hybridgroup/yzma/pkg/llama
160+
cpu: Apple M4 Max
161+
BenchmarkInference
162+
BenchmarkInference-16 212 56221789 ns/op 533.6 tokens/s
163+
BenchmarkInference-16 212 56651795 ns/op 529.6 tokens/s
164+
BenchmarkInference-16 213 56220516 ns/op 533.6 tokens/s
165+
BenchmarkInference-16 213 56204004 ns/op 533.8 tokens/s
166+
BenchmarkInference-16 208 57035355 ns/op 526.0 tokens/s
167+
PASS
168+
ok github.com/hybridgroup/yzma/pkg/llama 60.415s
169+
```
170+
171+
Want to see more benchmarks? Take a look at the [BENCHMARKS.md](./BENCHMARKS.md) document.
153172

154173
## More Info
155174

version.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
package yzma
22

3-
const currentVersion = "1.0.0-beta1"
3+
const currentVersion = "1.0.0-beta2"
44

55
// Version returns the current version of the yzma package.
66
func Version() string {

0 commit comments

Comments
 (0)