Skip to content

ggml-cpu: Add operator-level execution time profiling #17544

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

ggml-cpu: Add operator-level execution time profiling #17544

wants to merge 3 commits into from
+85 −0

Conversation

@kimminsu38oo
Copy link
Contributor

@kimminsu38oo kimminsu38oo commented Nov 27, 2025 •
edited
Loading

This PR adds operator-level profiling to the ggml-cpu backend.

Key Changes

  • Compile Option: Added GGML_CPU_OP_PROFILING to enable this feature.
  • Output: Saves operator execution times in ms to op_profiling.csv
  • Thread Safety: Implemented synchronization barriers to ensure accurate timing in multi-threaded environments.

Performance

  • Negligible runtime overhead.

Example Output
image

@github-actions github-actions bot added the ggml changes relating to the ggml tensor library for machine learning label Nov 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ggerganov ggerganov Awaiting requested review from ggerganov ggerganov is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@kimminsu38oo