Skip to content

Commit 4193ccf

Browse files
committed
fix: numbering
1 parent 2aee8b8 commit 4193ccf

File tree

1 file changed

+2
-2
lines changed
  • blog/2023-12-23-how-we-built-cost-effective-generative-ai-application

1 file changed

+2
-2
lines changed

blog/2023-12-23-how-we-built-cost-effective-generative-ai-application/index.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@ Additionally, we implemented triage logic to skip trivial changes from the revie
5151
By using this dual-model approach for summarization and filtering out trivial changes, we save almost 50% on costs.
5252

5353

54-
## Rate-limiting: Enforcing Fair Usage
54+
## 2. Rate-limiting: Enforcing Fair Usage
5555

5656
Upon launching our free service for open source projects, we noticed individual developers using it as a coding co-pilot by making hundreds of incremental commits for continuous feedback. CodeRabbit, designed for thorough code reviews unlike tools such as GitHub Copilot, incurs high costs when used in this manner. Therefore, we implemented hourly rate-limits on the number of files and commits reviewed per user, to control excessive usage without compromising user experience. These limits vary across different product tiers. For example, we set more aggressive limits for open source users compared to trial and paid users.
5757

@@ -81,7 +81,7 @@ Given the high cost and capacity constraints of state-of-the-art models such as
8181
Rate limit metrics for open source users
8282

8383

84-
## Caching: Avoid Re-generating Similar Review Comments
84+
## 3. Caching: Avoid Re-generating Similar Review Comments
8585

8686
We believe that building user habits around AI involves seamlessly augmenting existing workflows. Therefore, AI code reviews must be continuous: they should trigger as soon as a PR is opened and incrementally update the summary and generate review comments as more commits are added.
8787

0 commit comments

Comments
 (0)