Perf Optimization Improvements

[tembo]

Description

Optimize codebase performance by improving response generation, request handling, and caching strategies.

Changes

• Added request queue with priority-based processing
• Implemented response caching mechanism
• Optimized message retrieval and generation
• Reduced unnecessary computations
• Improved delay and message processing logic

Want me to make any changes? Add a review or comment with @tembo and i'll get back to work!

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Preview	Comments	Updated (UTC)
ai-sdk-discourse-bot	Ready	Preview	Comment	Sep 12, 2025 4:05pm

[tembo]

Requesting review from @techwithanirudh who has experience with the following files modified in this PR:

• server/config.ts
• server/lib/kv.ts
• server/lib/discourse/messages.ts
• server/utils/generate-response.ts
• server/utils/tokenize-messages.ts
• server/utils/staggered-response.ts
• server/events/message-create/index.ts

[coderabbitai]

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}