chore: Add llms.txt to documentation

[hjgraca]

Please provide the issue number

Issue number: #892

Summary

Changes

This pull request updates the documentation dependencies and configuration to include support for generating LLM (Large Language Model)-specific text outputs. Key changes include the addition of new dependencies, updates to the mkdocs.yml configuration, and adjustments to the requirements files.

Dependency Updates:

• Added mkdocs-llmstxt==0.2.0 to docs/requirements.in and docs/requirements.txt to enable LLM-specific text generation. [1] [2]
• Introduced dependencies such as beautifulsoup4, markdown-it-py, markdownify, mdformat, and mdurl to support the new plugin and its functionality. [1] [2] [3]

Configuration Updates:

• Updated mkdocs.yml to include a new "Resources" section in the navigation menu, linking to LLM-specific text files (llms.txt and llms-full.txt).
• Configured the llmstxt plugin in mkdocs.yml with descriptions, output paths, and specific sections for generating structured LLM text outputs.

User experience

Please share what the user experience looks like before and after this change

Checklist

Please leave checklist items unchecked if they do not apply to your change.

• Meets tenets criteria
• I have performed a self-review of this change
• Changes have been tested
• Changes are documented
• PR title follows conventional commit semantics

Is this a breaking change?

RFC issue number:

Checklist:

• Migration process documented
• Implement warnings (if it can live side by side)

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud