Put Xet Spec in TOC, rename Storage Backends to Storage Backend - Xet

README.md

@@ -19,8 +19,8 @@ For simple edits, you don't need a local build environment.
 ### Previewing locally
 
 ```bash
-# install doc-builder (if not done already)
-pip install hf-doc-builder
+# install doc-builder (if not done already) - (need to build from source https://github.com/huggingface/doc-builder, pypi package is out of date)
+# pip install hf-doc-builder
 
 # you may also need to install some extra dependencies
 pip install black watchdog

docs/hub/_toctree.yml

@@ -48,7 +48,50 @@
   - local: storage-limits
     title: Storage Limits
   - local: storage-backends
-    title: Storage Backends
+    title: Storage Backend - Xet
+    sections:
+    - local: xet/overview
+      title: Xet History & Overview
+    - local: xet/using-xet-storage
+      title: Using Xet Storage
+    - local: xet/deduplication
+      title: Deduplication
+    - local: xet/protocol/index
+      title: Open Source Xet Protocol
+      sections:
+        - local: xet/protocol/building-client
+          title: Building a client library for xet storage
+          sections:
+            - local: xet/protocol/upload-protocol
+              title: Upload Protocol
+            - local: xet/protocol/download-protocol
+              title: Download Protocol
+            - local: xet/protocol/api
+              title: CAS API
+            - local: xet/protocol/auth
+              title: Authentication and Authorization
+            - local: xet/protocol/file-id
+              title: Hub files conversion to Xet File ID's
+        - local: xet/protocol/architecture
+          title: Overall Xet architecture
+          sections:
+            - local: xet/protocol/chunking
+              title: Content-Defined Chunking
+            - local: xet/protocol/hashing
+              title: Hashing Methods
+            - local: xet/protocol/file-reconstruction
+              title: File Reconstruction
+            - local: xet/protocol/xorb
+              title: Xorb Format
+            - local: xet/protocol/shard
+              title: Shard Format
+            - local: xet/protocol/deduplication
+              title: Deduplication
+    - local: xet/legacy-git-lfs
+      title: Backwards Compatibility & Legacy
+    - local: xet/security
+      title: Security
+
   - local: repositories-pull-requests-discussions
     title: Pull Requests & Discussions
   - local: notifications

docs/hub/index.md

@@ -27,7 +27,7 @@ The Hugging Face Hub is a platform with over 1.7M models, 400k datasets, and 600
 <a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./repositories-getting-started">Getting Started</a>
 <a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./repositories-settings">Repository Settings</a>
 <a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./storage-limits">Storage Limits</a>
-<a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./storage-backends">Storage Backends</a>
+<a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./storage-backends">Storage Backend - Xet</a>
 <a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./repositories-pull-requests-discussions">Pull requests and Discussions</a>
 <a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./notifications">Notifications</a>
 <a class="transform no-underline! transition-colors hover:translate-x-px hover:text-gray-700" href="./collections">Collections</a>
@@ -105,7 +105,7 @@ The Hugging Face Hub is a platform with over 1.7M models, 400k datasets, and 600
 
 We are helping the community work together towards the goal of advancing Machine Learning 🔥.
 
-The Hugging Face Hub is a platform with over 1.7M models, 400k datasets, and 600k demos in which people can easily collaborate in their ML workflows. The Hub works as a central place where anyone can share, explore, discover, and experiment with open-source Machine Learning.
+The Hugging Face Hub is a platform with over 2M models, 500k datasets, and 600k demos in which people can easily collaborate in their ML workflows. The Hub works as a central place where anyone can share, explore, discover, and experiment with open-source Machine Learning.
 
 No single company, including the Tech Titans, will be able to “solve AI” by themselves – the only way we'll achieve this is by sharing knowledge and resources in a community-centric approach. We are building the largest open-source collection of models, datasets, and demos on the Hugging Face Hub to democratize and advance ML for everyone 🚀.
 
@@ -122,7 +122,7 @@ On it, you'll be able to upload and discover...
 - Spaces: _interactive apps for demonstrating ML models directly in your browser_
 
 The Hub offers **versioning, commit history, diffs, branches, and over a dozen library integrations**! 
-All repositories build on [Xet](https://huggingface.co/join/xet), a new technology to efficiently store Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads.
+All repositories build on [Xet](./storage-backends), a new technology to efficiently store Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads.
 
 You can learn more about the features that all repositories share in the [**Repositories documentation**](./repositories).
 

docs/hub/repositories.md

@@ -17,7 +17,7 @@ In these pages, you will go over the basics of getting started with Git and Xet
 - [Getting Started with Repositories](./repositories-getting-started)
 - [Settings](./repositories-settings)
 - [Storage Limits](./storage-limits)
-- [Storage Backends](./storage-backends)
+- [Storage Backend - Xet](./storage-backends)
 - [Pull Requests & Discussions](./repositories-pull-requests-discussions)
   - [Pull Requests advanced usage](./repositories-pull-requests-discussions#pull-requests-advanced-usage)
 - [Collections](./collections)