- 
                Notifications
    You must be signed in to change notification settings 
- Fork 33
0514 ml usage tags #516
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
          
     Open
      
      
            glenrobson
  wants to merge
  17
  commits into
  master
  
    
      
        
          
  
    
      Choose a base branch
      
     
    
      
        
      
      
        
          
          
        
        
          
            
              
              
              
  
           
        
        
          
            
              
              
           
        
       
     
  
        
          
            
          
            
          
        
       
    
      
from
0514-ml-usage-tags
  
      
      
   
  
    
  
  
  
 
  
      
    base: master
Could not load branches
            
              
  
    Branch not found: {{ refName }}
  
            
                
      Loading
              
            Could not load tags
            
            
              Nothing to show
            
              
  
            
                
      Loading
              
            Are you sure you want to change the base?
            Some commits from the old base branch may be removed from the timeline,
            and old review comments may become outdated.
          
          
  
     Open
                    0514 ml usage tags #516
Changes from all commits
      Commits
    
    
            Show all changes
          
          
            17 commits
          
        
        Select commit
          Hold shift + click to select a range
      
      aa5c1a0
              
                Create index.md
              
              
                alliomeria 647f7e1
              
                Create manifest.json
              
              
                alliomeria 6241c45
              
                Update recipe folder to include issue number
              
              
                alliomeria e0adaf2
              
                Update manifest.json
              
              
                alliomeria d166158
              
                Update manifest.json
              
              
                alliomeria 77074aa
              
                Update index.md
              
              
                alliomeria 507c140
              
                Update index.md
              
              
                alliomeria b1fcc6a
              
                Update index.md
              
              
                alliomeria 19ebd3a
              
                Update manifest.json
              
              
                alliomeria 5c93302
              
                Update manifest.json
              
              
                alliomeria 6ddfc4e
              
                Update manifest.json
              
              
                alliomeria eff85e4
              
                Update index.md
              
              
                alliomeria a5bb159
              
                Update preview.yml
              
              
                alliomeria 5b34696
              
                Update preview.yml
              
              
                alliomeria 191ec32
              
                Update preview.yml
              
              
                alliomeria 4253edc
              
                Update index.md
              
              
                alliomeria ae28788
              
                Update index.md
              
              
                alliomeria File filter
Filter by extension
Conversations
          Failed to load comments.   
        
        
          
      Loading
        
  Jump to
        
          Jump to file
        
      
      
          Failed to load files.   
        
        
          
      Loading
        
  Diff view
Diff view
There are no files selected for viewing
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
              
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
              | Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,117 @@ | ||
| --- | ||
| title: IIIF ML/AI Usage Tags Recipe | ||
| id: | ||
| layout: recipe | ||
| tags: [rights, requiredStatement] | ||
| summary: "Ethical ML/AI Use Tags for IIIF Manifests" | ||
| viewers: | ||
| - Mirador | ||
| - UV | ||
| topic: note | ||
| property: rights, requiredStatement | ||
| --- | ||
|  | ||
| ## Use Case | ||
|  | ||
| Similar to the initiatives crafted by other communities of practice in efforts to limit the scraping of images and text using “noai” and “noimageai” meta HTML tags, users of the IIIF APIs may consider implementing a set of tags/statements in their IIIF manifests to help better regulate ML/AI content scraping and non-consented or attributed use of IIIF powered content in ML/AI applications. | ||
|  | ||
| ## Implementation Notes | ||
|  | ||
| Use of these standardized ML/AI Usage tags/statements in IIIF Manifests will always need to be paired with sophisticated, up-to-date DevOps and data security practices within the context of a repository environment. | ||
|  | ||
| Recommendation is to use a single applicable tag/statement, based on the particular concerns associated with an asset's use in ML/AI applications. | ||
|  | ||
| ### Using `rights` statement URIs sourced from Wikidata | ||
|  | ||
| The examples shown here reference the Wikidata URIs for the different statements. As described in the [IIIF Presentation 3.0 `rights` property](https://iiif.io/api/presentation/3.0/#rights), URIs should be sourced from Creative Commons or RightsStatements.org. For URIs that do not reference either of these sources, the [`extensions`](https://iiif.io/api/presentation/3.0/#46-linked-data-context-and-extensions) mechanism using a source found in one of the [IIIF Registry of Known Extensions](https://iiif.io/api/registry/) can also be used. Wikidata is included in the [Profiles Registry](https://iiif.io/api/registry/profiles/). | ||
|  | ||
| Please see the [goals statement on Stable URIs Development and Maintenance in the Ethical ML/AI Usage Tags Project Repository](https://github.com/alliomeria/ethical_ml_usage_tags/blob/main/README.md#stable-uris-development-and-maintenance) for information about the longer term plans regarding related URIs. When those stable URIs are finalized, a proposal will be made to add to the [Rights Registry](https://iiif.io/api/registry/rights/). | ||
|  | ||
| Aside from providing a link reference which typically leads to a static webpage that describes a license/statement in greater detail, a machineable outcome of the usage of Creative Commons or RightsStatement.org URIs within the `rights` property is the display of the corresponding license/statement icon or badge within one of the standard IIIF viewers (as shown in the example below). In the future, there may be ways to extend the machineable outcomes associated with these ML/AI Usage tags/statements (or other `rights` values) in ways that direct responses to machine-mediated interactions. | ||
|  | ||
| #### For machines, within [`rights`](https://iiif.io/api/presentation/3.0/#rights) | ||
|  | ||
| * No AI | ||
|  | ||
| ```JSON | ||
| { "rights": "https://www.wikidata.org/wiki/Q127515163" } | ||
| ``` | ||
|  | ||
| * No Image AI | ||
|  | ||
| ```JSON | ||
| { "rights": "https://www.wikidata.org/wiki/Q127516405" } | ||
| ``` | ||
|  | ||
| * Regulated ML/AI Use Permitted - Attribution Required | ||
|  | ||
| ```JSON | ||
| { "rights": "https://www.wikidata.org/wiki/Q127516763" } | ||
| ``` | ||
|  | ||
| * Regulated ML/AI Use Permitted - Consent Required | ||
|  | ||
| ```JSON | ||
| { "rights": "https://www.wikidata.org/wiki/Q127518037" } | ||
| ``` | ||
|  | ||
| #### For humans (public display), within [`requiredStatement`](https://iiif.io/api/presentation/3.0/#requiredstatement) | ||
|  | ||
| ```JSON | ||
| { | ||
| "requiredStatement": { | ||
| "label": { "en": [ "No AI" ] }, | ||
| "value": { "en": [ "Material related to this Digital Object should not be used for AI or ML training datasets." ] } | ||
| } | ||
| } | ||
| ``` | ||
| ```JSON | ||
| { | ||
| "requiredStatement": { | ||
| "label": { "en": [ "No Image AI" ] }, | ||
| "value": { "en": [ "Image-based material related to this Digital Object should not be used for AI or ML training datasets." ] } | ||
| } | ||
| } | ||
| ``` | ||
| ```JSON | ||
| { | ||
| "requiredStatement": { | ||
| "label": { "en": [ "Regulated ML/AI Use Permitted - Attribution Required" ] }, | ||
| "value": { "en": [ "material related to this Digital Object may be used for AI or ML training datasets, as long as Standard Attribution of source Digital Object Title and URL is maintained and referenced publicly for the ML/AI dataset." ] } | ||
| } | ||
| } | ||
| ``` | ||
| ```JSON | ||
| { | ||
| "requiredStatement": { | ||
| "label": { "en": [ "Regulated ML/AI Use Permitted - Consent Required" ] }, | ||
| "value": { "en": [ "Material related to this Digital Object may be used for AI or ML training datasets, if Prior Written Consent is obtained from the Source Holding Institution and Standard Attribution is maintained and referenced publicly." ] } | ||
| } | ||
| } | ||
| ``` | ||
|  | ||
| #### Additional Considerations | ||
|  | ||
| * Simple use cases (apply per manifest) versus complex uses casses (apply per item/canvas) | ||
|  | ||
| * IIIF is an API based framework, geared to machine mediated interactions but: **IIIF resources are for humans** | ||
|  | ||
| * As we, professionally and personally, decide to use or integrate ML/AI tools into our repositories, we need to keep in mind our curatorial legacies and the complex nature of our own content. | ||
|  | ||
| * ML/AI technology will continue to shift over time and require diligent application and monitoring, for the rest of our professional lives. | ||
|  | ||
| ## Restrictions | ||
|  | ||
| No known restrictions. | ||
|  | ||
| ## Example | ||
|  | ||
| The [IIIF 3.0 Specs](https://iiif.io/api/presentation/3.0/) restrict `rights` to a single value string format, and `requiredStatement` to a single value JSON Object. The example shown below uses a singe applicable ML/AI Usage statement Wikidata URI in `rights`, paired with a set of two human-readable `value` statements (one for ML/AI usage and one for a standard Creative Commons reference) in `requiredStatement` (structured as a single JSON object). | ||
|  | ||
| {% include manifest_links.html manifest="manifest.json" %} | ||
|  | ||
| {% include jsonviewer.html src="manifest.json" config='data-line="15-28"' %} | ||
|  | ||
| ## Related Recipes | ||
|  | ||
| * [Rights][0008] for demonstrating use of `rights` and `requiredStatement` | 
  
    
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
      Learn more about bidirectional Unicode characters
    
  
  
    
              | Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,67 @@ | ||
| { | ||
| "@context": [ | ||
| "http://iiif.io/api/presentation/3/context.json" | ||
| ], | ||
| "id": "{{ id.url }}", | ||
| "type": "Manifest", | ||
| "label": { | ||
| "en": [ | ||
| "Picture of Göttingen taken during the 2019 IIIF Conference" | ||
| ] | ||
| }, | ||
| "summary": { | ||
| "en": [ | ||
| "<p>Picture taken by the <a href=\"https://github.com/glenrobson\">IIIF Technical Coordinator</a></p>" | ||
| ] | ||
| }, | ||
| "rights": "https://www.wikidata.org/wiki/Q127518037", | ||
| "requiredStatement": { | ||
| "label": { | ||
| "en": [ | ||
| "Regulated ML/AI Use Permitted - Consent Required" | ||
| ] | ||
| }, | ||
| "value": { | ||
| "en": [ | ||
| "Material related to this Digital Object may be used for AI or ML training datasets, if Prior Written Consent is obtained from the Source Holding Institution and Standard Attribution is maintained and referenced publicly.", | ||
| "Attribution: <span>Glen Robson, IIIF Technical Coordinator. <a href=\"https://creativecommons.org/licenses/by-sa/3.0\">CC BY-SA 3.0</a> <a href=\"https://creativecommons.org/licenses/by-sa/3.0\" title=\"CC BY-SA 3.0\"><img src=\"https://licensebuttons.net/l/by-sa/3.0/88x31.png\"/></a></span>" | ||
| ] | ||
| } | ||
| }, | ||
| "items": [ | ||
| { | ||
| "id": "{{ id.path }}/canvas/p1", | ||
| "type": "Canvas", | ||
| "height": 3024, | ||
| "width": 4032, | ||
| "items": [ | ||
| { | ||
| "id": "{{ id.path }}/page/p1/1", | ||
| "type": "AnnotationPage", | ||
| "items": [ | ||
| { | ||
| "id": "{{ id.path }}/annotation/p0001-image", | ||
| "type": "Annotation", | ||
| "motivation": "painting", | ||
| "body": { | ||
| "id": "https://iiif.io/api/image/3.0/example/reference/918ecd18c2592080851777620de9bcb5-gottingen/full/max/0/default.jpg", | ||
| "type": "Image", | ||
| "format": "image/jpeg", | ||
| "height": 3024, | ||
| "width": 4032, | ||
| "service": [ | ||
| { | ||
| "id": "https://iiif.io/api/image/3.0/example/reference/918ecd18c2592080851777620de9bcb5-gottingen", | ||
| "profile": "level1", | ||
| "type": "ImageService3" | ||
| } | ||
| ] | ||
| }, | ||
| "target": "{{ id.path }}/canvas/p1" | ||
| } | ||
| ] | ||
| } | ||
| ] | ||
| } | ||
| ] | ||
| } | ||
  Add this suggestion to a batch that can be applied as a single commit.
  This suggestion is invalid because no changes were made to the code.
  Suggestions cannot be applied while the pull request is closed.
  Suggestions cannot be applied while viewing a subset of changes.
  Only one suggestion per line can be applied in a batch.
  Add this suggestion to a batch that can be applied as a single commit.
  Applying suggestions on deleted lines is not supported.
  You must change the existing code in this line in order to create a valid suggestion.
  Outdated suggestions cannot be applied.
  This suggestion has been applied or marked resolved.
  Suggestions cannot be applied from pending reviews.
  Suggestions cannot be applied on multi-line comments.
  Suggestions cannot be applied while the pull request is queued to merge.
  Suggestion cannot be applied right now. Please check back later.
  
    
  
    
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Cool!