Skip to content

Commit 17fc1a0

Browse files
committed
Builder for scraperr, added geoapi support.
- Removed direct use of the server_scraper function, now offering a builder interface for scrapers. - Added GeoAPI support. - Refactored the scraper code as part of the builder interface. - Updated documentation to match new code. - Added markdownlint to allow for duplicate headers in the README.md.
1 parent 4e1ebb3 commit 17fc1a0

File tree

15 files changed

+1068
-174
lines changed

15 files changed

+1068
-174
lines changed

.markdownlint.json

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
{
2+
"default": true,
3+
"MD013": false,
4+
"MD024": false
5+
}

Cargo.lock

Lines changed: 83 additions & 39 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Cargo.toml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,3 +21,5 @@ chrono = { version = "0.4", features = ["serde"] }
2121
yare = "3"
2222
futures = "0.3"
2323
log = "0.4"
24+
lazy_static = "1"
25+
rand = "*"

Changelog.md

Lines changed: 41 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,41 @@
1+
# Changelog
2+
3+
All notable changes to this project will be documented in this file.
4+
5+
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
6+
and this will adhere to [Semantic Versioning](https://semver.org/spec/v2.0.0.html) once
7+
we reach version 0.1.0, up until then, expect breaking changes.
8+
9+
## [Unreleased]
10+
11+
### Added
12+
13+
- GeoAPI support.
14+
- A builder interface for scraping, `Scraper`, allowing for easier configuration of the scraper and more flexibility in the future.
15+
- Pre-flight validation of the scraper configuration when using the builder interface.
16+
17+
### Changed
18+
19+
- The `server_scraper` function now takes a fourth argument, an optional list of GeoAPI servers to test against.
20+
21+
### Added
22+
23+
- A changelog...
24+
- Support for ignoring repositories to prevent them from being part of the scan. Note that ignoring takes precedence over even explicit including.
25+
26+
## [0.0.2] - 2024-06-30
27+
28+
### Added
29+
30+
- Improved documentation for relevant types.
31+
- Re-exported MaybeRfc2822DateTime and Manifest.
32+
33+
### Changed
34+
35+
- Moved from using a from_str-like interface to create Manifests to implementing FromStr and thus allowing the use of parse().
36+
37+
## [0.0.1] - 2024-06-30
38+
39+
### Added
40+
41+
- Initial release.

0 commit comments

Comments
 (0)