35 lines
731 B
Markdown
35 lines
731 B
Markdown
# hsntsn-scraper
|
|
|
|
.NET console scraper.
|
|
|
|
Source: `http://www.hsn-tsn.de/`
|
|
|
|
CSV output fields:
|
|
|
|
- `HsnTsn`, `Hsn`, `Tsn`
|
|
- `Brand`, `VehicleType`, `Model`, `OfficialType`
|
|
- `YearFrom`, `YearTo`
|
|
- `PowerPs`, `PowerKw`, `DisplacementCcm`, `FuelType`
|
|
- `MatchKey`
|
|
- `SourceQuery`, `SourceListUrl`, `SourceDetailUrl`
|
|
|
|
## Usage
|
|
|
|
Scrape all brand pages:
|
|
|
|
```bash
|
|
dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj > hsntsn.csv
|
|
```
|
|
|
|
Scrape only specific queries from `stdin`:
|
|
|
|
```bash
|
|
printf "0588\nGolf\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj > hsntsn.csv
|
|
```
|
|
|
|
Enable detail-page enrichment:
|
|
|
|
```bash
|
|
printf "0588\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj -- --include-details
|
|
```
|