Update vehicle scraping logic and enhance error handling; add CSV output flushing

This commit is contained in:
2026-03-04 14:43:27 +03:00
parent fb2c2cdb8a
commit a10aabe4bf
3 changed files with 101 additions and 98 deletions
+7 -7
View File
@@ -2,9 +2,9 @@
.NET console scraper.
Kaynak: `http://www.hsn-tsn.de/`
Source: `http://www.hsn-tsn.de/`
CSV cikti alanlari:
CSV output fields:
- `HsnTsn`, `Hsn`, `Tsn`
- `Brand`, `VehicleType`, `Model`, `OfficialType`
@@ -13,22 +13,22 @@ CSV cikti alanlari:
- `MatchKey`
- `SourceQuery`, `SourceListUrl`, `SourceDetailUrl`
## Calistirma
## Usage
Tum marka sayfalarini tara:
Scrape all brand pages:
```bash
dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj > hsntsn.csv
```
Sadece verilen sorgulari tara (`stdin`):
Scrape only specific queries from `stdin`:
```bash
printf "0588\nGolf\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj > hsntsn.csv
```
Detay sayfasi zenginlestirmesini kapat:
Enable detail-page enrichment:
```bash
printf "0588\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj -- --skip-details
printf "0588\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj -- --include-details
```