Update vehicle scraping logic and enhance error handling; add CSV output flushing
This commit is contained in:
@@ -2,9 +2,9 @@
|
||||
|
||||
.NET console scraper.
|
||||
|
||||
Kaynak: `http://www.hsn-tsn.de/`
|
||||
Source: `http://www.hsn-tsn.de/`
|
||||
|
||||
CSV cikti alanlari:
|
||||
CSV output fields:
|
||||
|
||||
- `HsnTsn`, `Hsn`, `Tsn`
|
||||
- `Brand`, `VehicleType`, `Model`, `OfficialType`
|
||||
@@ -13,22 +13,22 @@ CSV cikti alanlari:
|
||||
- `MatchKey`
|
||||
- `SourceQuery`, `SourceListUrl`, `SourceDetailUrl`
|
||||
|
||||
## Calistirma
|
||||
## Usage
|
||||
|
||||
Tum marka sayfalarini tara:
|
||||
Scrape all brand pages:
|
||||
|
||||
```bash
|
||||
dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj > hsntsn.csv
|
||||
```
|
||||
|
||||
Sadece verilen sorgulari tara (`stdin`):
|
||||
Scrape only specific queries from `stdin`:
|
||||
|
||||
```bash
|
||||
printf "0588\nGolf\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj > hsntsn.csv
|
||||
```
|
||||
|
||||
Detay sayfasi zenginlestirmesini kapat:
|
||||
Enable detail-page enrichment:
|
||||
|
||||
```bash
|
||||
printf "0588\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj -- --skip-details
|
||||
printf "0588\n" | dotnet run --project src/HsnTsnScraper/HsnTsnScraper.csproj -- --include-details
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user