aggro.git/plugins/ScraperSourcePlugin.py, branch main
A feed manipulator & aggregator
http://forge.jan.systems/aggro.git/atom?h=main
2025-03-22T08:09:10Z
Add crawl_detail_page option to Scraper
2025-03-22T08:09:10Z
Jan Tuomi
jans.tuomi@gmail.com
2025-03-22T08:09:10Z
urn:sha1:b482facc9e8f5599cad176885b06bba6eef055d3
Fix unbound variable bug
2024-05-20T09:51:20Z
Jan Tuomi
jans.tuomi@gmail.com
2024-05-20T09:51:20Z
urn:sha1:15623fb8204f9ba421f2cf8396837858093d7d88
Improve scraper logs
2024-04-20T19:08:05Z
Jan Tuomi
jans.tuomi@gmail.com
2024-04-20T19:08:05Z
urn:sha1:861333c28a8f0eb5663c5b744212d4d1a5eaf4ab
Fix same issue in ScraperSourcePlugin
2024-04-11T08:53:32Z
Jan Tuomi
jans.tuomi@gmail.com
2024-04-11T08:53:32Z
urn:sha1:c8da3f055b9990635fabb1d87f78b79e34da89be
Cast image_elem["style"] to string
2023-10-09T12:52:58Z
Jan Tuomi
jans.tuomi@gmail.com
2023-10-09T12:52:58Z
urn:sha1:0a9a74f6e21d174148d3796fffb079ff80feb394
Improve http error logging
2023-09-25T07:11:28Z
Jan Tuomi
jans.tuomi@gmail.com
2023-09-25T07:11:28Z
urn:sha1:bd77148bef39829350670856706b48ad35837df1
Improve scraper errors
2023-09-22T15:38:15Z
Jan Tuomi
jans.tuomi@gmail.com
2023-09-22T15:38:15Z
urn:sha1:4844c3f4baf97d9ef7a194ab1f24ce922b927b7b
Support meta content style images
2023-09-13T16:55:22Z
Jan Tuomi
jans.tuomi@gmail.com
2023-09-13T16:55:22Z
urn:sha1:88b6110faa34df0bb92c94d78ccec967ad544340
Add doctype to html, browser-like headers to scraper
2023-09-13T13:17:10Z
Jan Tuomi
jans.tuomi@gmail.com
2023-09-13T13:17:10Z
urn:sha1:82901e29439c2ddd29a20ad993db8fa1ec918d9c
Strip quotes from around background-image urls
2023-09-13T10:38:46Z
Jan Tuomi
jans.tuomi@gmail.com
2023-09-13T10:38:46Z
urn:sha1:cc8f1632a859a414dd3f7ab3d23d341c36a36a6a