less subscribe buttons more rss feeds
htis is my hubble request for 2022
anyway i am thinking of making a furaffinity to rss scraper
i found an existing one but it quotes lowtax in its readme so im going to pass
maybe someone who is actually familiar with how fa works should be doing this instead of me
it is extremely frustrating that i could scrape almost everything i need in a single request *except* submission date for which i need to visit each submission's page
this *could* have been easy but instead i'm going to have to involve *cache*
*emphasis*
why does FA insist on calling every time zone "Something Standard Time"
shout outs for not having the same wonky time zone list as half the web but no shout outs for, whatever the fuck this is
update on this garbage: it works
i do not know how careful i should be hitting fa with automated requests so i'm not making it public quite yet
@codl you really really really gotta hammer them to get banned, i've done sustained 3-4 requests a second without being banned in the past
@ChlorideCull oh sick good to know
@codl I've written a browser extension that opens all submission links on a page into new tabs with a default rate limit of 1 sec per link, which is almost always fine. If the site is under heavy load it will sometimes start throwing 503s but it's rare. I imagine each link generates at least a couple of requests.
Tired: Using tzdata, which is what everyone on the Internet uses, and which is maintained by like three people total
Wired: Maintaining your own timezone list, used by your website, maintained by you
🔹
@codl wow, it's literally just a list of "here's all the UTC offsets that are currently used in time zones"
but just the UTC offsets, no other time zone rules?
I'd expect the daylight savings time support to be broken on this site (like, does it handle north vs south hemisphere, or changes by a different amount than 1h?)
@kepstin yeah i have no idea, there is a checkbox for dst but that's it
and i have to *reverse* that mystery dst since i'm making a scraper
shout outs to india standard t
ime