before the "purge", I was using their old v1 API to download new images from a list of tumblrs...
it still seems to work, even without authentication...
so basically this call to get a list of photo-posts:
curl -s "${TUMBLR}/api/read?type=photo&num=${MAX_POSTS}&start=0"
(with $TUMBLR being the blog's URL)
and then grep for 'photo-url', a bit sed-magic and wget...
If you want, I can post the script...
May not be a bad idea. At lease if it’s posted here, it can’t get deleted unless Ra kills it, and we can reference it when we need it.
Does that make sense?
a
ight, here it is...
you pass it the URL of the blog you want to download. It will create directories for the images and for status-files (they store the id of the latest downloaded post, so subsequent runs won't re-download images)
You'll probably need to adapt the WORKDIR variable...
{diceroller-code}
Good one! Thanks! The way do rip the entire tumblr blogs! (Unless there's an API limitation).
But for the automatic update I need to get access to the RSS. Or ... create a new wordpress plugin, what would require much more time 😁
Need to check the API...
(01 Mar 2019, 16:28 )occorics Wrote: [ -> ]{diceroller-code}
I take it you run several scripts in parallel, right? Otherwise (for one blog only) I would add an '&' at the end of the 'wget' line:
{diceroller-code}
Can’t you take an existing Wordpress Plugin and adapt it suit the needs rather than creating a whole new plugin?
(02 Mar 2019, 02:13 )Tinker D Wrote: [ -> ]Can’t you take an existing Wordpress Plugin and adapt it
That's what I usually do - tinkering 😁
The problem is - there are no similar plugins around. The one I use for the RSS feeds was deleted by the author from everywhere and is, obviously, not supported. It's quite complex and buggy, but it works so far. The most recent version has some bugs fixed, but the caching is removed, what catastrophically degraded the performance, so I use one of the versions, that, actually, needs to be rewritten.
The bottom line is - currently I tweak only what can be easily tweaked without digging into the details, and what will bring the maximum benefit. (BTW, I'm not even a programmer 😁 )
There is no access to the RSS feed in either APIv1 or APIv2, but what might work is the following:
Program 1:
o- Grab the last x posts in the XML format
o- Convert the XML into the RSS XML
o- Store the results in memcache, indexed by the site name
Program 2:
o- Serve HTTP requests from the locallost
o- Return memcache entry according to the site name in the query
Then configure the RSS feed grabber (the current WP plugin) to use the Program 2 URL
The problem #1 - figure out how to convert the Tumblr XML response to an RSS feed.
(01 Mar 2019, 17:54 )Like Ra Wrote: [ -> ]Good one! Thanks! The way do rip the entire tumblr blogs! (Unless there's an API limitation).
But for the automatic update I need to get access to the RSS. Or ... create a new wordpress plugin, what would require much more time 😁
Need to check the API...
It will only rip everything new. That's what the STATFILE is for. It stores the id of the latest downloaded post and the script stops there on the next run. For the first run, it's limited by MAX_POSTS