Using AgentQL and Pipedream to Fix Missing RSS Feeds

Last week I blogged about how I used AgentQL to scrape a web page, this blog to be precise, into pure data. If you don’t remember, AgentQL lets you pass a simple query string that is run against a web page and parsed into data. So for example, I was able to use this query on my home page to get a list of entries in pure data: { blogposts[] { url title date } } The REST API was incredibly easy, and I demonstrated in BoxLang how I could use AgentQL to turn my blog’s home page into a much simpler, smaller, HTML version. This of course begs the question, how else could we transform it? What about creating a RSS feed for a blog that doesn’t have one! Of course, if... more →
Posted in: JavaScript

Watching RSS Feeds for Keywords in Pipedream

Back in the day, I used to run a website called rssWatcher. (If you want, you can read the original launch announcement from 2004.) The idea was simple. You would sign up, then create a list of RSS feeds and corresponding keywords. The service would check this on a schedule and let you know when a match was found. I built this in ColdFusion and I honestly don’t remember when I shut it down, but it was in my mind recently and thought I’d take a stab at building a simple version of this on my favorite service, Pipedream. Here’s how I did it. Raymond Camden… more →
Posted in: JavaScript