Classifying Documents with Generative AI / / No Comments Generative AI and documents is a fairly common topic these days, typically in the form of creating summaries or asking questions about the documents. I was curious how generative AI could help in terms of classification. Way back in January of this year, I blogged about using Google’s Gemini API to classify images based on whether they were a photo, screenshot, or meme: "Using GenAI to Classify an Image as a Photo, Screenshot, or Meme". That actually worked well and I thought perhaps it could work with text as well. Specifically: Your organization gets an influx of documents, lets say many per day… And you would like to categorize them for sorting/processing later Before... more → Posted in: JavaScript Tagged with: Classifying, documents, Generative
Automating Object Detection with Google Gemini GenAI and Pipedream / / No Comments For my last technical post of the year (although I can’t promise I’ll stop blogging!), I wanted to share an interesting workflow I built using Google Gemini and Pipedream. The idea was somewhat simple – how difficult would it be to build a "general purpose" workflow to look for objects in images and trigger an alert if certain things were found. Here’s what I was able to build. Step One – Image Input In my mind, I imagined this workflow would be tied to some service that was either streaming in video or generating still images. You could image a security camera posting new pictures every 30 seconds or so, or some other system that takes a picture at a regular... more → Posted in: JavaScript Tagged with: Automating, Detection, Gemini, GenAI, Google, Object, Pipedream
In Search of My Next Role / / No Comments This week I discovered, unfortunately, that my position at Adobe has been eliminated. I’m incredibly proud of what I’ve achieved during my time at Adobe, but now need to find my next opportunity. If you’ve ever gained anything from one of my posts, or presentations, I’d absolutely love a recommendation or referral for a position in developer relations. I’m also looking for a role where I could mentor, or lead, a team of developer advocates/evangelists. So, if you know of a role, or have a role yourself, please reach out! Raymond Camden… more → Posted in: JavaScript Tagged with: Next, Role, search
Adding PDFs to Your Webpage without JavaScript / / No Comments Edited at 4:03PM to add a small note to the end. In my time at Adobe, one of the products I evangelized was the PDF Embed API, a JavaScript library for adding PDFs to a web page. I still recommend this library of course, but I was thinking this morning about how you could get similar results without JavaScript. Remember, you are allowed to build a web page and not ship any JavaScript. It’s ok, I won’t tell. Before looking at what I built, some context to why someone would use a library like Adobe’s PDF Embed: Browser’s have great built-in PDF support, natively, but the display is typically the entire page, which means you lose the context of the rest of your site. There’s... more → Posted in: JavaScript Tagged with: Adding, JavaScript, PDFs, Webpage, without
Summarizing with Transformers.js / / No Comments Earlier this month I took my first look at using Transformers.js, a JavaScript SDK around multiple different models hosted by Hugging Face. My initial experiments worked pretty OK I think. The sentiment analysis felt pretty good, and the object detection (with a cat demo of course), worked pretty good as well. I was curious how well summarization would work, and while I’m not quite as impressed as I was before, I thought I’d share what I found. (And it’s 100% possible I’m not tweaking the right knobs to get better results, so if you see a way to improve my results, leave me a comment!) A Basic Test If you remember from the first post, usage can be fairly simple. Import... more → Posted in: JavaScript Tagged with: Summarizing, Transformers.js
The Twelve (Generative) Days of Christmas – 2024 Edition / / No Comments Last year I did a fun little experiment where I asked a few different generative models to generateimages based on the classic Twelve Days of Christmas song. For those unfamiliar, the song is about a series of gifts given over twelve days: partridge in a pear treetwo turtle dovesthree French hensfour calling birdsfive golden ringssix geese a-layingseven swans a-swimmingeight maids a-milkingnine ladies dancingten lords a-leapingeleven pipers pipingtwelve drummers drumming To be clear, this was done for fun, nothing more. Also, the prompts were literally just the lyrics, nothing more (with some exceptions, see the details below). In a ‘real world’ example if you wanted to generate images... more → Posted in: JavaScript Tagged with: 2024, Christmas, Days, Edition, Generative, Twelve
Links For You (12/14/24) / / No Comments Good morning folks, as I shared yesterday, this week has been a bit rough as I found out my job was eliminated at Adobe, but the outpouring of support, and links to jobs, has been overwhelming. You people are pretty darn good, you know what? I’m confident I’m going to be able to land a good job, but at the same time, it’s going to be a heck of a lot less stressful once I actually do. On top of that, I’ve got a head cold, which is annoying af as the kids say, but, I’m alive, surrounded by people who love me, well fed and warm, so all things considered, I’m pretty dang lucky. Let’s get to the link. AI in the Browser – A Playlist A month or so ago,... more → Posted in: JavaScript Tagged with: 12/14/24, links
Christmas Code Break – Next Tuesday / / No Comments Hello friends. The next, and final (for the year!) Code Break will be Tuesday, December 17th, one week from today. I’ve got some surprises in store and would love to use this last session to answer questions from my audience. If you’ve got a question you would like me (and others – oh wait, that’s part of the surprise!) to answer, leave me a comment below and I’ll try to get to it. I hope to see you there! RSVP here: https://cfe.dev/talkshows/codebreak-12172024/ Raymond Camden… more → Posted in: JavaScript Tagged with: Break, Christmas, code, Next, Tuesday