Building a Document Q&A System with On-Device AI / / No Comments Every now and then I build a demo for a presentation and think to myself – this deserves its own blog post. I then promptly forget to actually do that. Even better, I completely forget to even show the demo in the presentation. A few weeks ago I made my first presentation at RenderATL and gave my talk on Chrome’s on-device AI technology. I’ve been blogging about this particular set of APIs for a few years now and I’ve given talks on it at numerous conferences. While these APIs are still evolving, many of them (and the ones I’m using today in particular) are now fully GA for Chrome. For this demo, I put together a few things I’ve done before into one cohesive... more → Posted in: JavaScript Tagged with: building, Document, OnDevice, system
Summarizing PDFs with On-Device AI / / No Comments You can take the man out of the PDFs, but you can’t take the PDFs out of the man. Ok, I’m not sure that exactly makes sense, but with a couple years in me of working with PDFs, I find myself using them quite often with my AI demos. For today, I’m going to demonstrate something that’s been on my mind in a while – doing summarizing of PDFs completely in the browser, with Chrome’s on-device AI. Unlike the Prompt API, summarization has been released since Chrome 138, so most likely those of you on Chrome can run these demos without problem. (You can see more about the AI API statuses if you’re curious.) Getting PDF Text – Client-Side There’s plenty... more → Posted in: JavaScript Tagged with: OnDevice, PDFs, Summarizing