weekend project that uses the latest Chrome Summarizer API, but also YOLO to process PDF pages and find images, tables, and math formulas.
Readability (Mozilla) is used when you open regular web pages, but PDF.JS (also Mozilla!!) is used to render each page, run YOLO region detection and then generate a clean HTML. Math formulas are rendered as Latex, and tables are rendered into HTML by detecting their structure using Texo/FormulaNet.
Finally, you can read out loud the readable articles/PDFs using another local TTS (I prefer PocketTTS personally, but wanted to try the newly released and tiny Inflect TTS as well, so it's an option).
Let me know if you find this useful.
I should probably publish them to the Chrome and Firefox stores.
this app runs entirely in your browser.
thanks to Codex, it now uses a YOLO detector using ONNX to detect regions in each rendered PDF page image (text, pictures, formulas, tables).
based on this analysis, PDF Reflow then cuts out TEXT regions into tiny little word images and adds back the original text from the PDF (when available) so you can still select and find text in the reflowed HTML render.
Hope you find this useful.
The original version used heuristics, but frankly it was breaking on many more PDF that I'd want to admint.
This new AI-based version that uses a YOLO detector trained specifically on Doc Layout dataset seems to do a very very good job.
Cooking a local AI version of PDF Reflow to show PDFs on mobile and keep all the look and feel (font, formulas, pictures, tables) yet formatted for a smaller screen.
It’s using a local YOLO detector trained specifically on detection pdf page regions.
The old version works and has many users who love it to read scientific papers, but its heuristics based and was in my opinion failing on edge cases that this new AI approach solves.
I created QuickScre because I wanted a no editing way of recording polished screen recordings for Slack etc. Free to try https://www.appblit.com/quickscreen
I grew tired of endless YouTube videos, X articles or web articles.
So this app lets you open any link and you instantly get an AI summary + brief about the content.
(It's free up to 20 articles because there are real costs: I use Gemini to summarize the pages you open)
AI voices run locally on your iPhone/iPad (web extension version coming soon).
I built a voice AI stack and background noise can be really helpful to a restaurant AI for example. Italian background music or cafe background is part of the brand. It’s not meant to make the caller believe this is not a bot but only to make the AI call on brand.
You can call it what ever you like, but to me this is deceptive.
Where is the difference between this and Indian support staff pretending to be in your vicinity by telling you about the local weather? Your version is arguably even worse because it can plausibly fool people more competently.
It doesn't have to be. You can configure your bot to great the user.
E.g. "Aleksandra is not available at the moment, but I'm her AI assistant to help you book a table. How may I help you?"
So you're telling the caller that it is an AI, and yet you can have a pleasant background audio experience.
Yes DO let you handle long lived websocket connections.
I think this is unique to Cloudflare. AWS or Google Cloud don't seem to offer these things (statefulness basically).
Same with TTS: some like Deepgram and ElevenLabs let you stream the LLM text (or chunks per sentence) over their websocket API, making your Voice AI bot really really low latency.
Readability (Mozilla) is used when you open regular web pages, but PDF.JS (also Mozilla!!) is used to render each page, run YOLO region detection and then generate a clean HTML. Math formulas are rendered as Latex, and tables are rendered into HTML by detecting their structure using Texo/FormulaNet.
Finally, you can read out loud the readable articles/PDFs using another local TTS (I prefer PocketTTS personally, but wanted to try the newly released and tiny Inflect TTS as well, so it's an option).
Let me know if you find this useful.
I should probably publish them to the Chrome and Firefox stores.