My covidsewage bot finally generates useful alt text!
-
@simon ...the absurdity of having to use a computationally expensive visual-to-text language model to extract data, when PowerBI usually offers an option to download the data visualized in a given graphic right there on the UI.
-
@Sevoris I genuinely cannot find that link! Where is it?
-
Simon Willisonreplied to Simon Willison last edited by
@Sevoris at one point I did try to recreate the alt text from raw measurements in CSV data I found via an older version of the dashboard, but I didn’t trust myself to correctly recreate whatever logic they were using for their high/medium/low indicators
-
Simon Willisonreplied to Simon Willison last edited by
Wrote up a few more details about how the alt text generation works on my blog https://simonwillison.net/2024/Aug/25/covidsewage-alt-text/
-
Simon Willisonreplied to Simon Willison last edited by
Scraping data by taking a screenshot of a dashboard and then running it through a vision model is both slightly absurd and potentially quite a robust way of accessing data that's otherwise impossible to extract!
-
Jim Fenton 🇺🇸🇨🇦replied to Simon Willison last edited by
@simon These are useful, thanks, but wish they were described as “Santa Clara County” or “South Bay” rather than SF Bay Area because they aren’t representative of the rest of the Bay Area.
-
Simon Willisonreplied to Jim Fenton 🇺🇸🇨🇦 last edited by
@jimfenton good call, I’ll fix that
-
@simon Depending on the dashboard, #KeyboardMaestro could do the trick.
-
@ahnenfunde would it run in a macOS GitHub Actions workflow?