releases
24 rows where repo = 467679579
This data as json, CSV (advanced)
Suggested facets: prerelease, created_at (date), published_at (date)
| id ▼ | html_url | author | node_id | tag_name | target_commitish | name | draft | prerelease | created_at | published_at | body | repo | reactions | mentions_count |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 61324768 | https://github.com/simonw/shot-scraper/releases/tag/0.1a0 | simonw 9599 | RE_kwDOG-A5W84Dp73g | 0.1a0 | main | 0.1a0 | 0 | 1 | 2022-03-08T23:08:45Z | 2022-03-08T23:10:08Z | - Initial prototype. [#1](https://github.com/simonw/shot-scraper/issues/1) | shot-scraper 467679579 | ||
| 61415269 | https://github.com/simonw/shot-scraper/releases/tag/0.1 | simonw 9599 | RE_kwDOG-A5W84DqR9l | 0.1 | main | 0.1 | 0 | 0 | 2022-03-09T19:13:44Z | 2022-03-09T19:16:43Z | - Switched from npm Playwright to [Python Playwright](https://pypi.org/project/playwright/). [#3](https://github.com/simonw/shot-scraper/issues/3) - New `shot-scraper install` command for installing the browser needed by Playwright. [#6](https://github.com/simonw/shot-scraper/issues/6) - New `shot-scraper shot URL` command (also the default if you just run `shot-scraper ...`) which takes a single screenshot. [#5](https://github.com/simonw/shot-scraper/issues/5) - `shot-scraper multi shots.yml` command now executes the YAML file with a list of shots in it. | shot-scraper 467679579 | ||
| 61425659 | https://github.com/simonw/shot-scraper/releases/tag/0.2 | simonw 9599 | RE_kwDOG-A5W84DqUf7 | 0.2 | main | 0.2 | 0 | 0 | 2022-03-09T21:05:31Z | 2022-03-09T21:05:41Z | - `shot-scraper --selector SELECTOR` option to specify an element on the page using a CSS selector and take a screenshot of just that element. [#8](https://github.com/simonw/shot-scraper/issues/8) - `selector: ...` key in YAML file to specify an element by CSS selector. - `--javascript SCRIPT` option to specify custom JavaScript to be executed after the page has loaded but before the screenshot is taken. [#12](https://github.com/simonw/shot-scraper/issues/12) - `javascript:` key in YAML to specify JavaScript to execute. - `--width` and `--height` options to set the width and height of the browser window used for the screenshot. If a height is specified, the resulting screenshot will be that height rather than being the full height of the page. [#13](https://github.com/simonw/shot-scraper/issues/13) - Equivalent `width:` and `height:` keys in the YAML configuration. | shot-scraper 467679579 | ||
| 61440067 | https://github.com/simonw/shot-scraper/releases/tag/0.3 | simonw 9599 | RE_kwDOG-A5W84DqYBD | 0.3 | main | 0.3 | 0 | 0 | 2022-03-09T22:22:57Z | 2022-03-09T22:24:53Z | - Added a live demo, in the [shot-scraper-demo](https://github.com/simonw/shot-scraper-demo) repository. [#14](https://github.com/simonw/shot-scraper/issuse/14) - New `--quality 80` option for outputting smaller JPEG images with the specified quality. [#15](https://github.com/simonw/shot-scraper/issuse/15) - New `--wait 2000` option for waiting the specified number of milliseconds before taking the screenshot. [#16](https://github.com/simonw/shot-scraper/issuse/16) | shot-scraper 467679579 | ||
| 61546223 | https://github.com/simonw/shot-scraper/releases/tag/0.4 | simonw 9599 | RE_kwDOG-A5W84Dqx7v | 0.4 | main | 0.4 | 0 | 0 | 2022-03-10T22:33:48Z | 2022-03-10T22:33:51Z | - Added `shot-scraper accessibility URL` command, which dumps out a JSON copy of the Chromium accessibility tree for the page. [#22](https://github.com/simonw/shot-scraper/issues/22) - Fixed error in the `--help` output for the `shot-scraper multi` command. | shot-scraper 467679579 | ||
| 61681162 | https://github.com/simonw/shot-scraper/releases/tag/0.5 | simonw 9599 | RE_kwDOG-A5W84DrS4K | 0.5 | main | 0.5 | 0 | 0 | 2022-03-12T19:10:11Z | 2022-03-12T19:17:00Z | - New `shot-scraper pdf` command for creating a PDF export of a web page. [#24](https://github.com/simonw/shot-scraper/issues/24) - `shot-scraper accessibility --javascript` option for executing custom JavaScript before taking the accessibility snapshot. [#23](https://github.com/simonw/shot-scraper/issues/23) - `shot-scraper accessibility -o filename.json` option. [#25](https://github.com/simonw/shot-scraper/issues/25) - README demos section now links to `@newshomepages` Twitter bot by [@palewire](https://github.com/palewire) - README now includes tips on executing JavaScript. [#20](https://github.com/simonw/shot-scraper/issues/20) - README now includes the `--help` output of the various commands. | shot-scraper 467679579 | ||
| 61684671 | https://github.com/simonw/shot-scraper/releases/tag/0.6 | simonw 9599 | RE_kwDOG-A5W84DrTu_ | 0.6 | main | 0.6 | 0 | 0 | 2022-03-12T21:29:07Z | 2022-03-12T21:30:32Z | - Now supports taking screenshots of **pages that require authentication**. [#18](https://github.com/simonw/shot-scraper/issues/18) The following command will open a browser window for the specified website, wait for you to manually authenticate and hit `<enter>` in the terminal, and then write the resulting authentication context out to `auth.json`: shot-scraper auth https://github.com/ auth.json` You can then take authenticated screenshots like this: shot-scraper https://github.com/notifications \ --auth auth.json -o notifications.png The `-a/--auth` option is also supported by the `multi`, `pdf` and `accessibility` commands. - The `shot-scraper` command can now open a browser in which you can **interact with a page** before the screenshot is taken: [#31](https://github.com/simonw/shot-scraper/issues/31) shot-scraper https://simonwillison.net/ \ -o after-interaction.png \ --height 800 --interactive This will output: Hit <enter> to take the shot and close the browser window: # And after you hit <enter>... Screenshot of 'https://simonwillison.net/' written to 'after-interaction.png' - You can now pass **multiple CSS selectors** in order to take a screenshot of the smallest area that encompasses all of the content referenced by those selectors: [#21](https://github.com/simonw/shot-scraper/issues/21) shot-scraper https://simonwillison.net/ \ -s '#bighead' -s .overband \ -o bighead-multi-selector.png Add `--padding 20` to include an additional 20px of padding around the specified area. The YAML format used by `snap-shotter multi` also now supports multiple CSS selectors, which look like this: ```yaml - output: bighead-multi-selector.png url: https://simonwillison.net/ selectors: - "#bighead" - .overband padding: 20 ``` - Scripted tests can now be run using `tests/run_examples.sh` [#29](https://github.com/simonw/shot-scraper/issues/29) | shot-scraper 467679579 | ||
| 61694703 | https://github.com/simonw/shot-scraper/releases/tag/0.7 | simonw 9599 | RE_kwDOG-A5W84DrWLv | 0.7 | main | 0.7 | 0 | 0 | 2022-03-13T04:46:58Z | 2022-03-13T04:49:36Z | - The `shot-scraper shot` and `shot-scraper pdf` commands both now default to writing a file to disk if no filename is specified, using a name derived from the URL. If you want to write the PNG or PDF content to standard output you can do so using `-o -`. [#32](https://github.com/simonw/shot-scraper/issues/32) - New `--retina` flag for `shot-scraper shot` and `shot-scraper multi` which causes the screenshot to be taken with a device scale factor of 2. [#33](https://github.com/simonw/shot-scraper/issues/33) - `shot-scraper shot --devtools` option opens an interactive browser window with the browser developer tools enabled. [#34](https://github.com/simonw/shot-scraper/issues/34) | shot-scraper 467679579 | ||
| 61708615 | https://github.com/simonw/shot-scraper/releases/tag/0.8 | simonw 9599 | RE_kwDOG-A5W84DrZlH | 0.8 | main | 0.8 | 0 | 0 | 2022-03-13T17:02:55Z | 2022-03-13T17:05:21Z | - `shot-scraper` can now take screenshots of local files on disk: [#35](https://github.com/simonw/shot-scraper/issues/35) shot-scraper index.html -o index.png - If you call `shot-scraper` on a URL with no protocol, `http://` will be assumed. Redirects will be followed: shot-scraper datasette.io -o datasette.png | shot-scraper 467679579 | ||
| 61716825 | https://github.com/simonw/shot-scraper/releases/tag/0.9 | simonw 9599 | RE_kwDOG-A5W84DrblZ | 0.9 | main | 0.9 | 0 | 0 | 2022-03-13T23:59:19Z | 2022-03-14T00:05:56Z | - New [shot-scraper javascript](https://github.com/simonw/shot-scraper/blob/0.9/README.md#scraping-pages-using-javascript) command for executing JavaScript against a web page and returning the result to the console as JSON: [#38](https://github.com/simonw/shot-scraper/issues/38) % shot-scraper javascript datasette.io document.title "Datasette: An open source multi-tool for exploring and publishing data" This can be used for web scraping and data extraction. Any JavaScript errors will cause the command to return an exit code of 1, so this can also be used to run tests against a website from within a continuous integration environment such as GitHub Actions. - The `shot-scraper pdf` and `shot-scraper accessibility` commands can both now be used with local files in addition to URLs. [#37](https://github.com/simonw/shot-scraper/issues/37) - The `output:` key is no longer required in YAML shot configuration: if omitted, an automatic filename will be used instead. [#40](https://github.com/simonw/shot-scraper/issues/40) - An empty YAML file no longer produces an error. [#41](https://github.com/simonw/shot-scraper/issues/41) | shot-scraper 467679579 | ||
| 62981983 | https://github.com/simonw/shot-scraper/releases/tag/0.10 | simonw 9599 | RE_kwDOG-A5W84DwQdf | 0.10 | main | 0.10 | 0 | 0 | 2022-03-29T00:25:29Z | 2022-03-29T00:25:33Z | - New `-b/--browser` option for the `shot-scraper install`, `shot`, `multi` and `javascript` commands. This can be used to install and run alternative browsers `firefox`, `chrome` or `chrome-beta`. Thanks, [Ben Welsh](https://github.com/palewire). [#53](https://github.com/simonw/shot-scraper/issues/53) - New `--timeout` option for `shot-scraper shot` and `shot-scraper multi`. Thanks, [Ben Welsh](https://github.com/palewire). [#47](https://github.com/simonw/shot-scraper/pull/47) - `shot-scraper multi` now continues to create other shots despite a timeout error, unless `--fail-on-error` is passed. Thanks, [Ryan Cheley](https://github.com/ryancheley). [#50](https://github.com/simonw/shot-scraper/issues/50) - README now describes the `async () => { ... }` pattern for `shot-scraper javascript`, as discussed in [Extracting web page content using Readability.js and shot-scraper](https://til.simonwillison.net/shot-scraper/readability). - New demo: [shot-scraper-template](https://github.com/simonw/shot-scraper-template), which lets you setup shot-scraper running in a GitHub repository in a single click. [See also Instantly create a GitHub repository to take screenshots of a web page](https://simonwillison.net/2022/Mar/14/shot-scraper-template/). - New scraping demo: [scrape-hacker-news-by-domain](https://github.com/simonw/scrape-hacker-news-by-domain) uses `shot-scraper javascript` to scrape a web page. See [Scraping web pages from the command-line with shot-scraper](https://simonwillison.net/2022/Mar/14/scraping-web-pages-shot-scraper/). | shot-scraper 467679579 | ||
| 64003666 | https://github.com/simonw/shot-scraper/releases/tag/0.11 | simonw 9599 | RE_kwDOG-A5W84D0J5S | 0.11 | main | 0.11 | 0 | 0 | 2022-04-08T20:02:26Z | 2022-04-08T20:06:57Z | - New `shot-scraper accessibility --timeout` option, thanks [Ben Welsh](https://github.com/palewire). [#59](https://github.com/simonw/shot-scraper/pull/59) - `shot-scraper auth --browser` option for authentication using a browser other than Chromium. [#61](https://github.com/simonw/shot-scraper/issues/61) - Using `--quality` now results in a JPEG file with the correct `.jpg` extension. Thanks, [Ian Wootten](https://github.com/iwootten). [#58](https://github.com/simonw/shot-scraper/pull/58) - New `--reduced-motion` flag for emulating the "prefers-reduced-motion" media feature. Thanks, [Ryan Murphy](https://github.com/rdmurphy). [#49](https://github.com/simonw/shot-scraper/issues/49) | shot-scraper 467679579 | {"url": "https://api.github.com/repos/simonw/shot-scraper/releases/64003666/reactions", "total_count": 5, "+1": 0, "-1": 0, "laugh": 0, "hooray": 0, "confused": 0, "heart": 2, "rocket": 1, "eyes": 2} | |
| 64151500 | https://github.com/simonw/shot-scraper/releases/tag/0.12 | simonw 9599 | RE_kwDOG-A5W84D0t_M | 0.12 | main | 0.12 | 0 | 0 | 2022-04-11T19:32:44Z | 2022-04-11T19:32:50Z | - `--selector-all` option to take a screenshot that encompasses every element matching the specified CSS selector - complements `--selector` which takes a screenshot of just the first element matching that selector. See [Specifying elements using JavaScript filters](https://github.com/simonw/shot-scraper/blob/0.12/README.md#specifying-elements-using-javascript-filters). [#64](https://github.com/simonw/shot-scraper/issues/64) - `selector_all:` and `selectors_all:` keys in the `shot-scraper multi` YAML format. - `--js-selector` and `--js-selector-all` options for specifying elements to screenshot using a JavaScript expression, for cases which cannot be handled using CSS selectors [#43](https://github.com/simonw/shot-scraper/issues/43). The following example takes a screenshot of the first paragraph on the page that mentions `shot-scraper`: ``` shot-scraper https://github.com/simonw/shot-scraper \ --js-selector 'el.tagName == "P" && el.innerText.includes("shot-scraper")' ``` - `js_selector:`, `js_selectors:`, `js_selector_all:` and `js_selectors_all:` equivalent keys in the `shot-scraper multi` YAML format. - `--user-agent` option for setting a custom user agent header. [#63](https://github.com/simonw/shot-scraper/issues/63) - `--browser webkit` option for running [WebKit](https://playwright.dev/docs/browsers#webkit) - thanks, [Ryan Murphy](https://github.com/rdmurphy). [#56](https://github.com/simonw/shot-scraper/pull/56) | shot-scraper 467679579 | ||
| 64666269 | https://github.com/simonw/shot-scraper/releases/tag/0.13 | simonw 9599 | RE_kwDOG-A5W84D2rqd | 0.13 | main | 0.13 | 0 | 0 | 2022-04-18T18:21:30Z | 2022-04-18T18:29:46Z | - `shot-scraper auth --devtools` option for opening DevTools when authenticating with a site. [#66](https://github.com/simonw/shot-scraper/issues/66) - `shot-scraper multi -n/--no-clobber` option for skipping screenshots where the output image already exists on disk. [#70](https://github.com/simonw/shot-scraper/issues/70) | shot-scraper 467679579 | ||
| 67334683 | https://github.com/simonw/shot-scraper/releases/tag/0.14 | simonw 9599 | RE_kwDOG-A5W84EA3Ib | 0.14 | main | 0.14 | 0 | 0 | 2022-05-19T23:43:37Z | 2022-05-19T23:45:02Z | - Documentation is now hosted at **[shot-scraper.datasette.io](https://shot-scraper.datasette.io/)** and has been expanded to multiple pages. [#73](https://github.com/simonw/shot-scraper/issues/73) - `shot-scraper $URL --wait-for EXPRESSION` can be used to take the screenshot only once the provided JavaScript expression returns `true`. See [Waiting until a specific condition](https://shot-scraper.datasette.io/en/stable/screenshots.html#waiting-until-a-specific-condition). [#72](https://github.com/simonw/shot-scraper/issues/72) - The `wait_for:` key in the YAML format used by `shot-scraper multi` provides equivalent functionality for scripted multiple screenshots. - New documentation on [Using shot-scraper with GitHub Actions](https://shot-scraper.datasette.io/en/stable/github-actions.html). [#74](https://github.com/simonw/shot-scraper/issues/74) - New example: [Extracting page content with Readability.js](https://shot-scraper.datasette.io/en/stable/javascript.html#example-extracting-page-content-with-readability-js) | shot-scraper 467679579 | ||
| 67488492 | https://github.com/simonw/shot-scraper/releases/tag/0.14.1 | simonw 9599 | RE_kwDOG-A5W84EBcrs | 0.14.1 | main | 0.14.1 | 0 | 0 | 2022-05-22T14:22:50Z | 2022-05-22T14:24:06Z | - Switched [documentation site](https://shot-scraper.datasette.io/) over to the [Furo](https://github.com/pradyunsg/furo) theme. [#77](https://github.com/simonw/shot-scraper/issues/77) | shot-scraper 467679579 | ||
| 73094156 | https://github.com/simonw/shot-scraper/releases/tag/0.14.2 | simonw 9599 | RE_kwDOG-A5W84EW1QM | 0.14.2 | main | 0.14.2 | 0 | 0 | 2022-07-28T18:31:24Z | 2022-07-28T18:32:10Z | - Documentation improvements. [0.14.1...0.14.2](https://github.com/simonw/shot-scraper/compare/0.14.1...0.14.2) | shot-scraper 467679579 | ||
| 73489131 | https://github.com/simonw/shot-scraper/releases/tag/0.14.3 | simonw 9599 | RE_kwDOG-A5W84EYVrr | 0.14.3 | main | 0.14.3 | 0 | 0 | 2022-08-02T23:40:20Z | 2022-08-02T23:41:37Z | - Improved example workflow in [Optimizing PNGs using Oxipng](https://shot-scraper.datasette.io/en/stable/github-actions.html#optimizing-pngs-using-oxipng). - Fixed typos in README and documentation. [#83](https://github.com/simonw/shot-scraper/pull/83) | shot-scraper 467679579 | ||
| 76938431 | https://github.com/simonw/shot-scraper/releases/tag/0.15 | simonw 9599 | RE_kwDOG-A5W84Elfy_ | 0.15 | main | 0.15 | 0 | 0 | 2022-09-12T20:56:20Z | 2022-09-12T20:57:07Z | - New [--log-requests option](https://shot-scraper.datasette.io/en/stable/screenshots.html#logging-all-requests) for logging out newline-delimited JSON showing all requests made while rendering a page, including image and asset loads. [#88](https://github.com/simonw/shot-scraper/issues/88) - New [shot-scraper pdf](https://shot-scraper.datasette.io/en/stable/pdf.html) formatting options: `--format`, `--width`, `--height`, `--scale` and `--print-background`. Thanks, Eddie Chapman. [#87](https://github.com/simonw/shot-scraper/pull/87) - Removed `-h` shortcut for help - use `--help` instead. `-h` was clashing with the shorter version of `--height`. Thanks, Matthew Bafford. [#84](https://github.com/simonw/shot-scraper/pull/84) | shot-scraper 467679579 | ||
| 77030985 | https://github.com/simonw/shot-scraper/releases/tag/0.15.1 | simonw 9599 | RE_kwDOG-A5W84El2ZJ | 0.15.1 | main | 0.15.1 | 0 | 0 | 2022-09-13T17:14:41Z | 2022-09-13T17:15:53Z | - Fix error message shown when `--log-requests` tries to log a request with an unknown response size. [#89](https://github.com/simonw/shot-scraper/issues/89) | shot-scraper 467679579 | ||
| 77229718 | https://github.com/simonw/shot-scraper/releases/tag/0.16 | simonw 9599 | RE_kwDOG-A5W84Emm6W | 0.16 | main | 0.16 | 0 | 0 | 2022-09-15T03:16:51Z | 2022-09-15T03:18:44Z | - Fixed error message displayed when attempting to use `--log-requests` on a page that includes a redirect. [#90](https://github.com/simonw/shot-scraper/issues/90) - `--log-requests` output now includes a `"status": 200` field indicating the HTTP status code returned by that response. | shot-scraper 467679579 | ||
| 79955611 | https://github.com/simonw/shot-scraper/releases/tag/0.17 | simonw 9599 | RE_kwDOG-A5W84ExAab | 0.17 | main | 0.17 | 0 | 0 | 2022-10-14T19:30:50Z | 2022-10-14T19:32:23Z | - New `shot-scraper multi -o` option for specifying a subset of one or more output files to execute that are defined in the YAML. This is useful for testing a larger `shots.yml` file without re-taking every screenshot every time the command is run. [#94](https://github.com/simonw/shot-scraper/issues/94) | shot-scraper 467679579 | ||
| 79997287 | https://github.com/simonw/shot-scraper/releases/tag/1.0 | simonw 9599 | RE_kwDOG-A5W84ExKln | 1.0 | main | 1.0 | 0 | 0 | 2022-10-15T19:45:04Z | 2022-10-15T19:46:37Z | - New `shot-scraper html URL` command ([documented here](https://shot-scraper.datasette.io/en/stable/html.html)) for outputting the final HTML of a page, after JavaScript has been executed. [#96](https://github.com/simonw/shot-scraper/issues/96) - `shot-scraper javascript` has a new `-r/--raw` option for outputting the result of the JavaScript expression as a raw string rather than JSON encoded ([shot-scraper javascript documentation](https://shot-scraper.datasette.io/en/stable/javascript.html)). [#95](https://github.com/simonw/shot-scraper/issues/95) - Tutorial: [Automating screenshots for the Datasette documentation using shot-scraper](https://simonwillison.net/2022/Oct/14/automating-screenshots/). | shot-scraper 467679579 | ||
| 80854553 | https://github.com/simonw/shot-scraper/releases/tag/1.0.1 | simonw 9599 | RE_kwDOG-A5W84E0b4Z | 1.0.1 | main | 1.0.1 | 0 | 0 | 2022-10-24T23:06:56Z | 2022-10-24T23:07:59Z | - [shot-scraper.datasette.io](https://shot-scraper.datasette.io/) homepage now includes an example screenshot. [#97](https://github.com/simonw/shot-scraper/issues/97) | shot-scraper 467679579 |
Advanced export
JSON shape: default, array, newline-delimited, object
CREATE TABLE [releases] (
[html_url] TEXT,
[id] INTEGER PRIMARY KEY,
[author] INTEGER REFERENCES [users]([id]),
[node_id] TEXT,
[tag_name] TEXT,
[target_commitish] TEXT,
[name] TEXT,
[draft] INTEGER,
[prerelease] INTEGER,
[created_at] TEXT,
[published_at] TEXT,
[body] TEXT,
[repo] INTEGER REFERENCES [repos]([id])
, [reactions] TEXT, [mentions_count] INTEGER);
CREATE INDEX [idx_releases_repo]
ON [releases] ([repo]);
CREATE INDEX [idx_releases_author]
ON [releases] ([author]);