repos: 467679579
This data as json
| id | node_id | name | full_name | private | owner | html_url | description | fork | created_at | updated_at | pushed_at | homepage | size | stargazers_count | watchers_count | language | has_issues | has_projects | has_downloads | has_wiki | has_pages | forks_count | archived | disabled | open_issues_count | license | topics | forks | open_issues | watchers | default_branch | permissions | temp_clone_token | organization | network_count | subscribers_count | readme | readme_html | allow_forking | visibility | is_template | template_repository | web_commit_signoff_required | has_discussions |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 467679579 | R_kgDOG-A5Ww | shot-scraper | simonw/shot-scraper | 0 | 9599 | https://github.com/simonw/shot-scraper | A command-line utility for taking automated screenshots of websites | 0 | 2022-03-08T21:21:02Z | 2022-11-15T14:38:08Z | 2022-11-16T04:28:52Z | https://shot-scraper.datasette.io | 188 | 775 | 775 | Python | 1 | 1 | 1 | 1 | 0 | 40 | 0 | 0 | 16 | apache-2.0 | ["playwright", "playwright-python", "scraping", "screenshot-utility", "screenshots"] | 40 | 16 | 775 | main | {"admin": false, "maintain": false, "push": false, "triage": false, "pull": false} | 40 | 3 | # shot-scraper [](https://pypi.org/project/shot-scraper/) [](https://github.com/simonw/shot-scraper/releases) [](https://github.com/simonw/shot-scraper/actions?query=workflow%3ATest) [](https://github.com/simonw/shot-scraper/blob/master/LICENSE) A command-line utility for taking automated screenshots of websites For background on this project see [shot-scraper: automated screenshots for documentation, built on Playwright](https://simonwillison.net/2022/Mar/10/shot-scraper/). ## Documentation - [Full documentation for shot-scraper](https://shot-scraper.datasette.io/) - [Tutorial: Automating screenshots for the Datasette documentation using shot-scraper](https://simonwillison.net/2022/Oct/14/automating-screenshots/) - [Release notes](https://github.com/simonw/shot-scraper/releases) ## Get started with GitHub Actions To get started without installing any software, use the [shot-scraper-template](https://github.com/simonw/shot-scraper-template) template to create your own GitHub repository which takes screenshots of a page using `shot-scraper`. See [Instantly create a GitHub repository to take screenshots of a web page](https://simonwillison.net/2022/Mar/14/shot-scraper-template/) for details. ## Quick installation You can install the `shot-scraper` CLI tool using [pip](https://pip.pypa.io/): pip install shot-scraper # Now install the browser it needs: shot-scraper install ## Taking your first screenshot You can take a screenshot of a web page like this: shot-scraper https://datasette.io/ This will create a screenshot in a file called `datasette-io.png`. Many more options are available, see [Taking a screenshot](https://shot-scraper.datasette.io/en/stable/screenshots.html) for details. ## Examples - The [shot-scraper-demo](https://github.com/simonw/shot-scraper-demo) repository uses this tool to capture recently spotted owls in El Granada, CA according to [this page](https://www.owlsnearme.com/?place=127871), and to generate an annotated screenshot illustrating a Datasette feature as described [in my blog](https://simonwillison.net/2022/Mar/10/shot-scraper/#a-complex-example). - The [Datasette Documentation](https://docs.datasette.io/en/latest/) uses screenshots taken by `shot-scraper` running in the [simonw/datasette-screenshots](https://github.com/simonw/datasette-screenshots) GitHub repository, described in detail in [Automating screenshots for the Datasette documentation using shot-scraper](https://simonwillison.net/2022/Oct/14/automating-screenshots/). - Ben Welsh built [@newshomepages](https://twitter.com/newshomepages), a Twitter bot that uses `shot-scraper` and GitHub Actions to take screenshots of news website homepages and publish them to Twitter. The code for that lives in [palewire/news-homepages](https://github.com/palewire/news-homepages). - [scrape-hacker-news-by-domain](https://github.com/simonw/scrape-hacker-news-by-domain) uses `shot-scraper javascript` to scrape a web page. See [Scraping web pages from the command-line with shot-scraper](https://simonwillison.net/2022/Mar/14/scraping-web-pages-shot-scraper/) for details of how this works. | <div id="readme" class="md" data-path="README.md"><article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-shot-scraper" class="anchor" aria-hidden="true" href="#user-content-shot-scraper"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>shot-scraper</h1> <p dir="auto"><a href="https://pypi.org/project/shot-scraper/" rel="nofollow"><img src="https://camo.githubusercontent.com/286ea85d2fe4edc6a9b1fdb4649d30bdf8021bb7251f1952f5ac780efe108494/68747470733a2f2f696d672e736869656c64732e696f2f707970692f762f73686f742d736372617065722e737667" alt="PyPI" data-canonical-src="https://img.shields.io/pypi/v/shot-scraper.svg" style="max-width: 100%;"></a> <a href="https://github.com/simonw/shot-scraper/releases"><img src="https://camo.githubusercontent.com/efbd5167cbe1861a03ee215da1ed60e73452db7584ea177e1334c63c7b35897d/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f762f72656c656173652f73696d6f6e772f73686f742d736372617065723f696e636c7564655f70726572656c6561736573266c6162656c3d6368616e67656c6f67" alt="Changelog" data-canonical-src="https://img.shields.io/github/v/release/simonw/shot-scraper?include_prereleases&label=changelog" style="max-width: 100%;"></a> <a href="https://github.com/simonw/shot-scraper/actions?query=workflow%3ATest"><img src="https://github.com/simonw/shot-scraper/workflows/Test/badge.svg" alt="Tests" style="max-width: 100%;"></a> <a href="https://github.com/simonw/shot-scraper/blob/master/LICENSE"><img src="https://camo.githubusercontent.com/1698104e976c681143eb0841f9675c6f802bb7aa832afc0c7a4e719b1f3cf955/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f6c6963656e73652d417061636865253230322e302d626c75652e737667" alt="License" data-canonical-src="https://img.shields.io/badge/license-Apache%202.0-blue.svg" style="max-width: 100%;"></a></p> <p dir="auto">A command-line utility for taking automated screenshots of websites</p> <p dir="auto">For background on this project see <a href="https://simonwillison.net/2022/Mar/10/shot-scraper/" rel="nofollow">shot-scraper: automated screenshots for documentation, built on Playwright</a>.</p> <h2 dir="auto"><a id="user-content-documentation" class="anchor" aria-hidden="true" href="#user-content-documentation"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>Documentation</h2> <ul dir="auto"> <li><a href="https://shot-scraper.datasette.io/" rel="nofollow">Full documentation for shot-scraper</a></li> <li><a href="https://simonwillison.net/2022/Oct/14/automating-screenshots/" rel="nofollow">Tutorial: Automating screenshots for the Datasette documentation using shot-scraper</a></li> <li><a href="https://github.com/simonw/shot-scraper/releases">Release notes</a></li> </ul> <h2 dir="auto"><a id="user-content-get-started-with-github-actions" class="anchor" aria-hidden="true" href="#user-content-get-started-with-github-actions"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>Get started with GitHub Actions</h2> <p dir="auto">To get started without installing any software, use the <a href="https://github.com/simonw/shot-scraper-template">shot-scraper-template</a> template to create your own GitHub repository which takes screenshots of a page using <code>shot-scraper</code>. See <a href="https://simonwillison.net/2022/Mar/14/shot-scraper-template/" rel="nofollow">Instantly create a GitHub repository to take screenshots of a web page</a> for details.</p> <h2 dir="auto"><a id="user-content-quick-installation" class="anchor" aria-hidden="true" href="#user-content-quick-installation"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>Quick installation</h2> <p dir="auto">You can install the <code>shot-scraper</code> CLI tool using <a href="https://pip.pypa.io/" rel="nofollow">pip</a>:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="pip install shot-scraper # Now install the browser it needs: shot-scraper install"><pre class="notranslate"><code>pip install shot-scraper # Now install the browser it needs: shot-scraper install </code></pre></div> <h2 dir="auto"><a id="user-content-taking-your-first-screenshot" class="anchor" aria-hidden="true" href="#user-content-taking-your-first-screenshot"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>Taking your first screenshot</h2> <p dir="auto">You can take a screenshot of a web page like this:</p> <div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="shot-scraper https://datasette.io/"><pre class="notranslate"><code>shot-scraper https://datasette.io/ </code></pre></div> <p dir="auto">This will create a screenshot in a file called <code>datasette-io.png</code>.</p> <p dir="auto">Many more options are available, see <a href="https://shot-scraper.datasette.io/en/stable/screenshots.html" rel="nofollow">Taking a screenshot</a> for details.</p> <h2 dir="auto"><a id="user-content-examples" class="anchor" aria-hidden="true" href="#user-content-examples"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>Examples</h2> <ul dir="auto"> <li>The <a href="https://github.com/simonw/shot-scraper-demo">shot-scraper-demo</a> repository uses this tool to capture recently spotted owls in El Granada, CA according to <a href="https://www.owlsnearme.com/?place=127871" rel="nofollow">this page</a>, and to generate an annotated screenshot illustrating a Datasette feature as described <a href="https://simonwillison.net/2022/Mar/10/shot-scraper/#a-complex-example" rel="nofollow">in my blog</a>.</li> <li>The <a href="https://docs.datasette.io/en/latest/" rel="nofollow">Datasette Documentation</a> uses screenshots taken by <code>shot-scraper</code> running in the <a href="https://github.com/simonw/datasette-screenshots">simonw/datasette-screenshots</a> GitHub repository, described in detail in <a href="https://simonwillison.net/2022/Oct/14/automating-screenshots/" rel="nofollow">Automating screenshots for the Datasette documentation using shot-scraper</a>.</li> <li>Ben Welsh built <a href="https://twitter.com/newshomepages" rel="nofollow">@newshomepages</a>, a Twitter bot that uses <code>shot-scraper</code> and GitHub Actions to take screenshots of news website homepages and publish them to Twitter. The code for that lives in <a href="https://github.com/palewire/news-homepages">palewire/news-homepages</a>.</li> <li><a href="https://github.com/simonw/scrape-hacker-news-by-domain">scrape-hacker-news-by-domain</a> uses <code>shot-scraper javascript</code> to scrape a web page. See <a href="https://simonwillison.net/2022/Mar/14/scraping-web-pages-shot-scraper/" rel="nofollow">Scraping web pages from the command-line with shot-scraper</a> for details of how this works.</li> </ul> </article></div> | 1 | public | 0 | 0 | 0 |
Links from other tables
- 24 rows from repo in releases