repos
1 row where "created_at" is on date 2017-11-13, permissions = "{"admin": false, "maintain": false, "push": false, "triage": false, "pull": false}" and topics contains "datasette-tool"
This data as json, CSV (advanced)
Suggested facets: created_at (date), updated_at (date), pushed_at (date), topics (array)
| id ▼ | node_id | name | full_name | private | owner | html_url | description | fork | created_at | updated_at | pushed_at | homepage | size | stargazers_count | watchers_count | language | has_issues | has_projects | has_downloads | has_wiki | has_pages | forks_count | archived | disabled | open_issues_count | license | topics | forks | open_issues | watchers | default_branch | permissions | temp_clone_token | organization | network_count | subscribers_count | readme | readme_html | allow_forking | visibility | is_template | template_repository | web_commit_signoff_required | has_discussions |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 110509816 | MDEwOlJlcG9zaXRvcnkxMTA1MDk4MTY= | csvs-to-sqlite | simonw/csvs-to-sqlite | 0 | simonw 9599 | https://github.com/simonw/csvs-to-sqlite | Convert CSV files into a SQLite database | 0 | 2017-11-13T06:38:21Z | 2021-11-18T16:33:39Z | 2021-11-18T16:35:33Z | 138 | 655 | 655 | Python | 1 | 1 | 1 | 1 | 0 | 50 | 0 | 0 | 34 | Apache License 2.0 apache-2.0 | ["click", "csv", "datasette", "datasette-io", "datasette-tool", "pandas", "python", "sqlite"] | 50 | 34 | 655 | main | {"admin": false, "maintain": false, "push": false, "triage": false, "pull": false} | 50 | 17 | # csvs-to-sqlite [](https://pypi.org/project/csvs-to-sqlite/) [](https://github.com/simonw/csvs-to-sqlite/releases) [](https://github.com/simonw/csvs-to-sqlite/actions?query=workflow%3ATest) [](https://github.com/simonw/csvs-to-sqlite/blob/main/LICENSE) Convert CSV files into a SQLite database. Browse and publish that SQLite database with [Datasette](https://github.com/simonw/datasette). Basic usage: csvs-to-sqlite myfile.csv mydatabase.db This will create a new SQLite database called `mydatabase.db` containing a single table, `myfile`, containing the CSV content. You can provide multiple CSV files: csvs-to-sqlite one.csv two.csv bundle.db The `bundle.db` database will contain two tables, `one` and `two`. This means you can use wildcards: csvs-to-sqlite ~/Downloads/*.csv my-downloads.db If you pass a path to one or more directories, the script will recursively search those directories for CSV files and create tables for each one. csvs-to-sqlite ~/path/to/directory all-my-csvs.db ## Handling TSV (tab-separated values) You can use the `-s` option to specify a different delimiter. If you want to use a tab character you'll need to apply shell escaping like so: csvs-to-sqlite my-file.tsv my-file.db -s $'\t' ## Refactoring columns into separate lookup tables Let's say you have a CSV file that looks like this: county,precinct,office,district,party,candidate,votes Clark,1,President,,REP,John R. Kasich,5 Clark,2,President,,REP,John R. Kasich,0 Clark,3,President,,REP,John R. Kasich,7 ([Real example taken from the Open Elections project](https://github.com/openelections/openelections-data-sd/blob/master/2016/20160607__sd__primary__clark__precinct.csv)) You can n… | <div id="readme" class="md" data-path="README.md"><article class="markdown-body entry-content container-lg" itemprop="text"><h1 dir="auto"><a id="user-content-csvs-to-sqlite" class="anchor" aria-hidden="true" href="#user-content-csvs-to-sqlite"><svg class="octicon octicon-link" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path fill-rule="evenodd" d="M7.775 3.275a.75.75 0 001.06 1.06l1.25-1.25a2 2 0 112.83 2.83l-2.5 2.5a2 2 0 01-2.83 0 .75.75 0 00-1.06 1.06 3.5 3.5 0 004.95 0l2.5-2.5a3.5 3.5 0 00-4.95-4.95l-1.25 1.25zm-4.69 9.64a2 2 0 010-2.83l2.5-2.5a2 2 0 012.83 0 .75.75 0 001.06-1.06 3.5 3.5 0 00-4.95 0l-2.5 2.5a3.5 3.5 0 004.95 4.95l1.25-1.25a.75.75 0 00-1.06-1.06l-1.25 1.25a2 2 0 01-2.83 0z"></path></svg></a>csvs-to-sqlite</h1> <p dir="auto"><a href="https://pypi.org/project/csvs-to-sqlite/" rel="nofollow"><img src="https://camo.githubusercontent.com/4869c8a624ce3dbf120decc95900d98af23c54cf5c87d65f7164e640a5fcda6b/68747470733a2f2f696d672e736869656c64732e696f2f707970692f762f637376732d746f2d73716c6974652e737667" alt="PyPI" data-canonical-src="https://img.shields.io/pypi/v/csvs-to-sqlite.svg" style="max-width: 100%;"></a> <a href="https://github.com/simonw/csvs-to-sqlite/releases"><img src="https://camo.githubusercontent.com/c0cc260f11a725723219d723be3829d23edfc0962d0e8d191fa2bcd6ceaa749f/68747470733a2f2f696d672e736869656c64732e696f2f6769746875622f762f72656c656173652f73696d6f6e772f637376732d746f2d73716c6974653f696e636c7564655f70726572656c6561736573266c6162656c3d6368616e67656c6f67" alt="Changelog" data-canonical-src="https://img.shields.io/github/v/release/simonw/csvs-to-sqlite?include_prereleases&label=changelog" style="max-width: 100%;"></a> <a href="https://github.com/simonw/csvs-to-sqlite/actions?query=workflow%3ATest"><img src="https://github.com/simonw/csvs-to-sqlite/workflows/Test/badge.svg" alt="Tests" style="max-width: 100%;"></a> <a href="https://github.com/simonw/csvs-to-sqlite/blob/main/LICENSE"><img src="https://camo.githubusercontent.com/1698104e976c681143eb0841f9… | 1 | public | 0 |
Advanced export
JSON shape: default, array, newline-delimited, object
CREATE TABLE [repos] (
[id] INTEGER PRIMARY KEY,
[node_id] TEXT,
[name] TEXT,
[full_name] TEXT,
[private] INTEGER,
[owner] INTEGER REFERENCES [users]([id]),
[html_url] TEXT,
[description] TEXT,
[fork] INTEGER,
[created_at] TEXT,
[updated_at] TEXT,
[pushed_at] TEXT,
[homepage] TEXT,
[size] INTEGER,
[stargazers_count] INTEGER,
[watchers_count] INTEGER,
[language] TEXT,
[has_issues] INTEGER,
[has_projects] INTEGER,
[has_downloads] INTEGER,
[has_wiki] INTEGER,
[has_pages] INTEGER,
[forks_count] INTEGER,
[archived] INTEGER,
[disabled] INTEGER,
[open_issues_count] INTEGER,
[license] TEXT,
[topics] TEXT,
[forks] INTEGER,
[open_issues] INTEGER,
[watchers] INTEGER,
[default_branch] TEXT,
[permissions] TEXT,
[temp_clone_token] TEXT,
[organization] INTEGER REFERENCES [users]([id]),
[network_count] INTEGER,
[subscribers_count] INTEGER, [readme] TEXT, [readme_html] TEXT, [allow_forking] INTEGER, [visibility] TEXT, [is_template] INTEGER, [template_repository] TEXT, [web_commit_signoff_required] INTEGER, [has_discussions] INTEGER,
FOREIGN KEY([license]) REFERENCES [licenses]([key])
);
CREATE INDEX [idx_repos_license]
ON [repos] ([license]);
CREATE INDEX [idx_repos_organization]
ON [repos] ([organization]);
CREATE INDEX [idx_repos_owner]
ON [repos] ([owner]);