DOC: Add short DataLad intro as proposed in the handbook #1

Merged
adswa merged 1 commit from README into master 2020-06-05 14:41:17 +00:00

View file

@ -54,40 +54,69 @@ Content
How to obtain the data files How to obtain the data files
---------------------------- ----------------------------
This repository contains metadata and information on the identity of all This repository is a `DataLad <https://www.datalad.org/>`__ dataset. It provides
included files. However, the actual content of the (sometime large) data fine-grained data access down to the level of individual files, and allows for
files is stored elsewhere. To obtain any dataset component, git-annex_ is tracking future updates up to the level of single files. In order to use
required in addition to Git_. this repository for data retrieval, `DataLad <https://www.datalad.org>`_ is
required. It is a free and open source command line tool, available for all
major operating systems, and builds up on Git and `git-annex
<https://git-annex.branchable.com>`__ to allow sharing, synchronizing, and
version controlling collections of large files. You can find information on
how to install DataLad at `handbook.datalad.org/en/latest/intro/installation.html
<http://handbook.datalad.org/en/latest/intro/installation.html>`_.
1. Clone this repository to the desired location. Get the dataset
2. Enter the directory with the local clone and run:: ^^^^^^^^^^^^^^^
git annex init A DataLad dataset can be ``cloned`` by running::
Older versions of git-annex may require you to run the following datalad clone <url>
command immediately afterwards::
git annex enableremote mddatasrc Once a dataset is cloned, it is a light-weight directory on your local machine.
At this point, it contains only small metadata and information on the
identity of the files in the dataset, but not actual *content* of the
(sometimes large) data files.
Now any desired dataset component can be obtained by using the ``git annex get`` Retrieve dataset content
command. To obtain the entire dataset content run:: ^^^^^^^^^^^^^^^^^^^^^^^^
git annex get . After cloning a dataset, you can retrieve file contents by running::
Keep data up-to-date datalad get <path/to/directory/or/file>
--------------------
If updates to this dataset are made in the future, update any local clone by This command will trigger a download of the files, directories, or
running:: subdatasets you have specified.
git pull DataLad datasets can contain other datasets, so called *subdatasets*. If you
clone the top-level dataset, subdatasets do not yet contain metadata and
information on the identity of files, but appear to be empty directories. In
order to retrieve file availability metadata in subdatasets, run::
followed by:: datalad get -n <path/to/subdataset>
git annex get . Afterwards, you can browse the retrieved metadata to find out about
subdataset contents, and retrieve individual files with ``datalad get``. If you
use ``datalad get <path/to/subdataset>``, all contents of the subdataset will
be downloaded at once.
to fetch all new files. Stay up-to-date
^^^^^^^^^^^^^^^
DataLad datasets can be updated. The command ``datalad update`` will *fetch*
updates and store them on a different branch (by default
``remotes/origin/master``). Running::
datalad update --merge
will *pull* available updates and integrate them in one go.
More information
^^^^^^^^^^^^^^^^
More information on DataLad and how to use it can be found in the DataLad Handbook at
`handbook.datalad.org <http://handbook.datalad.org/en/latest/index.html>`_. The
chapter "DataLad datasets" can help you to familiarize yourself with the
concept of a dataset.
.. _Git: http://www.git-scm.com .. _Git: http://www.git-scm.com