The Human Rights Web Archive (HRWA) is a collection of freely available websites featuring substantive resources related to human rights, mainly by and about non-governmental organizations dedicated to human rights issues. The HRWA is an initiative of Columbia University Libraries and Information Services and its Center for Human Rights Documentation and Research.  Our goal is to build an ongoing mechanism for preserving web-based human rights information, adaptable to a variety of fields and subjects.  The development of this program is supported by a grant from the Andrew W. Mellon Foundation.

Subject specialists at Columbia University Libraries with regional and language expertise select websites for inclusion in the archive.  We also invite suggestions from researchers, students, scholars and human rights advocates.  Criteria for selection include relevance of the site to current research, teaching, and advocacy, perceived risk of a site disappearing, and likelihood that a site will not be archived or preserved by other means.  Organizations whose paper archives are held at Columbia will be another priority for web archiving.

Subject specialists at Columbia University Libraries with regional and language expertise select websites for inclusion in the archive.  We also invite suggestions from researchers, students, scholars and human rights advocates.  Criteria for selection include relevance of the site to current research, teaching, and advocacy, perceived risk of a site disappearing, and likelihood that a site will not be archived or preserved by other means.  Organizations whose paper archives are held at Columbia will be another priority for web archiving.

Yes, we welcome your suggestions.  Please use this form to nominate a website for inclusion in the archive.  We are especially interested in hearing from human rights organizations that want to nominate their own sites.  Site owners should use this form.

We follow principles and techniques of non-intrusive harvesting.  We attempt to notify all organizations and/or site owners of our interest in archiving their sites.  We will refrain from harvesting sites whose owners do not wish to participate in this project. Some sites may contain material that is produced by other parties who may claim copyright ownership of such materials.  The HRWA reserves the right to remove any material that in our reasonable opinion may violate copyright or other intellectual property rights.  Third-party copyright holders who believe their rights have been infringed by inclusion of their content in our archive may contact us at culhrweb@libraries.cul.columbia.edu.

We use the open source web crawler, "Heritrix," to create archival quality copies of the websites.  Currently we are managing Heritrix through the Internet Archive's "Archive-It" service.  All data created using the Archive-It service is hosted and stored by the Internet Archive.  Eventually we will also store the data in Columbia University Libraries' digital repository.

No, site owners do not have to change the content, structure, or appearance of their websites to be included in the crawls.

We crawl websites at a polite rate so as not to interfere with access to your website.  Crawls will generally be run quarterly or semi-annually for actively updated sites, and last for a few days.  Once a crawl is complete, the crawler no longer interacts with your server.  If you encounter any issues or have any additional questions, please contact us at culhrweb-tech@libraries.cul.columbia.edu.

Yes, as long as there are links to the raw content.  We cannot capture content that is retrieved through a database query.  For example, we cannot capture files retrieved from a database after a user enters a search query.

Archived sites will be publicly available.  Initially you can view sites by date of capture in our Internet Archive Human Rights Web Archive collection.  Additional means of viewing archived sites will be explored by program  staff.

There are several reasons why a site may appear to be incomplete.  First, parts of the site may be excluded from crawls by robots.txt.  We respect all robots.txt exclusions.  Second, some types of content are very challenging and sometimes impossible to archive from a technical standpoint.  Some examples include Javascript, streaming media, and form/database driven content.  Finally, portions of a website may be restricted, or password protected.  We will only collect public content, so password protected material will not be crawled.

We will honor requests to remove archived content.  Please contact culhrweb-tech@libraries.cul.columbia.edu.

• Visit the HRWA page and the Web Resources Collection Program site.
• Contact culhrweb@libraries.cul.columbia.edu for more information.