sobre.arquivo.pt > Articles by: admin

admin

Ipres’2013: Five new communications about the Portuguese Web Archive

by

Last updated on December 20th, 2019 at 05:22 pm

The Portuguese Web Archive activities were presented during Ipres’2013, a scientific conference on the preservation of digital objects, that took place in Lisbon from 2 to 6 September.

The following communications about the Portuguese Web Archive were made during Ipres’2013:

See all the details on our Publications page.

System administrator for the Portugese Web Archive

by

Last updated on September 28th, 2017 at 01:12 pm

The Portuguese Web Archive (www.archive.pt) is looking for an administrator for its large-scale distributed system.

The system administrator we are looking to strengthen our team will be in charge of operating and maintaining the quality of the results provided by a web archive system composed by more than 60 servers.

Requirements

  • Higher education on Computer Engineering.
  • Experience on design, operation and administration of large-scale distributed systems exposed on the Internet.
  • Technical knowledge on Apache HTTP Server, Apache Tomcat, Java and Linux.
  • Experience on technologies to monitor and manage distributed systems (e.g. Nagios, Cacti, Ganglia, Rex, Puppet, Chef, SpaceWalk, Jenkins).

Experience preferences

  • Distributed processing (e.g. Hadoop, HBase).
  • Web informationm search (e.g. Apache Solr, Lucene);
  • Web archiving tehcnologies (e.g. Heritrix, Wayback Machine, NutchWAX);
  • Software management platforms (ex. Selenium, SonarCube, Ant, Maven, Git, SVN).
  • Load balacing and fault tolerance tools (e.g. LVS).

We appreciate your help disseminating this offer.

It’s now easier to download the PWA software.

by

Last updated on August 5th, 2024 at 11:30 am

All the source-code, binary and documentation files can now be downloaded through a set of large compressed files.

The software developed to create the Portuguese Web Archive is available as a free open-source project hosted at Google Code under the name pwa-technologies.

The files below contain a dump of the PWA-technologies software and were created to facilitate the distribution and preservation of the developed software. Please feel free to join us to contribute to improve this software:

We hope this project can be useful to enable access to our digital memory.

The Portuguese Web Archive joined the International Internet Preservation Consortium

by

Last updated on August 5th, 2024 at 11:16 am

The Foundation for the National Scientific Computing, home of the Portuguese Web Archive, joined IIPC.

The International Internet Preservation Consortium (IIPC) is a worldwide consortium that joins 44 organizations from 25 countries.

The IIPC is dedicated to improving the tools, standards and best practices of web archiving while promoting international collaboration and the broad access and use of web archives for research and cultural heritage.

The Portuguese Web Archive is an innovative service based on cutting-edge technology that requires permanent investments on Research and Development activities.

Joining IIPC is a crucial milestone to establish international partnerships to enable the collaborative development of the tools used by the Portuguese Web Archive and improve the quality of the provided service.

 

Related links:

How to create a billion-scale searchable web archive

by

Last updated on September 28th, 2017 at 01:26 pm

The Portuguese Web Archive published a study that contributes with an overview of the lessons learned while developing the Portuguese Web Archive, focusing on web data acquisition, ranking search results and user interface design.

Several organizations around the world are struggling to archive information from the web before it vanishes. However, users demand efficient and effective search mechanisms to access the already vast collections of historical information held by web archives. The Portuguese Web Archive is the largest full-text searchable web archive publicly available. It supports search over 1.2 billion files archived from the web since 1996.

The paper Creating a Billion-Scale Searchable Web Archive was presented on the Temporal Web Analytics Workshop 2013, in Rio de Janeiro, Brazil.

WWW 2013: Search the Past with the Portuguese Web Archive

by

Last updated on August 4th, 2024 at 06:10 pm

The Portuguese Web Archive (PWA) is at the World Wide Web Conference (WWW 2013) in Rio de Janeiro, Brazil, with a demo session.

The demo at WWW 2013 presents the Portuguese Web Archive, which enables search over 1.6 billion files archived from 1996 to 2012.

New video: “The Portuguese Web Archive: An overview”

by

Last updated on December 20th, 2019 at 05:26 pm

The Portuguese Web Archive preserves and provides access to information published on the web of main interest to the Portuguese community. It provides a free and publicly available full-text search service over 1 billion web archived since 1996.

This video provides an overview of the services provided by the Portuguese Web Archive:

New video: “The Portuguese Web Archive and the open access to scientific knowledge”

by

Last updated on August 4th, 2024 at 06:11 pm

Web archiving contributes to empower open-access to science.

There is a growing amount of open access scientific knowledge published on the Web.

This video debates the importance of web archiving to empower open access to science.