Paper will be presented at LA-Web on November 11

Last updated on October 2nd, 2017 at 10:50 am

The paper Trends in Web characteristics will be presented at LA-Web 2009, on November 11, 2009.

The paper Trends in Web Characteristics, by João Miranda and Daniel Gomes, will be presented at the 7th Latin American Web Congress (LA-Web), in Merida, Mexico.

This paper presents trends in the evolution of the Web derived from the analysis of 3 characterizations performed within an interval of 5 years. The Web portion used as a case study was the Portuguese Web. Several metrics regarding site and content characteristics were analyzed.

Ipres’2013: Five new communications about the Portuguese Web Archive

Last updated on December 20th, 2019 at 05:22 pm

The Portuguese Web Archive activities were presented during Ipres’2013, a scientific conference on the preservation of digital objects, that took place in Lisbon from 2 to 6 September.

System administrator for the Portugese Web Archive

Last updated on September 28th, 2017 at 01:12 pm

The Portuguese Web Archive (www.archive.pt) is looking for an administrator for its large-scale distributed system.

The system administrator we are looking to strengthen our team will be in charge of operating and maintaining the quality of the results provided by a web archive system composed by more than 60 servers.

Requirements

  • Higher education on Computer Engineering.
  • Experience on design, operation and administration of large-scale distributed systems exposed on the Internet.
  • Technical knowledge on Apache HTTP Server, Apache Tomcat, Java and Linux.
  • Experience on technologies to monitor and manage distributed systems (e.g. Nagios, Cacti, Ganglia, Rex, Puppet, Chef, SpaceWalk, Jenkins).

Experience preferences

  • Distributed processing (e.g. Hadoop, HBase).
  • Web informationm search (e.g. Apache Solr, Lucene);
  • Web archiving tehcnologies (e.g. Heritrix, Wayback Machine, NutchWAX);
  • Software management platforms (ex. Selenium, SonarCube, Ant, Maven, Git, SVN).
  • Load balacing and fault tolerance tools (e.g. LVS).

We appreciate your help disseminating this offer.

It’s now easier to download the PWA software.

Last updated on September 28th, 2017 at 01:16 pm

All the source-code, binary and documentation files can now be downloaded through a set of large compressed files.

The software developed to create the Portuguese Web Archive is available as a free open-source project hosted at Google Code under the name pwa-technologies.

The files below contain a dump of the PWA-technologies software and were created to facilitate the distribution and preservation of the developed software. Please feel free to join us to contribute to improve this software:

We hope this project can be useful to enable access to our digital memory.

The Portuguese Web Archive joined the International Internet Preservation Consortium

Last updated on September 28th, 2017 at 01:12 pm

The Foundation for the National Scientific Computing, home of the Portuguese Web Archive, joined IIPC.

The International Internet Preservation Consortium (IIPC) is a worldwide consortium that joins 44 organizations from 25 countries.

The IIPC is dedicated to improving the tools, standards and best practices of web archiving while promoting international collaboration and the broad access and use of web archives for research and cultural heritage.

The Portuguese Web Archive is an innovative service based on cutting-edge technology that requires permanent investments on Research and Development activities.

Joining IIPC is a crucial milestone to establish international partnerships to enable the collaborative development of the tools used by the Portuguese Web Archive and improve the quality of the provided service.

 

Related links:

How to create a billion-scale searchable web archive

Last updated on September 28th, 2017 at 01:26 pm

The Portuguese Web Archive published a study that contributes with an overview of the lessons learned while developing the Portuguese Web Archive, focusing on web data acquisition, ranking search results and user interface design.

Several organizations around the world are struggling to archive information from the web before it vanishes. However, users demand efficient and effective search mechanisms to access the already vast collections of historical information held by web archives. The Portuguese Web Archive is the largest full-text searchable web archive publicly available. It supports search over 1.2 billion files archived from the web since 1996.

The paper Creating a Billion-Scale Searchable Web Archive was presented on the Temporal Web Analytics Workshop 2013, in Rio de Janeiro, Brazil.

New video: “The Portuguese Web Archive: An overview”

Last updated on December 20th, 2019 at 05:26 pm

The Portuguese Web Archive preserves and provides access to information published on the web of main interest to the Portuguese community. It provides a free and publicly available full-text search service over 1 billion web archived since 1996.

This video provides an overview of the services provided by the Portuguese Web Archive: