CDXJ index files are available to support bulk access

Um grupo de investigadores olham para um bastidor de servidores

Last updated on August 22nd, 2024 at 10:48 am

The research and education community has been requesting the bulk download of web-archived data and index files (CDXJ), for instance, to feed AI training models, optimize routing of web archive requests or recover information from selected websites (e.g. news).

Arquivo.pt begun making all its CDXJ index files publicly available in real-time to facilitate the bulk download of web-archived data. Learn how at:

Your feedback with comments or suggestions is most welcome to improve this service!

Please disseminate this information among potentially interested parties.

CitationSaver preserves citations to web resources

Last updated on April 20th, 2023 at 09:37 pm

Documents cite web content by referencing their URLs so that readers can later access them.

In the case of scientific articles, the importance of these citations is even greater to maintain the integrity of research works because they often reference essential information to enable the reproducibility of an experiment or analysis.

For example, links in a scientific article may cite the datasets, software or web news that supported the research, which are not included in the text of the article.

To respond to the need of preserving the integrity of documents, Arquivo.pt launched the CitationSaver.

CitationSaver automatically extracts cited links in a document and preserves their content (e.g. web pages cited in a book) so that they can be retrieved later from Arquivo.pt.

infografia-citationsaver-en

Use CitationSaver to preserve the integrity of your documents

Upload a document and CitationSaver will extract the cited URLs, archive their content and make it available on Arquivo.pt after a short notice. There are 3 methods to upload a document:

  • insert the address (URL) of the PDF or TXT file, if it is published online
  • upload the file in PDF or TXT format
  • paste the text containing the addresses you want to preserve (e.g. References section of an article or Bibliography of a book).

More information

Project “Renascer” brings back old websites

Last updated on April 17th, 2023 at 06:32 pm

Organizations keep domains that referenced websites which are no longer used, to prevent them from being bought or because they were just forgotten.

The aim of project Renascer (Reborn) is to bring back historical websites whose content is no longer available online and whose domain continues to be held by their authors.

“Forgotten” domains can cause cybersecurity problems

In May 2023, the domain hmsportugal.pt of the Harvard Medical School-Portugal project referenced just one default web page hosted on an active server and the domain continued to be owned by its author.

In this situation, the original content of the website was inaccessible despite the fact that the domain continued to be owned by the author of the website.

Furthermore, since the domain was still pointing to an active web server, cybersecurity issues could occur if this server was not being properly maintained.

The domain hmsportugal.pt could be reborn to reference the contents of this website preserved by Arquivo.pt.

How are websites Reborn?

The domain owner only has to redirect it to Arquivo.pt, through the Memorial service.

For example, the mctes.pt domain started to reference back its original contents preserved by Arquivo.pt, thus making this website to be reborn.

Examples of Reborn domains

Project Renascer identified active domains managed by FCCN which were not referencing any content, and gave them a new life turning them to reference its historical contents preserved by Arquivo.pt.

Contact Arquivo.pt to reborn the historical websites of your organization.

See the following examples of Reborn websites:

 

 

 

Free training on digital media – webinars

Last updated on August 2nd, 2024 at 12:10 pm

The Aveiro Media Competence Center (AMCC) is a platform to support and promote the European Union (EU) Local News Media sector in the implementation of digital transition projects. The consortium includes the PCI Creative Science Park of Aveiro Region, the Associação Portuguesa de Imprensa and the University of Aveiro.

Arquivo.pt is a free public service that allows searching and accessing Web pages preserved since the 1990’s, such as viewing an old news or accessing an old version of a website.

The collaboration between the AMCC and Arquivo.pt is materialized in a training program entitled Arquivo.pt: Digital Skills for the Media, developed in four webinars, and in the attribution of the AMCC Honorable Mention to work done on Portuguese centenary newspapers in the Arquivo.pt Award 2023.

Webinar cycle: Arquivo.pt: digital skills for media

The webinar cycle aims to equip trainees with digital skills that enable them to solve problems caused by the disappearance of digital information and gain competitive advantage in the production of unique and exclusive content.

  • Webinar 1: A tool for quickly searching the past
    • Data: Mars 24, 2023 Time: 14h00-15h30 (in Portuguese)
  • Webinar 2: Publishing well for preserving well

    • Data: April 6, 2023, Time: 14h00-15h30 (in Portuguese)
  • Webinar 3: Automated access and processing of preserved Web information through APIs
    • Data: May 4, 2023, Time: 14h00-15h30 (in Portuguese)
    • Slides
    • Video
  • Webinar 4: Web archiving: do-it-yourself!
    • Data: June 1, 2023, Time: 14h00-15h30 (in Portuguese)

Prepare a work for the Arquivo.pt Award 2023!

thumbnail_award2023

Last updated on August 6th, 2024 at 05:16 pm

Until May 4th, Arquivo.pt launches the challenge of creating a work based on historical information preserved from the Web.

In this 6th edition of the Arquivo.pt Award, 15 000 euros will be granted to the three best works (1st place: 10 000 euros).

Works about any subject may be submitted, done individually or in group. The only condition is that Arquivo.pt was the main source of information.

The Público newspaper will grant an Honorable Mention for works based on the web-archived content of Público online.

The Aveiro Media Competence Center (AMCC) will also grant an Honorable Mention to one of the submitted works that focuses on the archives of the online version of century-old newspapers.

All details at: arquivo.pt/award2023

The Arquivo.pt Award promotes the visibility of the applicants and their institutions.

Help us spread the word about the Arquivo.pt Award 2023 among potential candidates!

 

Arquivo.pt was considered the best Digital Service of 2022

thumbnial seal the best digital service

Last updated on August 6th, 2024 at 05:22 pm

Exame Informática, the oldest Portuguese magazine on Information and Communication Technology, distinguished Arquivo.pt with the award for the Best Digital Service of the year 2022.

The prize was delivered during the 16th gala Os Melhores & As Maiores do Portugal Tecnológico, held on November 29th, 2022, in Lisbon.

Daniel Gomes, manager of Arquivo.pt, dedicated the award to the various teams that have worked on Arquivo.pt over the years. In the month in which Arquivo.pt marked 15 years of existence, this distinction is an excellent anniversary gift, he concluded.

He also invited those present to discover the old pages of Exame Informática preserved in Arquivo.pt.

Photos of the event

Selo Os Melhores & As Maiores do Portugal Tecnológico 2022
Prémio Serviço Digital. Os Melhores & As Maiores do Portugal Tecnológico 2022
Prémio Serviço Digital. Os Melhores & As Maiores do Portugal Tecnológico 2022
Prémio Serviço Digital. Os Melhores & As Maiores do Portugal Tecnológico 2022
Selo Os Melhores & As Maiores do Portugal Tecnológico 2022 Prémio Serviço Digital. Os Melhores & As Maiores do Portugal Tecnológico 2022 Prémio Serviço Digital. Os Melhores & As Maiores do Portugal Tecnológico 2022 Prémio Serviço Digital. Os Melhores & As Maiores do Portugal Tecnológico 2022

Videos

Award cerimony

Flash interview

Extract from the programme Exame Informática broadcast by SIC Notícias on 11 December 2022 (was obtained by external screen recording).

15 years of Arquivo.pt celebrated in a event promoted by Wikimedia

thumbnail_15-anos-Arquivopt-Wikimedia

Last updated on August 18th, 2023 at 03:29 pm

On November 8, 2007, the Portuguese Web Archive was officially created and later named Arquivo.pt.

To celebrate this date, Wikimedia Portugal and Arquivo.pt have associated themselves in the organization of an online event dedicated to the preservation of the digital heritage.

Agenda

  • Introdução – André Barbosa, Wikimédia Portugal (Video)
  • 15 anos de Arquivo.pt – Daniel Gomes, Arquivo.pt (Slides, Video)
  • Wikimedia na Universidade: Exploração e Projetos na NOVA FCSH – Rute Correia, Residência WMPT na NOVA FCSH, (Slides; Video)
  • GLAM Wiki. Uma introdução geral – Giovanna Fontenelle, Fundação Wikimédia, Brasil (Slides; Video)
  • Demo dos recursos em acesso livre no Arquivo.pt – Daniel Gomes (Video)

More information

15-anos-Arquivopt-Wikimedia

Afghanistan Websites and the fall of the regime in August 2021

thumbnail_Karima Faryabi

Last updated on September 26th, 2022 at 03:57 pm

afghan-ministry-of-economy-17-08-2021

Afghanistan Ministry of Economy website with Karima Faryabi (recorded August 17, 2021)

On August 15, 2021 the presidential palace in Kabul was taken over by the Taliban, consummating the fall of the regime that had been in place for 20 years, following the 9/11 attacks on the United States.

The community of Web archivists, through the Content Development Working Group – International Internet Preservation Consortium, was challenged to record the Afghan sites, given the risk that they would disappear with the new regime.

No time to lose when it comes to preserving the Web

Arquivo.pt reacted quickly, launching an automatic content search focused on .af domain sites and on international media news about the ongoing events.

On August 17, the websites began to be recorded.

1800 website addresses from Afghanistan (ending in .af) and 500 media news stories from around the world were used.

The addresses, URLs or “seeds” were obtained through automated search using the Bing Search API and immediately put into recording.

Content available to know Afghanistan’s history

As a result of the collection carried out, more than 400 Gigabytes of information became available at Arquivo.pt, which anyone can use for research in the most diverse areas.

The main contribution of Arquivo.pt to the community of Web archivists was the use of the automatic search that allows a quick reaction in the recording of Web contents in imminent risk of being lost.

Know more

Arquivo.pt open data set (Dados.gov)

Content collected by the Content Development Working Group of the International Internet Preservation Consortium available at the Archive-it service

Tutorial: how to explore Arquivo.pt using Python

Last updated on August 5th, 2024 at 04:50 pm

The Programming Historian aims to develop digital skills among the Humanities researchers through the publication of practical lessons in several languages.

The call Computational analysis skills for large-scale humanities data originated 7 new lessons.

One of them was the tutorial “Timeline summarization for large-scale past-web events with Python: the case of Arquivo.pt” developed by Daniel Gomes and Ricardo Campos.

It shows how to explore Arquivo.pt user interface and the Application Programming Interface (API) to execute advanced queries, process large amount of data or build new services, such as Tell me stories.

All the developed resources are freely available in open-access.

Open-access resources of the tutorial “Timeline summarization for large-scale past-web events with Python: the case of Arquivo.pt”

 

 

Open dataset about cryptocurrency

Criptomoedas gráfico

Last updated on August 17th, 2022 at 09:19 am

(Photo: QuoteInspector)

Since 2008 the cryptocurrency market has revolutionised the world by innovating and expanding into other areas (e.g., finance and art). However, with this rapid expansion, many projects are created every day, giving rise to a wide and varied range of websites, technologies and scams. Markets follow financing stages and it is during an initial stage of euphoria that more projects are created.

We believe that as the cryptocurrency market  stabilises, projects/websites are disappearing because funding diminishes or runs out.

Arquivo.pt initiated a new web archive collection that preserves web content that documents Cryptocurrency activities.

This work produced a new open dataset with information documenting each cryptocurrency project, including it is original URLs and links to the corresponding web-archived version in Arquivo.pt. The information sources selected to create this dataset were:

We believe that by creating this new dataset related to cryptocurrencies and by preserving all the corresponding web content, it has the potential to originate innovative scientific contributions in several areas such as Economy or Digital Humanities.

Resources

Researchers who want to carry out studies on the Cryptocurrencies dataset and need earlier access to the collected contents can contact Arquivo.pt.

Presentation at the IIPC Web Archiving Conference 2022