The historical collection of web content generated during the Internet Memory Foundation’s (IMF) activity has been donated to Arquivo.pt and is now searchable!
The IMF was a European organization dedicated to preserving web content that was wound up in 2018.
The 1st web archiving project in Europe (2004-2010) was led by Julien Masanès (who was guest of honour at the celebration of 10 years of Arquivo.pt) and was called European Archive Foundation.
In 2010, Julien Masanès, the “father” of Web archives in Europe created the IMF.
Examples of pages from the collection donated by the IMF
The collection donated by the IMF has now been integrated in the Arquivo.pt collection to be preserved for posterity.
This collection is composed of 142 million files that total 6.3 TB of historical information whose texts or images can now be searched through Arquivo.pt.
This new collection has been named “InternetMemory” in the Arquivo.pt collections list.
Searches can be made on this collection using the collection search parameter or through the custom search page available at arquivo.pt/InternetMemory.
Preserving scientific project websites is important
The contents of the websites tend to disappear when the scientific projects are finished.
The preservation of scientific project websites is important because:
documents the development of projects;
ensures access to unique technical and scientific content that researchers have posted on the project websites (eg presentations, photographs, data sets);
reinforces the visibility of the results of projects financed by FCT.
Experimental collection of scientific projects websites in 2016
Arquivo.pt automatically collected websites for projects financed by FCT in 2016.
The information about these websites was dispersed as it was not recorded during the administrative process.
For about 20 years, FCT financed scientific projects, so the number of sites could be too high to be identified manually.
Then an automatic methodology for identifying these websites was developed, developed by Arquivo.pt.
The FCT database had a total of 11,996 project entries but did not include references to web addresses. Applying the automatic methodology, 7 956 URLs related to the funded scientific projects were identified.
The collection of content referenced by these addresses resulted in the preservation of 600 721 files (72 GB), including content such as research group web pages, researchers’ personal pages or project-related blogs.
Online references in scientific project reports have been preserved since 2020
From June 2020, the website addresses of the projects financed by FCT must be registered in the progress and final reports funded by FCT.
Arquivo.pt started using these addresses to preserve the contents of websites of national scientific projects in a systematic way.
1st official collection of scientific project websites
In June 2020, Arquivo.pt obtained 263 addresses related to 100 scientific projects from the reports submitted to FCT. Most of the addresses (67%) did not have any version previously preserved in Arquivo.pt.
The addresses obtained point to online resources such as the websites of the projects, R&D units, news in the media, articles in scientific journals or repositories, databases, videos on Youtube or Facebook pages.
In July 2020, a special collection was launched from this set of addresses which resulted in 6.9 GB of information obtained from the visit to 31,606 URLs.
Exhibition about Research & Development projects
The Scientific Research Memory is an online exhibition dedicated to the websites of scientific projects funded by the Foundation for Science and Technology (FCT) that Arquivo.pt has preserved.
There are also websites of the Research & Development Units financed by FCT.
Memorial do Arquivo.pt preserves scientific websites for free
The Memorial do Arquivo.pt service has preserved historic FCT websites that have been disabled. These were created for events or initiatives that have ended and therefore their contents are no longer updated.
To include a website in the Memorial, Arquivo.pt starts by making a high quality collection of its contents.
Then, the collected contents are validated in collaboration with those responsible for the website.
Finally, the website address is redirected to the contents that have been preserved by Arquivo.pt.
For example, if someone wants to access any page on the Scientific Archives Meeting held in 2014, they will be redirected to Arquivo.pt.
Thus, the contents remain accessible over time and the links, the references in scientific communications that may exist do not break.
The digital preservation service Memorial do Arquivo.pt is free of charge for websites of the academic and scientific community, just send a request to contacto@arquivo.pt.
At the end of 2020, we recommend some texts that put the future in perspective.
We highlight the theme of preserving online content presented in the ebook “Tendências 2021” (Trends 2021). The contribution of Daniel Gomes, the Arquivo.pt manager, was entitled “Arquivos online ou do online?” (Online archives or archives of the online?).
I was invited to write about the challenges and threats to online archives. The first question that came to me was what is meant by an “online archive”?
My concern lies in the “archives of the online” because there is not even an established awareness about their need, whether at an academic, governmental or individual level.
It is technologically impossible to preserve all information available online. But it is absurd not to be aware that we have to preserve some of the information online for short, medium and long term access.
The speaker for this session was the winner of the Arquivo.pt 2020 Award, Miguel Ramalho, who presented his work. “Desarquivo” is a web aplication that searches for entities on Arquivo.pt and return a graph.
As in 2017, 2018 e 2019, we invited everyone to get to know Arquivo.pt, and to use it in research and in the preservation of memory.
World Digital Preservation Day is promoted by the Digital Preservation Coalitium (UK) and an occasion for initiatives around the world, shared on social networks with the WDPD2020 hashtag.
Geocities.com was the first major “social network” which enabled anyone to create their website and publish information on the Web. It was created in 1994, acquired by Yahoo in 1999 and shut down in 2009.
Arquivo.pt also integrated Geocities history in its collections!
Now, anyone can explore Geocities through the innovative tools provided by Arquivo.pt (e.g. full-text search, image search or API).
By making the historical collection of Geocities available, Arquivo.pt intends to contribute to the development of innovative studies in areas such as Arts, Humanities or Sociology (see a project summary).
The special collection of web pages about the 2019 European Elections is available for search at Arquivo.pt.
To compile this collection, pages written in 24 European languages were identified through automatic searches on the Bing search engine and suggestions from 17 European countries.
We emphasize the collaboration of the Publications Office of the European Union, which reviewed the list of search terms in the different languages of the European Union.
Between May and July 2019, Arquivo.pt exhaustively collected pages related to the European Elections in several countries.
The resulting collection named “European Elections 2019” comprises 99 million web files that sum 4.8 Terabytes of information.
We invited all citizens, especially the researchers, to try this service especially created to search the 2019 European Elections cross-lingual and international collection: https://arquivo.pt/ee2019
Video “A transnational and cross-lingual crawl of the European Parliamentary Elections 2019”
A transnational and cross-lingual crawl of the European Parliamentary Elections 2019, Ivo Branco, IIPC Web Archiving Conference and RESAW 2021 (slides)
Talk directly to the Arquivo.pt team and get answers to all your questions!
The Arquivo.pt team chats with you through online sessions.
Brief introductory presentations will be given, leaving time to ask all your questions about how to get more out of Arquivo.pt or how to apply to the Arquivo.pt Awards.
Sessions held in the 1st season
1st session, 27 March – Website Preservation: Do It Yourself!
The 1st session (in Portuguese) was about Website Preservation: Do It Yourself! and counted with the participation of Ricardo Basílio (Digital Curator of Arquivo.pt) and Daniel Gomes (Manager of Arquivo.pt).
The App meuParlamento.pt, was the winner of Arquivo.pt Award 2019. Nuno Moniz presented the relevance of this app to the citizen participation on politics. Arian Pasquali and Tomás Amaro, also authors of this work were presents. The session continued with questions related to the development of works from Arquivo.pt.
3th session, April 17 – Arquivo.pt Award and News on Arquivo.pt
After Easter break Arquivo.pt Online Café was back, presented by Daniel Gomes. This session was dedicated to clarify doubts for those who are finalizing their work to compete for the Arquivo.pt Award. Finally, the new interface of Arquivo.pt has been presented.
Flávio Martins and André Mourão, creators of the Revisionista.pt, talked about this tool that uses Arquivo.pt to show the reviews of a given new after its publication in newspapers.
5th session, April 30 – Public speeches about violence in private
Zélia Teixeira, Professor at Fernando Pessoa University and Psychologist, brought us an analysis of 217 news collected in Arquivo.pt from the three main daily newspapers, on domestic violence.
6th session, May 8 – Arquivo.pt API – How to process data at large scale?
André Mourão, Engineer I&D explained Arquivo.pt APIs (Application Programming Interfaces) through examples and cases, in the session held on 8 April. One doesn’t need to be an IT expert to see the the potencial of the API when used on research or new tools.
7th session, May 15 – Website Preservation: Do It Yourself!
Ricardo Basílio, Arquivo.pt’s web curator, presented a tutorial dedicated to Webrecorder and Browsertrix. This tools are usefull to capture websites locally in a small scale. From a demonstration of how it works, Arquivo.pt want to encourage the community. Anyone can make a selection of pages or websites and preserve them in a standardized format.
8th session, May 22 – The history of video games on the Portuguese web
Miguel Costa, Web developer and passionate about Web, tecnologies and videogames talked about the main figures of national business of videogames and about the first Portuguese videogame. In Arquivo.pt he founded archived files of videogames and a lot of information.
9th session, May 29 – Straight Edge in the metropolitan area of Lisbon
In the 9th session of the Café, we have got to know Straight Edge and its presence in the punk/hardcore medium of the metropolitan area of Lisbon in the 90s more closely. Diogo Duarte, anthropologist and researcher at the Contemporary History Institute of Universidade Nova de Lisboa,talkedabout his work dedicated to the theme and about the importance of Arquivo.pt to study this movement and other expressions of popular culture.
1oth session, June 5 – Health and Internet: an evolution
Health and Internet was the topic of the 10th session of Arquivo.pt Café, presented by Rita Espanha, professor and researcher at the ISCTE (University Institute of Lisbon) and CIES (Centre for Research and Studies in Sociology). The Internet has become the privileged medium where citizens seek information and build their own know in all areas of your life, including health. State agencies in turn have developed services that use the Internet. From the outside, part of the population remains that has not followed this change. The other part of the population that has easy access to information does not always have the critical sense to evaluate information and use it to their advantage. All of these issues became more evident during the Covid-19 pandemic period.
“Tell me Stories”, “Conta-me Histórias” is a service that creates temporal narratives, based on the contents preserved by Arquivo.pt.This application was the winner of the Arquivo.pt Prize 2018. One of its authors, Ricardo Campos (IPT; INESC TEC), talked about the service developments. Arian Pasquali, member of the development team, also participated in the discussion.
Researchers on NLP (Natural Language Processing find in this session an excellent use case explained in detail by its author. Miguel Won, resercher at the INESC-ID (Lisbon), talked about the opinion sections of the media. How do commentators read events and how does this reflect their political position? Based on this question, he developed the Web application Arquivo de Opinion, awarded in 2018, which presents a history of the opinion columns of Portuguese newspapers, from the pages of Arquivo.pt. In this session we got to know the news of the project, which now also collects pages from social networks.
14th session, July 10 – Museum of Portuguese Web Design
Sandra Antunes, Professor at the School of Technology and Management of Viseu (ESTGV) spoke about virtual spaces for the memory of Portuguese Web design and showed the importance of a museum to fill gaps in the areas of preservation, exhibition and history of Portuguese Web design.
At the end of 2018, Arquivo.pt launched an experimental image search service from the past, which it was possible to search around 4 million images from the past, coming from some collections of Arquivo.pt.
Memorial (hight quality preservation) and image search were highlighted as new developments in Arquivo.pt during Jornadas de Computação Científica 2019, held from 6 to 8 at the University of Azores in Ponta Delgada.
On the first day of this annual event, Arquivo.pt developed a training session in 4 parts:
Memory of the web: a forgoten heritage?, by Daniel Gomes (in portuguese);
Curation of institutional websites, by Ricardo Basílio (in portuguese);
Automatic access and processing of preserved Web data (APIs), by Fernando Melo (in portuguese);
Recommendations for web publication of preservable information, by Daniel Bicho (in portuguese).
Participants learned about the web preservation service offered to the community by the Arquivo.pt that for the purpose of researching and safeguarding the digital heritage, and how they can help preserve the Web.
In addition to the Jornadas 2019, the Arquivo.pt team also made two presentations in class context. The first was to students of the Informatics – Networks and Multimedia course at the University of Azores, and the second at the Escola Secundária das Laranjeiras (high school) in Ponta Delgada.
To schedule a training session with Arquivo.pt, contact us.
On April 11, Arquivo.pt headquarters at LNEC welcomed 30 students enrolled in the course of Information Sciences at the Faculty of Arts and Humanities of the University of Coimbra.
On the occasion, students had the opportunity to take part in a technical visit, and a training session on digital preservation and on the services offered by Arquivo.pt
