Crawled web sites
Since 2006 July 21, the system has evolved to capture systematically and effectively a growing websites number. In addition, space required to store and give access to these dates also has evolved.
In exhibition to data statistics, we mean “web”, or “web site”, as a resource published on the Internet identified by an independent URL. We mean “capture”, each made capture in web site time. And we mean “file”, each technical files or archives that contains a website. Are included other technical dates that can be interesting for PADICAT public.
The repository contents:
| Concept | Total |
|---|---|
| Number of websites | 57.993 |
| Number of harvests | 229.396 |
| Number of files | 340.279.750 |
| ARC space (TB) | 12 |
| Indexing space (TB) | 1 |
| Total space (TB) | 13 |
Origin of harvests
Deposited resources in repository are from: capture .CAT domain of compiled resources to create monographic collections; websites recommended by PADICAT public; and digital resources of institutions that have signed cooperation agreement with Biblioteca de Catalunya.
| Concept | Number of websites | Number of harvests |
|---|---|---|
| Agreements | 463 | 2.606 |
| Recommended | 704 | 3.257 |
| Monographics | 3.249 | 36.682 |
| .cat | 35.171 | 75.494 |
| Total | 39.587 | 118.039 |
Distribution of file type that contains PADICAT repository
| Type | Files | |
|---|---|---|
| text/html | 263.148.453 | 77,33% |
| image/jpeg | 37.756.722 | 11,09% |
| image/gif | 8.456.930 | 2,49% |
| image/png | 5.963.586 | 1,75% |
| application/pdf | 5.375.942 | 1,58% |
| application/atom+xml | 3.548.712 | 1,04% |
| text/xml | 2.302.467 | 0,68% |
| application/rss+xml | 2.241.257 | 0,66% |
| text/css | 1.792.974 | 0,53% |
| application/javascript | 1.388.795 | 0,41% |
| text/plain | 1.387.596 | 0,41% |
| text/dns | 976.210 | 0,29% |
| application/x-shockwave-flash | 903.466 | 0,27% |
| application/x-javascript | 683.954 | 0,20% |
| no-type | 522.794 | 0,15% |
| application/xml | 517.012 | 0,15% |
| application/octet-stream | 377.471 | 0,11% |
| application/msword | 307.148 | 0,09% |
| image/pjpeg | 255.547 | 0,07% |
| image/jpg | 208.674 | 0,06% |
| Altres | 2.164.040 | 0,64% |
| Total | 340.279.750 | |
Monographic evolution: PADICAT topic collections
PADICAT made eight monographic collections: Catalan museums, folk-rock music in Catalonia, Parliament European Parliament elections campaign (2009), Parliament of Catalonia (2006 and 2010), Spanish Congress and Senate (2008), and local elections (2007 and 2011).
| Concept | Number of websibtes | Number of harvests | Number of files | Space (GB) |
|---|---|---|---|---|
| Catalan Elections 2006 | 88 | 775 | 4.953.215 | 175 |
| Local Elections 2007 | 615 | 1.747 | 13.641.991 | 457 |
| Folkrock music | 50 | 50 | 1.148.312 | 22 |
| Spanish Elections 2008 | 147 | 896 | 3.117.638 | 135,11 |
| European Elections 2009 | 170 | 613 | 5.404.291 | 233,05 |
| Catalan museums | 1.364 | 1.391 | 2.146.133 | 147,49 |
| Catalan Elections 2010 | 806 | 31.210 | 17.202.999 | 707,65 |
| Local Elections 2011 | 1.518 | 47.429 | 17.202.999 | 1.127 |
| Total | 4.758 | 84.111 | 64.817.578 | 3004,3 |
More about PADICAT monographic collections in election campaigns. The text is in Spanish:
Ciro Llueca; Daniel Cócera; Natalia Torres; Gerard Suades; Ricard de la Vega (2011). “A ritmo de tweet: archivando elecciones 2.0”. El profesional de la información, vol. 20, nº 3.
http://eprints.rclis.org/handle/10760/15764
