Full-population web crawl of .gov.uk web domain, 2014

Nicholls, Tom ORCID: 0000-0002-6971-8614
(2019) Full-population web crawl of .gov.uk web domain, 2014. UK Data Service.

Access the full-text of this item by clicking on the Open Access link.


This dataset is the result of a full-population crawl of the .gov.uk web domain, aiming to capture a full picture of the scope of public-facing government activity online and the links between different government bodies. Local governments have been developing online services, aiming to better serve the public and reduce administrative costs. However, the impact of this work, and the links between governments’ online and offline activities, remain uncertain. The overall research question for this research examines whether local e-government has met these expectations, of Digital Era Governance and of its practitioners. Aim was to directly analyse the structure and content of government online. It shows that recent digital-centric public administration theories, typified by the Digital Era Governance quasi-paradigm, are not empirically supported by the UK local government experience. The data consist of a file of individual Uniform Resource Locators (URLs) fetched during the crawl, and a further file containing pairs of URLs reflecting the Hypertext Markup Language (HTML) links between them. In addition, a GraphML format file is presented for a version of the data reduced to third-level-domains, with accompanying attribute data for the publishing government organisations and calculated webometric statistics based on the third-level-domain link network.

Item Type: Other
Divisions: Faculty of Humanities and Social Sciences > School of the Arts
Depositing User: Symplectic Admin
Date Deposited: 12 Apr 2021 08:33
Last Modified: 06 Oct 2022 06:17
DOI: 10.5255/UKDA-SN-852205
Open Access URL: https://reshare.ukdataservice.ac.uk/852205/
Related URLs:
URI: https://livrepository.liverpool.ac.uk/id/eprint/3118820