Gisele Da
email: giselesc@usp.br

Silva Craveiro

Cláudio Sonáglio

Budgetary Data (in an Open Format) Benefits, Advantages, Obstacles and Inhibitory Factors in the View of the Intermediaries of this System: A Study in Latin American Countries

Keywords: benefits, obstacles, open government data, intermediaries

ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

Introduction

Public organizations (in this study regarded as governments) are being confronted with new demands on the part of society. These demands are linked to the need for greater transparency in the management of public funds, and a greater control over the services provided, as well as a greater degree of accountability on the part of their managers. In this climate, information and communication technology (ICT) is beginning to play a key role. The Internet can be cited as one of the most important resources for this technology. The set of factors outlined herea greater demand by society for public organizations, a widespread use of information technology and the growing use and importance of the Internethave made feasible the rise of a platform called open government. In the view of [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF], under the aegis of open government, public organizations are seeking to meet the requirements of society by offering information as a means of finding a solution to some of the problems.

Among an array of opportunities created by open government initiatives, there is the prospect of being able to use open data (OD) which according to [START_REF] Eaves | The three laws of open government data[END_REF] means making information available on the Internet in a way that can allow it to be recycled for third parties. According to [12], open government data (OGD) involve the publication and dissemination of information of the public sector (i.e. governments) in the Web, which is shared in a rational and comprehensible format in a way that allows its reuse in digital applications or in other words, makes it legible for machines.

Following the rise of concepts (or technological platforms) of open data and open government, new players are emerging in the scene who may require new ways of using and appropriating the information made available, as well as reshaping traditional requirements. Thus the OGD projects must form a network between the government and society. It is only in this way that the assurances about the prospects of using open data effectively can be fulfilled, which means it is necessary to create and maintain an environment where the different players can interact [START_REF] Prince | Análisis de la cadena de valor del ecosistema de DatosAbiertos de la Ciudad de Buenos Aires[END_REF]. Thus, governments and society must create an environment which benefits both and allows these sectors to grow and become more involved. Several authors claim that there are potential benefits that can be derived from open government data: economic growth and an improvement in the provision of public services among other factors.

From what has been outlined so far, undertaking this work is justified in so far as it seeks to achieve the following general objective: to find out the advantages, benefits, obstacles and inhibitory facts in the view of the OG intermediaries, who are involved in the ecosystem of budgetary data in Latin American countries. In attaining this goal, it is hoped that an answer can be found to the following research question: by having a knowledge of the expectations of the OGD intermediaries, can governments be granted better conditions to carry out projects of open government data in the budgetary "ecosystem"?

By undertaking this study it is hoped that a contribution can be made to the background of open government data by obtaining information about how the intermediaries take action, what benefits are sought that can overcome obstacles and other factors that pervade the activities carried out in the budgetary "ecosystem" of open data. Another key issue is the context of the work since it focuses on representative countries from the Latin American continent, namely Argentina., Brazil, Mexico and Uruguay.

The exposed here, we consider important to clarify that intermediaries terms and ecosystem in this work. Intermediate are players (individually or representative of governments and civil society organizations), which operate with public data, released in an open format. Ecosystem as a group of organizations and individuals (government and society), as well as structures (example -public authorities and their agencies, non-profit society organizations), technological tools (eg -software), legal components (example -laws ) and values of society that interact in a particular government sector and society by making use of public data released in an open format.

Theoretical framework

The theories and models which act as a frame of reference, are employed for this study. This entails defining concepts about open data, its eco-system and the performance of intermediaries. The framework is outlined in the following sections together with its advan-tages, benefits, obstacles and inhibitory factors in an OGD ecosystem which supports the data collection data and analysis.

Open data, its ecosystem and intermediaries

The advent of the platform (or concept) of open data originates in a historical process, where public organizations were always great users of information technology. This fact allied to new requirements by society for greater efficiency in public bodies and the growing use of the Internet in modern society, have given rise to a new concept called open data.

The focal point of this study is open government data (OGD) for the [13], the publication and dissemination of information in the public sector (governments) in the Web, which can be shared in a rational and comprehensible format in a way that can allow it to be recycled in digital applications or in other words, made legible for machines.

Open government and open data are grounded on three pillars: transparency, participation and collaboration. Transparency imposes the responsibility to inform citizens about what exactly the government is doing and what activities it intends to carry out. Participation allows citizen to offer their ideas and skills and thus assists the government to devise more effective and far-reaching policies and also provide more information to society. Collaboration lays stress on the effectiveness of government and encourages closer cooperation between society and the different levels of government.

Until the time when all the initiatives and/or opportunities that the government had for making information available to society (more recently through the use of Internet technology ), these questions were traditionally addressed with a view to ensuring transparency, greater control and a better exercise of citizenship. However, with the advent of open data, new opportunities have arisen for society to go beyond these traditional requirements in areas such as the following: developing new goods and services to bring about financial opportunities (through these goods and services), making improvements in social welfare and assisting the government (by providing feedback) through an interaction made possible by these new goods and services.

Authors such as [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF], and [START_REF] Prince | Análisis de la cadena de valor del ecosistema de DatosAbiertos de la Ciudad de Buenos Aires[END_REF] stress that it cannot be expected that simply by opening up new data, governments will begin to produce goods and services and create economic opportunities. For this to take place an attempt must be made to study, understand and suggest improvements or corrections to the proceedings of governments and society in general, with a view to fostering new activities, facing challenges and reducing (or ideally overcoming) unforeseen problems .

Researchers into the environment of information have used the metaphor of the ecosystem to stand for the wide and intricate web of relationships between the suppliers, users, data, material infrastructure and institutions. In the opinion of [START_REF] Harrison | Creating Open Government Ecosystems: A Research and Development Agenda[END_REF], an eco-system is "a system of people, activities, values and technologies in a particular environment". [START_REF] Harrison | Creating Open Government Ecosystems: A Research and Development Agenda[END_REF] think that the owners of an eco-system are located in three entities: a) the policies and practices of governments; b) the web users, companies and citizens of society; c) the innovators. These can interact in several ways and influence the way the eco-system evolves: the policies and practices of government can interact with the web users, civil society and companies.

An ecosystem cannot be established in a satisfactory way without the presence of intermediaries. These might be government policymakers or originate in the society where there is a capacity and desire to act in the eco-system of open government data by having access to data and being able to handle and disseminate it. In other words, these data can be made useful for third parties for society through its most varied kinds of representation or organization.

Studies such as those of [START_REF] Kuk | The Roles in Assembling Open Data Complementarities[END_REF][START_REF] Mayer-Schoenberger | Participation and Power: Intermediaries of Open Data[END_REF], have underlined the importance of the intermediaries in this ecosystem. Setting out from these studies, these authors recognize that it is important for a wide range of players to take part because several technical activities are needed to handle the available information and make it accessible to the public. They state that a good deal is required to handle the available information and that this entails a close collaboration between the participants of this movement.

For the purposes of this study the authors define the term "intermediaries" as referring to "all the players (in an individual way or representatives of governments and social organizations), who are involved with public data that are released in an open format. They may or may not make use of technological, legal or structural artifacts in their activities. In making use of open data, the intermediaries aggregate value to the data to ensure that they can be understood more easily (and hence have a greater value) for third parties after their intervention". The intermediaries can and must supply goods and/or services with the public database for the government and society/third parties.

Possible Benefits and Advantages

It can be argued that there are several advantages for society and government in using government data in an open format. As well as having the chance to exercise a greater degree of citizenship, people are given new economic opportunities by having access to public information. The study by [START_REF] Mckinsey | Open data: Unlocking innovation and performance with liquid information[END_REF] estimates that when it is spread to cover areas such as education, transport, health, finance, fuel, and electricity, open data has the potential to add three trillion dollars to the global economy every year. Governments also benefit from the use of open data. [START_REF] Espinoza | Datos Abiertos: oportunidades y desafios paraCentroamérica con base en unacadena de valor[END_REF], [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF], cite the following as possible advantages to governments: greater internal efficiency -by having greater/better access to information, governments can make use of these data to undertake their activities and thus increase their efficiency by using information that is difficult to obtain (even by the governments themselves or other governments); and greater efficiency owing to the feedback provided by society that uses open data can and must "act as an informer" of the government about the possible approach that should be adopted for a better/greater use of public resources. [START_REF] Janssen | Benefits, Adoption Barriers and Myths of Open Dataand Open Government[END_REF] classify these possible benefits and/or advantages in three groups which are as follows: political and social; economic and technical; and operational. These benefits and/or advantages were used for an analysis of the main questions.

Possible obstacles and inhibitory factors

Some problems can arise in OGDs such as obstacles or possible inhibitors. Governments make great use of ICT; currently, they deploy different technological platforms in which the databases are stored. These databases should be the source of the data from open data projects. Governments have to carry out technical tasks that can be distinguished from the implementation of projects and involve the "conversion" of the data from these bases to formats that are suitable for publication in accordance with the rules of open data.

Another area that serves as a possible obstacle or inhibitory factor concerns the "understanding" of data from society (which is addressed in the issuethe quality and usability of available content). How can one ensure that the data are reliable and that the content is upto-date? Since the open data must be published in different formats from those stored in the database, the task of "conversion" is a necessary investment when forming the teams [START_REF] Harrison | Creating Open Government Ecosystems: A Research and Development Agenda[END_REF].

The structure of government bodies can also have an adverse effect on these initiatives since even when there are legal guarantees for the publication of the data, the governments need the operational conditions to carry out this task. It is recognized that there is a need for training and to adapt the culture of the public servers to this end as well as a suitable functional and technological framework for a correct understanding of the system and to meet the legal, technological and structural requirements. [13] and [START_REF] Janssen | Benefits, Adoption Barriers and Myths of Open Dataand Open Government[END_REF] classify the obstacles and possible inhibitory factors into six large groups which are as follows institutional, complexity of tasks, use and participation, legislation, quality of information and techniques. These obstacles and inhibitory factors were drawn on for the data analysis.

Methodology

In the light of its objectives, this can be characterized as an exploratory study, as defined by [START_REF] Creswell | Research project. Qualitative, quantitative and mixed method[END_REF], who believes that exploratory studies are suited to broadening the researcher's knowledge of a relatively unknown phenomenon and thus providing a greater understanding of it. Another feature of this kind of work is that the researcher does not expect to obtain definitive answers to the problem addressed.

In forming the sample, the authors of the study made use of their findings from a previous work on the "ecosystem" of open government data. Nineteen interviews were conducted, some in person and others via Skype; the interviews were recorded and subsequently transcribed. Four interviews were conducted in Argentina, six in Brazil, five in Mexico and four in Uruguay; all the interviews were carried out between September and December 2014.

The study was based on analysis assumptions with regard to content and a previous categorization of the aims of the research questions according to [START_REF] Bardin | Content Analysis[END_REF]. This author thinks that conducting an analysis of content is an investigative technique which is employed with a view to obtaining an objective and systematic description of the issue that is being communicated. One of the ways of putting into effect an analysis of content is to categorize the texts that emerge from the data collection. This categorization can be carried out in an a priori way and is grounded on a theoretical basis.

The categories must be valid and there must be a consistent classification of each element. A valid kind of categorization must be significant with regard to the content of the materials which are being analyzed and conform to the goals set out for the study. A qualitative approach was adopted for handling the data analysis which sought to determine what citations or references to previously established categories occurred according to [START_REF] Creswell | Research project. Qualitative, quantitative and mixed method[END_REF]. In Table 1, there is a chart showing the categories that were drawn on for the analysis

Results attained

Terms that can define the main results that were attained

In Table 2 there is a description of the instrument that was used, together with the purpose of each question and its relation to the categories defined for the analysis. The first part of the interview consisted of questions to determine the profile of the interviewee. The other questions were aimed at finding out about the activities that were carried out, the benefits and/or advantages, obstacles or inhibitory factors regarding the OGD ecosystem, especially with regard to budgetary data.

Results and analysis

In this section there is an examination of the results and respective analysis which follows the order of the questions in the instrument. In this way, the profiles of the respondents are shown together with the way they behaved during the project. Following this, the benefits and advantages are outlined together with obstacles and inhibitory factors.

The profile of the respondents and their way of behaving

The respondents basically had professional backgrounds and came from the following areas: public policymaking, economics, law, journalism and information technology Attention should be drawn to the presence of journalist in this group. With regard to the question of their performance, there were actors (intermediaries) of governments, who stressed that their main aim was to support the task of publishing data. On the other hand, there were key players who sought to publish the academic subject of the research they were carrying out. The intermediaries in the area of information technology stated that they acted in this area to develop tools that could make it easier to access and handle the data. Several actors (intermediaries) stated that they were involved in the observation of public policies and in the context of the interviews, the issues they focused on were financial matters or the public budget. Another issue that was often cited to justify the work of the intermediaries, were questions related to transparency.

Interviews: Benefits and Advantages

Table 3 shows the benefits and/or advantages that were revealed by the interviews. In all the tables there is a number beside the factor that is cited, which corresponds to the number of citations given for it. The number of citations of each category is the sum total of the citations of its respective advantages and/or benefits. The results are arranged to include all four countries and each interviewee is able to cite more than one benefit or advantage. This way of displaying the results can be explained by the fact that the main purpose of the study is to find out the advantages, benefits, obstacles and inhibitory factors in the view of the OGD interviewees who are involved in the ecosystem of budgetary data.

)
Greater transparency [START_REF] Prince | Análisis de la cadena de valor del ecosistema de DatosAbiertos de la Ciudad de Buenos Aires[END_REF]; increased participation and selfaccountability of citizens (web users) [START_REF] Prince | Análisis de la cadena de valor del ecosistema de DatosAbiertos de la Ciudad de Buenos Aires[END_REF]; creation of trust in the government [START_REF] Harrison | Creating Open Government Ecosystems: A Research and Development Agenda[END_REF]; public participation in producing data [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF]; equality of access to the data (1); new government services for the citizens (1); improvement in the formulation of policies [START_REF] Janssen | Benefits, Adoption Barriers and Myths of Open Dataand Open Government[END_REF]; creation of new kinds of knowledge in the public sector ( 5) and new social services (innovations) [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF]. Financial [START_REF] Prince | Análisis de la cadena de valor del ecosistema de DatosAbiertos de la Ciudad de Buenos Aires[END_REF] Assists in improving procedures, goods and/or services (1); development of new products or services (3) and the use of collective knowledge [START_REF] Janssen | Benefits, Adoption Barriers and Myths of Open Dataand Open Government[END_REF]. Operational and technical (14) Improvement in policymaking [START_REF] Mckinsey | Open data: Unlocking innovation and performance with liquid information[END_REF]; improvement in decision-making which allows comparisons to be made [START_REF] Bardin | Content Analysis[END_REF]; makes it easier to access and find data (2) and the creation of new databases by combining data [START_REF] Bardin | Content Analysis[END_REF].

It is clear from the results that the greatest benefits and/or results are linked to political and/or social factors where there are good prospects of bringing about greater transparency. This is one of the three pillars of open government and its citation was either made in a direct form or by mentioning other factors such as: the prospect of encouraging greater participation among the citizens or providing the public with greater access to the data.

Financial gains were also mentioned in this category and there were clear signs of another pillar of open data being found in this category-collaboration. This was clear when the interviewees stated that they were able to derive advantages or benefits from the use of collective knowledge through the use of an intermediary.

The factor highlighted above converge when obtaining operational and technical benefits or advantages in so far as there is a recognition that policymaking can be improved and that to achieve this a greater participation and collaboration between society and the government is needed through the main players (intermediaries) of these sectors.

With regard to political and/or social issues, it should be noted that some benefits or advantages were cited that could be obtained by governments such as: the creation of trust in the government and the discovery of new knowledge in the public sector. In addition, society can profit from open data in the following areas: new government services and social services for the general public. This confirms the underlying assumption of certain authors that everybody can derive benefits or advantages from the use of public data in an open format.

Possible obstacles and/or inhibitory factors

Table 4 shows the obstacles and/or inhibitory factors that emerged from the interviews. In all the tables, there is a number beside the factor being cited which corresponds to the number of its citations. The number of citations of each category is the total sum of the mentions of the respective obstacles and/or inhibitory factors. The results have been arranged to include all four countries and each interviewee can cite more than one benefit or advantage. Lack of uniformity in the policy for publishing data (15); priority given to the interests of organizations to the detriment of the interests of private citizens (5); failure to define the procedures adopted for working and/or interacting with the web users (3) the existence of doubtful standards for working with the web user (2)

Complexity of the task (38)

Duplication of data, the data made available in different ways either before or after the processing, resulting in uncertainty about the source (9); even when the data can be found, the users may not be aware of their potential uses [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF]; the data formats and datasets are much too complex to be handled and used easily (17); a lack of support for the tools or helpdesk ( 5) and the focus is on making use of individual datasets whereas the real value may come from a combination of several datasets (1).

Use and participation (40)

A lack of incentives for the user (9); public organizations fail to react to the input of the user (2); the costs are unexpectedly high (1); lack of time to use open data (1); a lack of knowledge about how to use or make sense of the data (15); lack of the necessary capacity to make use of the information (9); no statistical knowledge or understanding of the the potential value or limitations of statistics (3). Legislation (3) Written permission required to have access to the data or to reproduce them (2) and the question of the renewal of contracts/agreements (1). Quality of the information (32) Lack of information [START_REF] Mckinsey | Open data: Unlocking innovation and performance with liquid information[END_REF]; lack of precise information (8); information that is incomplete, only a part of the total picture shown or only conveyed at particular intervals [START_REF] Helbig | Modeling the Informational Relationships between Government and Society. Open Government Consultative Workshop -CTG[END_REF]; the loss of essential information (1) and the fact that similar data stored in different systems produce different results [START_REF] Janssen | Benefits, Adoption Barriers and Myths of Open Dataand Open Government[END_REF].

Techniques(29)

The data should be in a well defined format which is easily accessible: whereas the data formats are arbitrary, the data format must be strictly defined (1); absence of standards [START_REF] Prince | Análisis de la cadena de valor del ecosistema de DatosAbiertos de la Ciudad de Buenos Aires[END_REF]; absence of a support to make the data available (1); lack of goals and standards (1); no standard software for the processing of open data (5) and fragmentation of software and applications [START_REF] Mckinsey | Open data: Unlocking innovation and performance with liquid information[END_REF].

Several authors stated that they had a lot of difficulties in publishing public data in an open format which originated from the inner structures of the government. This is confirmed by the interviewees when the following factors had several citations: a lack of uniformity in the policy for publishing data and the fact that priority was given to the interests of organizations to the detriment of those of private citizens.

Other obstacles that were often cited by various authors were linked to the quality of the published information in various ways. This is also confirmed by the interviewees where there were a large number of citations: duplication of data; data being made available in different ways; the data formats and the fact that the datasets are much too complex to handle and use easily; lack of precise information, absence of standards; and the fragmentation of the software and applications. At the same time, attention should be drawn to the low number of citations regarding obstacles or inhibitory factors related to legislation.

There are many references to factors regarding the interests of society and the following had a lot of citations: a lack of incentives for the user; a lack of knowledge about how to use or make sense of the data and a lack of the skills needed to use the information. This is supported by the mention made of the factors related to the ability of the government to work together with society and the difficulties experienced by those wishing to obtain support or clarification of the content made available.

With regard to other factors, the driving-force behind the desire of society to participate in the OGD initiatives, as well as its qualifications for using these data, is to some extent related the factor of participation. These difficulties might be aggravated by a lack of understanding of the content made available and by the skills (some of which are technical) that are needed to have access to the information and be able to handle it .

4.4

Results attained Some questions about the instrument seek to find out what results can be attained. The purpose of these questions was to establish the results that were obtained and allow a parallel to be made between the benefits, advantages, obstacles or inhibitory factors and these results and learning experiences.

The main results that were mentioned, corroborate the fact that this issue is still in its early stages. This is because several of the interviewees stated that the principal result was the publication of documents with a view to publishing material about the question which included documents such as books, lists of statistics, and catalogues. Other results are as follows: it has had a small impact but is gradually being formed; there is more discussion of the issue and the community which is being formed around the subject is growing although only gradually; the fact that open data is an important question but still does not have great popular appeal; the fact that the issue is still in its early stages in the countries that are the focal point of this study .

In the previous subject, various advantages and benefits were cited by the interviewees as being susceptible to inclusion in this ecosystem and the results confirm some of these advantages such as: improving policymaking; a rise in the number of accusations of misdemeanors, which might lead to a better use of public resources; a heightened awareness in society of public expenditure and a greater trust in the government Some results confirmed that there were obstacles and difficulties, especially with regard to the limited interest and capacity of society to have access to the data or be able to use it. The interviewees cited the following results in support of this fact: a greater concern and awareness of the importance of allowing society to have access to data and the respective use of this data; in some areas there was a greater interest in the use of the data/information made available in this format as, for example, public transport; finally the formation of alliances between organizations of society increases the interest in the subject.

The results that were cited strengthen the need for the formation of networks between governments and society and allows the intermediaries to play a stronger role in this ecosystem. This is because mention was made of the effort and work necessary to obtain some results which must be carried out by the government and key players in society. As a result, certain activities were carried out such as public events and courses aimed at bringing about a greater degree of integration.

Final Considerations

Before giving our final thoughts about this work, an attempt will be made to outline some of its limitations and make suggestions for further studies. One drawback of the work which should be mentioned, is the fact that the sample was formed in an intentional or rather, non-probabilistic way which might have caused a degree of bias in the answers. In an attempt to overcome this problem of bias, the authors decided to interview key players (or intermediaries ) from different social origins and professional backgrounds , although all of them were linked to the ecosystem of budgeting.

The authors are aware that in future studies it would be valuable to carry out research into other ecosystems of open government data such as in education, and health among other areas, as a means of determining what results are different and/or similar. Forming a sample with intermediaries from other ecosystems will allow greater assistance to be given to public managers in future planning of schemes for the publication of data in an open format.

Undertaking this study has made it possible to confirm some of the advantages and/or benefits that are proclaimed by several authors, especially with regard to the open data which has the potential to exercise transparency and allow society to have more control over the acts of government and thus establish a historic trend. At the same time, it also confirms that few opportunities have been found in the economic field because not many interviewees referred to benefits and/or advantages in this area.

The results make clear that society still has little interest in the issue and the interviewees made several references to this fact. Several corroborative reasons were mentioned such as the difficulties of understanding the context of the data and the need for a higher level of education and culture to include the social players in this ecosystem. It should be underlined that there was also mention of the need for the intermediaries to have knowledge and technical skills (related to the information technology software sector), and a list was made of the technical difficulties of having access to the data or being able to handle it .

It is also evident from the results that the presence and involvement of governments is important since they can derive benefits and advantages from publishing the data in an open format. Governments should also give priority to mitigating factors that might harm the publication of data in a way and thus circumvent obstacles and technical or structural difficulties with regard to the publication of information. Government actions can also help to overcome the limited interest of society in available information, as well as to encourage activities that can lead to an understanding of the material that is published.

It is believed that this study has attained its intended objective of identifying the advantages, benefits, obstacles and inhibitory factors, from the standpoint of the OGDs who are involved in the ecosystem of budgetary data in Latin America. At the same time, the results have made it possible to find answers to the research question since identifying the factors listed above (as well as the results and lessons learned by the key players in the ecosystem of opexn government data) allow the policymakers to profit from the improved conditions for carrying out projects of open government data .

One of the contributions that can be made by the managers is as follows: it is extremely important to create the conditions that can enable organizations like those studies in this work, to be able to carry out their activities and in particular, to have an environment (or an ecosystem) that allows organizations to be combined so that partnerships can be formed in a way that is complementary to their individual capacities. These partnerships can also be formed to obtain benefits or advantages and as a way of overcoming possible obstacles and inhibitory factors through activities that encourage innovation and collaboration, which are the two basic principles of open data.

Table 1 .

 1 Categories for analisys.

	Category	Characteristics of each category

Table 2 .

 2 Questions of instrument.

	Questions	Purpose of the questions	Category Analy-
			sis
	Identification of the respondent.	To find out the name and	Profile of respon-
		organization of the respon-	dent
		dent .
	How would you define your use	To form a profile of the	Performance
	of open data and how much time	respondents through their
	have you spent on open data ?	performance
	What are the factors that have	To find out what factors	Benefits	and/or
	led you to play your role (i.e.	have driven the respon-	advantages
	from the action you have taken)	dents to take action in this
	in using open data ?	area .
	What are the main expected	To obtain a better under-	Benefits	and/or
	benefits (on the basis of your	standing of the driving-	advantages
	activities) of using open data	force behind the interme-
	(for governments and society in	diaries in the eco-system.
	general)?
	What are the main difficulties	To find outwhat factors	Obstacles	and/or
	encountered when using open	serve as obstacles or inhi-	inhibitory factors.
	data?	bitory factors in the eco-
		system and may, in a gen-
		eral way, impair the per-
		formance of the interme-
		diaries

Table 3 .

 3 Benefits and/or advantages

	Category	Benefits and/or advantages cited -number of citations
	Political and
	social (53

Table 4 .

 4 Obstacles and/or inhibitory factors

	Category	Obstacles and/or inhibitory factors -number of citations
	Institutional
	(25)

Acknowledgements

The authors acknowledge the support of the Iniciativa Latino Americana de Datos Abiertos (ILDA, the Latin American Open Data Initiative) and Avina Foundation that made possible this research study.


Kawaljeet Kapoor
email: kawaljeet.kappor@brunel.ac.uk

Vishanth Weerakkody
email: vishanth.weerakkody@brunel.ac.uk

Uthayasankar Sivarajah
email: sankar.sivarajah@brunel.ac.uk

Open Data Platforms and Their Usability: Proposing a Framework for Evaluating Citizen Intentions

Keywords: Open data, Citizen, Usability, Evaluation, Public Services

des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

Introduction

The push for making public services data available to the community started around mid 2000's with the European Union directive encouraging greater realisation of the economic value of public data through its reuse in 2003. This directive, combined with the advancement of Internet and associated ICT tools facilitating data analytics [START_REF] Sivarajah | Application of Web 2.0 technologies in egovernment: A United Kingdom case study[END_REF], has paved way for governments to open up data to the community. Conventionally, government departments retained public service data within their systems, with limited information being released to citizens and other stakeholders (businesses, charitable organizations, and NGO communities). However, since the last decade, the spread of digital governance and associated norms such as responsiveness, accessibility and efficiency of public services, transparency and accountability, have motivated governments to exploit the potential of wider distribution and use of such data [START_REF] Sivarajah | Evaluating the use and impact of Web 2.0 technologies in local government[END_REF]. One of the first countries to mandate the use of open data was the United States. The Presidential Open Government Directive in December 2009 required the use of open formats by all federal US agencies. Six months later, the UK followed with their own plans for open public data, with the Prime Minister announcing the setting up of the data.gov.uk website. Subsequently, the European Commission published a Communication on Open Data in 2011, and in the same year, USA, UK, and initially six other countries were signatories to the Open Government Declaration.

The UK is considered as one of the leading countries in Europe for open data. The data.gov.uk is one of the most comprehensive open data repositories making available non-personal UK government data about public services, ranging from health, social services, education, transport to crime and other geo-environmental data. It was launched in closed-beta in September 2009 and publicly launched in January 2010 (data.gov.uk/blog/the-new-datagovuk). When the data.gov.uk website was officially launched in January 2010, ordnance survey data which provides information on geographical locations was one of the key datasets that was opened up as part of the project [START_REF]Ordnance Survey offers free data access[END_REF]. Subsequently, in June 2010, the Treasury released the Combined Online Information System (COINS), which operates as the UK Government's central accounting system detailing the spending of all government departments and their major spending programmes [START_REF] Wilcox | Government drops first set of COINS[END_REF]. As of June 2015, the data.gov.uk website contains over 25500 datasets. The data can be used by individuals, businesses and other stakeholders under the conditions that the copyright and the source of the data is acknowledged by including an attribution statement specified by data.gov.uk.

One of the motivations of the open data movement has been to make more data easily accessible to diverse stakeholders with a view of enticing them to participate and contribute to the public policy-making space. For example, it is anticipated that researchers, think-tanks, entrepreneurs, businesses leaders, representatives of public services, NGOs, charities, community groups and citizens, at large, will use the open data to contribute to the policy decision making process, particularly across local governments. Indeed, this has encouraged these stakeholders to take an active interest in the way services are currently being delivered, and has stimulated thinking around how to improve services. Although countries such as the UK and US have taken proactive steps to improve the availability and ease of use (through machine-readability and technical standards), there still remain several barriers to accessibility and usability of open data. Moreover, the actual use of open data is cumbersome and stakeholders have to do it themself. In order to fully exploit the potential of open data, users will usually require a certain level of applied skills. The fact that there is no existing easy-to-use, proven solution which can help citizens exploit the open data for decision making regarding their own lives, or contribute to the wider public policy making debate, does not help. Such issues are further compounded by the generic nature of open data repositories such as www.data.gov.uk and www.epsiplatform.eu, and thus their relevance and direct interest to citizens, in particular.

The motivation for this paper lies in the reasoning that although the availability of open data offers many opportunities for citizens, no research exists that questions the usability of open data platforms, particularly from a citizen's perspective. In this pa-per, we set out to examine and discuss some of the salient factors that influence the usability of open data by citizens and propose a conceptual framework to encapsulate these factors. In order to do this, we first review the benefits and challenges of open data followed by examining the role of open data platforms, and motivations for using such platforms. Thereafter, we identify potential measures for evaluating the usability of open data platforms and propose a framework to capture these. We conclude the paper by offering a discussion to synthesise the main arguments presented in the paper, identifying the main limitation, and pointing at future research directions.

2

Open Data: An Overview

The goal of Open Data initiatives has been to open all non-personal and noncommercial data, especially data collected and processed by government organizations [START_REF] Borzacchiello | The impact on innovation of open access to spatial environmental information: A research strategy[END_REF]. It can be seen as a movement very similar to the Open Source or Open Access phenomenon. In the course of this trend, public sector organisations have started making governmental data available on web portals, as web services so that the public have access to these data at a single point of access to official datasets. The increase in availability of open data initiatives has been seen as mainly due to the growing pressure imposed by governments on all kinds of public organisations to release their raw data [18]. The key motivators to encourage public organisations for publishing data revolves around government's perception that the open access to publicly-funded data provides: (a) greater economic returns from public investment [START_REF] Cranefield | Value In The Mash: Exploring The Benefits, Barriers And Enablers Of Open Data Apps[END_REF], (b) provides policy-makers with data needed to address complex problems [START_REF] Arzberger | An international framework to promote access to data[END_REF], (c) generate wealth through the downstream use of outputs [18], and (d) help involve citizens in analysing large quantities of datasets [START_REF] Surowiecki | The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business economies, societies and nations[END_REF]. In general, the overarching arguments for stimulating open data are highlighted as the increase in political economic growth and the contribution to public values (i.e. transparency and accountability).

Benefits and Challenges in using and accessing of Open Data

Many scholars believe that Open data can be a valuable resource of information if published in a useful manner (e.g. [START_REF] Borzacchiello | The impact on innovation of open access to spatial environmental information: A research strategy[END_REF]). Some of the key benefits and challenges identified in the extant literature (e.g. [START_REF] Conradie | On the barriers for local government releasing open data[END_REF][START_REF] Cranefield | Value In The Mash: Exploring The Benefits, Barriers And Enablers Of Open Data Apps[END_REF][START_REF] Janssen | Benefits, adoption barriers and myths of open data and open government[END_REF][START_REF] Ubaldi | Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives[END_REF] are synthesised and presented in Tables 1 and2, respectively. These tables do not provide an extensive list of benefits and challenges of open data use, but highlight the prominent opportunities and concerns discussed in the literature.

Table 1. Benefits of Open Data

Benefits Description References

Increased Transparency and Accountability

Making government data transparent should increase public trust in government and civil servants and also allow citizens to hold the government officials accountable. [START_REF] Cranefield | Value In The Mash: Exploring The Benefits, Barriers And Enablers Of Open Data Apps[END_REF][START_REF] Janssen | Benefits, adoption barriers and myths of open data and open government[END_REF][START_REF] Ubaldi | Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives[END_REF] Economic Growth

Opening government data is believed to bring a range of economic benefits such as encouraging the marketplace to develop products and services, which increase productivity, offer employment, and bring revenue back to government in the form of taxation revenue. [START_REF] Borzacchiello | The impact on innovation of open access to spatial environmental information: A research strategy[END_REF][START_REF] Janssen | Benefits, adoption barriers and myths of open data and open government[END_REF] Societal benefits Potential to allow citizens to interact with government in a more informed and interactive manner.

[32]

Cost reduction and efficiencies

Sourcing data is often significantly costly in both time and money for organisations. Opening government data can significantly reduce the costs associated with acquiring data.

[33]

Improved data quality

Leads to improved data quality via crowdsourcing of corrections or by filling gaps in data.

[11]

Simulating Innovation

Opening government data encourages developers and the general public to explore and play with new data that might lead to development of innovative solutions.

[ [START_REF] Janssen | Benefits, adoption barriers and myths of open data and open government[END_REF][START_REF] Ubaldi | Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives[END_REF] Although open data can potentially provide many benefits, its use also comes with a number of challenges. Some of the key challenges identified in the extant literature are presented in the following table.

Table 2. Challenges of Open Data

Challenges Description References

Increasing public interest Challenge of raising the capacity and awareness of civil servants, citizens and the private sector on their rights to access and re-use public data initiatives. [START_REF] Ubaldi | Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives[END_REF][START_REF] Zuiderwijk | Open data policies, their implementation and impact: A framework for comparison[END_REF] Cost of opening up data Time and resource costs are seen as obstacles for government departments in opening their data, especially as they were often experienced as upfront costs. [START_REF] Cranefield | Value In The Mash: Exploring The Benefits, Barriers And Enablers Of Open Data Apps[END_REF][START_REF] Ubaldi | Open Government Data: Towards Empirical Analysis of Open Government Data Initiatives[END_REF] Data ownership risks and legality concerns

In the past, if councils or government departments contracted a third party to gather data for them, or purchased data directly from the third party, they often licensed the data and did not own the intellectual property rights, and thus could not directly release it under open copyright.

[18, 41]

Uncertainty about data stream continuity

If a user is not positive that a data stream will be maintained in the future, this creates uncertainty around any project using that data stream. This reduces the chances that an organisation or individual will be willing to invest the time and resources into a product or application that uses this data.

[18, 32]

Data quality concerns

Government departments may be reluctant to release data that they see as low quality. Some agencies are worried about the potential liabilities of releasing their data concerning information accuracy, up-to-dateness etc. [START_REF] Conradie | On the barriers for local government releasing open data[END_REF][START_REF] Zhang | Exploring stakeholders' expectations of the benefits and barriers of e-government knowledge sharing[END_REF] Privacy violation Data that includes private or potentially sensitive information on citizens; there can be concerns over whether and how the data can be anonymised, what can be released, to whom and under what copyright.

[11, 9]

Use of Open Data Platforms

The main purpose of open data platforms has been to promote access to government data and encourage development of creative tools and applications to engage and serve the wider community [START_REF] Martín | Open Government Data: A european Perspective[END_REF]. In doing so, enabling civic engagement by providing opportunity for citizens, public sector organisations, businesses and independent developers to use systematically-updated stream of open data is being encouraged. The governments perceive that making this data available on the web would lead to more transparency, participation, and innovation throughout society [START_REF] Conradie | On the barriers for local government releasing open data[END_REF][START_REF] Janssen | Benefits, adoption barriers and myths of open data and open government[END_REF]. Often open data platforms publish datasets covering a wide range of domains, from environmental data over employment statistics to the budgets of municipalities. Publishers of these datasets can be individual government agencies or providers of larger repositories that collect public datasets and make them available in a centralized and possibly standardized way. Governments and publishers of open data expect the users to exploit these data in many ways as possible for the benefit of the society [START_REF]About data[END_REF]. For example, general public (non-technical users) may use it simply to analyse trends over time from one policy area, or to compare how different parts of government go about their work. On the other hand, technical users such as software developers are encouraged to create useful applications out of the raw data files, which can then be used by everyone benefitting the wider society.

In terms of the process to find the available open data, end-users of these platforms (i.e. citizens, businesses) who wish to access and use Open Data need to first identify relevant datasets manually or by visiting a central repository/platform (e.g. data.gov.uk). In the case of finding datasets manually, this includes finding organizations or agencies that publish open datasets on platforms that provide a central and responsive entry point where users can search for data. If a single dataset can be found, that contains all the relevant data, the user can directly extract the required information. However, it is rather unlikely to find all relevant data in a single file. The way people access and use Open Data is greatly influenced by the way the data is published [START_REF] Borzacchiello | The impact on innovation of open access to spatial environmental information: A research strategy[END_REF]. Many government agencies or organizations collect large amounts of data. In its original, raw form, this data is often not very useful for end users. Therefore, many datasets are cleaned and customized before being published. While some publishers prefer the data to be in a human-readable format, others prefer a machinereadable format. Apart from accessing data from these platforms, users (e.g. organisations) are also encouraged to submit useful data that can be published to the general public. Government open data initiatives are also encouraging users in a number of ways to be involved as part of these projects dependent on their background or interest. For example, one of the challenges is making existing data come to life, and users are encouraged to combine and reorganise existing data to offer new insights resulting in useful visualisations of these data [START_REF]About data[END_REF].

Developing Measures for evaluating the acceptance of Open Data Platforms

Websites such as data.gov.uk make it easy for citizens to access governmental data and other offered services whilst increasing citizens' potential of contributing to democratic processes [START_REF] Fang | e-Government in Digital Era: Concept, Practice, and Development[END_REF]. According to Wangpipatwong et al [START_REF] Wangpipatwong | Understanding Citizen's Continuance Intention to Use e-Government Website: a Composite View of Technology Acceptance Model and Computer Self-Efficacy[END_REF], citizen use of such websites substantially reduces the management and operational costs for the government. This study aims to empirically investigate the use of the aforementioned open data website from a citizen's perspective. A suitable mix of measures will be borrowed from the available innovation adoption models to evaluate the citizens' continued use intentions of such websites. This will be undertaken by gathering the opinions of those who already have the experience of using data.gov.uk along a set of measures identified from the literature.

Available literature shows that very few studies have attempted to empirically evaluate the performance of open data websites. There are, however, evidences of other studies using different measures of innovation adoption to investigate the performance of different websites. For instance, Wangpipatwong et al [START_REF] Wangpipatwong | Understanding Citizen's Continuance Intention to Use e-Government Website: a Composite View of Technology Acceptance Model and Computer Self-Efficacy[END_REF] use the Technology Acceptance Model (TAM) alongside self-efficacy as an added measure, to evaluate the use of an e-government website. Fang and Holsapple [START_REF] Fang | e-Government in Digital Era: Concept, Practice, and Development[END_REF] focus on the navigation structure of a website and their impact on the usability of that website by using factors defining its usability. Wang and Senecal [START_REF] Wang | Measuring perceived website usability[END_REF] used ease of use, speed, and interactivity to measure the usability of a website and its subsequent impact on user attitudes and intentions.

The literature is rich with theoretical models, mostly developed from the psychology and sociology theories, which assist in analysing the acceptance of a service or a product [START_REF] Venkatesh | User acceptance of information technology: Toward a unified view[END_REF][START_REF] Venkatesh | Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology[END_REF]. Some of the most used models come from the following theories: Diffusion of Innovations theory (DOI) by Rogers [START_REF] Rogers | Diffusion of Innovations[END_REF], Theory of Reasoned action (TRA) by Fishbein and Ajzen [START_REF] Fishbein | Belief, attitude, intention, and behavior: An introduction to theory and research[END_REF], Theory of Planned Behaviour (TPB) by Ajzen [START_REF] Ajzen | From intentions to actions: A theory of planned behaviour[END_REF] and Ajzen and Fishbein [START_REF] Ajzen | Understanding attitudes and predicting social behavior[END_REF], Technology Acceptance Model (TAM) by Davis [START_REF] Davis | Perceived usefulness, perceived ease of use, and user acceptance of information technology[END_REF], Decomposed Theory of Planned Behavior, Extended Technology Acceptance Model, and Unified Theory of Acceptance and Use of Technology by Venkatesh et al [START_REF] Venkatesh | Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology[END_REF]. The DOI theory is regarded as a principal theoretical perspective on technology adoption offering a conceptual framework for discussing adoption at a global level. Rogers [START_REF] Rogers | Diffusion of Innovations[END_REF] has synthesized sixty years of innovation-adoption research in developing this theory. His DOI model has been well received in the world of innovative solutions, and it is one of the most used theories in the field of innovation diffusion [START_REF] Kapoor | Role of Innovation Attributes in Explaining the Adoption Intention for the Interbank Mobile Payment Service in an Indian Context[END_REF][START_REF] Tornatzky | Innovation Characteristics and Innovation Adoption-Implementation: A Meta-Analysis of Findings[END_REF].

Rogers [START_REF] Rogers | Diffusion of Innovations[END_REF] identified the following five attributes as the perceived attributes of innovations within DOIrelative advantage, compatibility, complexity, trialability, and observability. It can be easily observed from the attributes used in the aforementioned models that the TPB model is an extension of the TRA model, and the decomposed TPB model shares similarities with TAM. Fishbein and Ajzen [START_REF] Fishbein | Belief, attitude, intention, and behavior: An introduction to theory and research[END_REF] incorporated attitudes, subjective norms and behavioural intention in their TRA model. TAM is also regarded as an adaptation of the TRA model and the TAM model also shares two attributes with the DOI model (relative advantage/perceived usefulness and complexity). Davis [START_REF] Davis | Perceived usefulness, perceived ease of use, and user acceptance of information technology[END_REF] identified perceived usefulness and ease of use alongside the effects of attitude on intention in their TAM model, as the factors influencing the acceptance of a technology. Giving due consideration to all of these innovation adoption models, the following attributes were shortlisted depending upon their relevance to the case of open data website being covered within this study (figure 1): perceived usefulness, compatibility, ease of use, result demonstrability, trust, risk, social approval, visibility, and behavioural intentions.

Fig. 1. Proposed Framework for Open Data Websites

Perceived usefulness, also referred to as the relative advantage, will help assess if the information available on the website is relatively better across multiple aspects in comparison to the same data that a citizen can access via other physical offices and platforms. In measuring the advantages of a new service, users tend to evaluate the pluses and minuses of using that service. This characteristic is known to determine the ultimate rate of most innovation adoptions in the long run [START_REF] Pannell | Understanding and Promoting Adoption of Conservation Practices by Rural Landholders[END_REF]. In terms of compatibility, the website will be assessed for the type of information it offers to the citizens with respect to the type of information the citizens are interested in, or are expecting to, access using such open data platforms. Rogers [START_REF] Rogers | Diffusion of Innovations[END_REF] describes compatibility to be the degree with which the introduced innovation manifests itself as being consistent with users' past experiences, present values, and their future needs.

Users' knowhow of a service tends to dictate their perception of the level of effort involved in using that service. The less complex a service is to use/operate, the more easily it is accepted. The ease of using the data.gov.uk website will be evaluated from a perspective of optimizing user experience; the design of the interface, time required to look up for the desired information, understandability of different features/tabs offered within the website, and any other navigation complexities will be explored using this attribute (page layout, scrolling and paging, text appearances, links, search and so on). Result demonstrability will be measured along users' satisfaction of the quality of information that they can retrieve using the open data website. The trust factor will be used to measure the extent to which the users trust the validity of the information that they are accessing using such open data websites. A user's uncertainty about the quality of information being gathered can potentially lead to anxiety, which can come in the way of their adoption decision. The expected social or economic loss caused from using a new system constitutes perceived risk [START_REF] Labay | Exploring the consumer decision process in the adoption of solar energy systems[END_REF][START_REF] Rogers | Communication of Innovations[END_REF]. In this context, the risk factor will be used to measure users' apprehensions of inputting personal information onto such websites, and also their confidence in using the information available on such websites.

The members of a social system generally tend to display a sense of belonging by being a part of the activities that are regarded as a norm within their social system [START_REF] Ozaki | Adopting sustainable innovation: what makes consumers sign up to green electricity? Business strategy and the environment[END_REF]. Social interaction and information exchange can play critical roles in promoting the use of a new system, in effect, motivating individuals to accept that system [START_REF] Bandura | Social Foundations of Thoughts and Action: a Social Cognitive Theory[END_REF]. Social approval is a construct that will help measure approval from a user's social circle (friends, families, and peers) regarding the use of open data platforms and their authenticity. Visibility of a system encourages peer discussions of that system, which collectively contributes towards achieving a better acceptance rate for that system [START_REF] Rogers | Diffusion of Innovations[END_REF]. Thus, the visibility construct will be used in this study to help identify the awareness that the citizens have about the existence of such open data platforms that they can utilize to their benefit on a daily basis.

The effects/influences of perceived usefulness, compatibility, ease of use, result demonstrability, trust, risk, social approval, and visibility will then be individually measured across users' behavioural intentions. Behavioural intention is perceived as an instinctive probability that a user relates directly with the possibility of a particular behavioural option being chosen [START_REF] Chiu | Ethical judgment and whistleblowing intention: Examining the moderating role of locus of control[END_REF]. Some models of innovation adoption and diffusion (TRA and TPB) acknowledge this attribute to be the best immediate predictor of the acceptance of a given service/product [START_REF] Ozaki | Adopting sustainable innovation: what makes consumers sign up to green electricity? Business strategy and the environment[END_REF]. These eight characteristics are expected to positively and significantly impact users' intentions towards the usage of open data platforms. The positive or negative correlations that will surface post the empirical evaluations will then be logically reasoned and analysed for their significance in influencing users' intentions towards using the data.gov.uk website.

Discussion and Conclusions

This paper focuses specific interest on open data platforms to establish an understanding of its usability from a citizen perspective. In the UK, data.gov.uk is the functional open data website available to be accessed by the public. The UK government has introduced an action plan for a smarter and more efficient government to open the government and promote transparency in empowering citizens and their roles in the civic society; their focus is on redefining the relationship between the frontline and the centre to better manage finances via efficient delivery [START_REF] Veljković | Benchmarking open government: An open data perspective[END_REF].

In terms of theoretical implications, this study broadly touches upon the streams of open government, ICT literature, and digital governance. The framework presented in this paper has been developed from well-established and most used theories in innovation adoption. This framework can be applied across different open data domains to assess the impact of transparent governance on empowering and encouraging citizen engagement in open government data initiatives. Other researchers can use this framework to build upon, as required, to run in-depth analyses of specific aspects (such as trust in available information, level of risk involved in utilizing that information, and so on) of open data and its usability across different contexts.

In terms of practical implications, a significant milestone of this research is the development of a framework that would enable a reliable assessment of the open data platforms. A 2015 report from a four million project funded by the European commission revealed that one of the issues of such open data platforms is that most data owners in the public sector hold a poor understanding of the relative benefits of different data formats [START_REF] Glidden | Open Government Data and the Right to Information: Opportunities and Obstacles[END_REF]. Most owners tend to adopt a path of least resistance and publish the data in its original format, ignoring the potential of making the data available in more reader-friendly capable formats. Nevertheless, such open data holds numerous practical implications for international data standard forums [START_REF] Glidden | Open Government Data and the Right to Information: Opportunities and Obstacles[END_REF]. The framework will assist policymakers, publishers of open data, IT practitioners (application developers), and other proactive citizens in analyzing the usability of open data platforms. This framework will help evaluate the perceived usefulness of readily available open data, whilst measuring its compatibility with user needs. The stakeholders will also be able to assess the quality of information available in these websites across the risk and trust perceptions of the involved users. Other issues such as user friendliness and usefulness will also be measurable across the aspects of ease of use and result demonstrability. Overall, the constructs put together in the framework will help practitioners to summarize the effectiveness of the specific open data platforms being evaluated, to be eventually bettered for future use by the citizens. This study suffers from the limitation of no empirical evidence supporting the validity of the proposed framework. This is an ongoing research, and having established a framework for evaluating open data, our future research will be focused on empirically assessing the validity of this framework in the context of a UK open data website: data.gov.uk. Exclusive scenarios will be defined prior to the empirical evaluations; for instance, the users will be directed to explore specific categories (housing, environment, taxes, health, and so on) in the targeted website to assess the retrieved results against the framework proposed within this study. This will help analyze and identify problem areas, if any, to be marked for improvement by the publishers of such open data.

Data Findings. https://opensource.com/government/15/6/citadel-open-government-dataresults (2015)