Talk:Open Data/Wikibook on Open Data

Survey
The survey is awaiting input. Please feel free to add information on any project you - the volunteer data entry person - feel to be an open data project.

5 possible major nodes
It was initially suggested we base our list from 5 major nodes:
 * 1) Open Access to Knowledge Law (OAK Law), a centre within Queensland University of Technology, to give us a more complete historical picture of open data initiatives in Australia and Internationally
 * 2) The Gov 2.0 Taskforce, commissioned by the Federal Department of Finance and Deregulation in 2009, to show us projects they see as significant to the more recent Gov 2.0 agenda
 * 3) The Australian National Data Service (ANDS), supported through the Australian National Collaborative Research Infrastructure Strategy Program and the Education Investment Fund (EIF) Super Science Initiative, to explain the type of open data projects they support and where they fit internationally
 * 4) Wikimedia Australia, a local chapter to the international Wikimedia Foundation, to show us local and international projects that are using Wikimedia projects as platforms for open data publishing
 * 5) Google Open Public Data Explorer, an initiative of Google Incorporated, to discuss the conditions for being included in that project, and to get a major commercial enterprise perspective on open data initiatives generally

Definitions, Terminology, Principles

 * UCL - http://discovery.ucl.ac.uk/open_access.html
 * Jon Mason's paper - http://www.intercog.net/publications/20071105_ICCE_Leeson_Mason.pdf
 * Open Definition, based on principles - http://opendefinition.org/
 * 8 Principles of Open Government Data - https://public.resource.org/8_principles.html
 * Campaign video http://www.youtube.com/watch?v=5FoYxzPZDuw&feature=youtu.be CC By
 * Open Standards for open Formats, Open Data - http://semanticweb.com/open-standards-for-data-formats-and-open-data_b77 Semantic Web focused
 * The Open Data Workflow - http://www.w3.org/2012/06/pmod/pmod2012_submission_21.pdf W3C Position Paper
 * 5 Star Data - http://5stardata.info/ Based on Tim Berners-Lee's modelling

Technology, information governance, management

 * Tim Berners-Lee: The Year Open Data went Worldwide - http://www.ted.com/talks/tim_berners_lee_the_year_open_data_went_worldwide.html
 * Open Standards in the UK - http://radar.oreilly.com/2012/05/uk-open-standards-software.html
 * Who represents all the data? - http://blogs.gartner.com/andrea_dimaio/2012/05/14/open-data-and-the-new-divide/

Government, Gov Agencies, Gov funded projects

 * Australian Government project to build new infrastructure specifically for the needs of Australian researchers - http://nectar.org.au NeCTAR
 * Department of Finance and Deregulation endorse Gov 2.0 Task Force recommendation to make all Public Service Information default to a copyright license of Creative Commons Attribution - http://agimo.govspace.gov.au/2010/10/07/government-2-0-update-%E2%80%93-amended-ip-principles-released/
 * NHMRC Mandates open access - http://theconversation.edu.au/all-research-funded-by-nhmrc-to-be-accessible-free-of-charge-5486
 * UK Mandates Open Access - http://blogs.nature.com/news/2012/05/key-questions-in-the-uks-shift-to-open-access-research.html
 * http://www.guardian.co.uk/technology/2012/may/01/wikipedia-research-jimmy-wales-online
 * http://openaccess.eprints.org/index.php?/categories/1-Self-Archiving-Mandates


 * USA Federal Research Public Access Act (FRPAA) to make all publicly funded research open access within 6 months - http://creativecommons.org/tag/frpaa
 * Research Data Australia is a discovery service for Australian research data. - http://services.ands.org.au/home/orca/rda/
 * GovHack, a meetup for, and Au$30000 prize money for, the best mashup of government data - http://www.govhack.org/
 * Data.Gov - http://www.data.gov/
 * Data.Gov (Aust) - http://data.gov.au/
 * Data.NSW - http://data.nsw.gov.au/
 * Data.VIC - http://www.data.vic.gov.au/
 * AusGOAL - Federating Government Data Portals - http://www.ausgoal.gov.au/data.x.gov.au
 * Australian Cultural data - http://www.culturaldata.gov.au/
 * Canada's Action Plan on Open Government - http://www.open.gc.ca/index-eng.asp Based on "Three Pillars" of Open Data, Open Dialogue, and Open Information
 * Open Government Partnership - http://www.opengovpartnership.org/open-government-declaration
 * British Library Metadata Services - Free Data Services - http://www.bl.uk/bibliographic/datafree.html/
 * UK Govt Open data Consultation - http://data.gov.uk/opendataconsultation

Universities, Research Institutes, Research Projects

 * Amgen’s incomplete report on an early major trial of epoetin misled the medical community about the anemia drug’s risks and benefits—and helped make Amgen rich - http://the-scientist.com/2012/05/14/opinion-misleading-drug-trials/
 * Lack of data leading to poor policy in the handling of epidemics - http://the-scientist.com/2012/05/01/data-diving/
 * Association of College & Research Libraries (US) - Scholarly Communication Toolkit: Open Data, Open Science, Open Educational Resources - http://www.scholcomm.acrl.ala.org/node/50
 * The denton Declaration - An Open Data Manifesto - http://openaccess.unt.edu/denton_declaration

Associations, NGOs, other organisations
Wikipedia
 * List of organisations promoting open data - http://en.wikipedia.org/wiki/Open_data#Organisations_promoting_open_data
 * Project to pick up ABS data and present it in Wikipedia pages http://lists.wikimedia.org/pipermail/wikimediaau-l/2012-May/003295.html
 * Wikidata - http://meta.wikimedia.org/wiki/Wikidata

Wikibooks
 * http://en.wikibooks.org/wiki/Open_Metadata_Handbook

Others
 * Linking open data - http://www.researchpipeline.com/mediawiki/index.php?title=Linking_Open_Data
 * Linking open data - http://linkeddata.org/
 * Open Data Commons - http://opendatacommons.org/
 * Data Journalism - http://datajournalismhandbook.org/
 * Coalition for Networked Information - http://www.cni.org/
 * Open Grid Forum (formerley Global Grid Forum) - http://www.ogf.org/
 * Open Source Big Data - http://www.gridgain.com/
 * Open Data Institute - http://theodi.org/drupal7/ Tim Berners-Lee behind this
 * Open Data Alliance - http://www.opendatacenteralliance.org/ Founded 2010; led by Intel; corporate consortium
 * Open Data Group - http://opendatagroup.com/ Consultancy focused on predictive models, big data, & analytics
 * OASIS (Advancing Open Standards for the Information Society) - https://www.oasis-open.org/
 * Open Data Format Initiative - http://odfi.org/
 * Global Learning Resource Connection - http://www.jesandco.org/weblink-cat-ourprojects/web-cat-glrc
 * DataKind Data Dive - http://datakind.org/york-city-datadive/

Models, Specifications & Protocols, Licenses

 * OData - http://www.odata.org/ An initiative of OASIS
 * Open Archives Initiative - http://www.openarchives.org/OAI/openarchivesprotocol.html This has been a very important protocol in the historical development of the Web in relation to sharing of digital collections.
 * OpenMAMA Project - http://www.openmama.org/ Middleware Agnostic Messaging API (MAMA)
 * Open Conceptual Data Models http://virtuoso.openlinksw.com/whitepapers/open%20conceptual%20data%20models.html
 * Open Data Model - http://www.opendatamodel.com/ Focused on database design
 * Open Data Format - http://ewh.ieee.org/cmte/psace/CAMS_taskforce/format.htm sponsored by IEEE
 * City of Vancouver Open Data Formats - http://data.vancouver.ca/dataFormats.htm
 * GOM Inspection Exchange Format - http://www.gom.com/3d-software/open-data-formats.html 3D datasets
 * Common Data Format - http://cdf.gsfc.nasa.gov/ Led by NASA
 * Microformats - http://microformats.org/
 * British Library Data Model - http://talis-systems.com/2011/07/british-library-data-model-overview/
 * Open Data Commons Licenses - http://opendatacommons.org/licenses/
 * XTF eXtensible Text Format - http://xtf.cdlib.org/

Directories and portals to open data internationally
A good overview of current public data sets is given on: http://maps.google.at/maps/ms?ie=UTF8&source=embed&oe=UTF8&msa=0&msid=105833408128032902805.00048bfbba4ecb314e822&ll=31.952162,7.734375&spn=117.143188,352.265625&z=1

This is part of the Austrian Linked Data portal at: http://gov.opendata.at/site/node/38 The main European meta site for public data can be found at: http://www.publicdata.eu/ This is an outcome of the LOD2 project: http://lod2.eu/Welcome.html Probably the most comprehensive public data initiative next to the one of the UK and the US is the French public data portal: http://www.data.gouv.fr/ A repository for Linked Open Data can be found at: http://thedatahub.org/ A validator for the most recent additions to the DataHub can be found at: http://www4.wiwiss.fu-berlin.de/lodcloud/ckan/validator/ The newest Linked Data Cloud will probably be published in the next two weeks at: http://richard.cyganiak.de/2007/10/lod/

12 Sep 2012
IMM and CSLLD Teleconference

Kathryn Moyle tabled an initial and very rough draft of the report, mostly to check that the style and direction of it was consistent with IMM's expectations. It was agreed that it was, and the Kathryn would continue developing the report, including notation to data captured in the survey, and drawing from information recorded on this wiki.

Some discussion was had reflecting on the poor response rate to the survey (10 entries only) despite email and telephone efforts to encourage responses, and then offerings to enter information on behalf of projects if they were simply nominated with a name of URL. The poor response is considered information in itself, and could be used to inform some level of critical discourse on open data as a movement.

The final draft of the report will be prepared by end of September, including the information captured in the survey and documented in the wiki discussion page. The report will be copied into the Wikibook, and IMM will consider using the report to inform their own publications.

3 May 2012
IMM and CSLLD Teleconference:

Motivation for commissioning the work:

doing something different not just benchmarking best practice or getting "how to" from other players

Who do we anticipate being the audience:
 * people working with data
 * Those implicated for organisational change - policy makers, organisational development etc

Definition of Open Data: Partly to come from the project, partly informed by existing definitions. References to come. We will problematise the definition of open data - how it is perceived within the environment

Which organisations to focus on to start? (based on what our group knows now):

Victorian government - Nadia Mecoi - Nadia Mecoli SA government - Bryan King NZ government - Keitha Booth

Next meetings: Morning of 28th May 2012

Issues arising during investigation
The following comments are observations & anecdotal comments based upon communications with stakeholders:


 * 1) Academics, while overwhelming in their support for the benefits of open access and free software, generally do not want to share their data because of "intellectual property".
 * 2) Services such as ANDS (Australian National Data Service) have currently put in place infrastructure that may serve as a useful foundation for open data & greater public access to publicly-funded research. However, most entries in the ANDS registry to date require significant further investigation to track down how to access the resources listed or described
 * 3) Discussion in this wiki is not easily triggered in this "Discuss" section
 * 4) There appears to be an assumption by some prominent communities that the "open data" agenda is being led by the Open Government movement Open Data Emerges as a Global Movement. Such an assumption appears to be questionable given the other facets to openness associated with the Internet (architecture, source code, standards, educational resources, access, etc).
 * 5) In September, Wikileaks was entered into the our survey collecting information about open data projects. Receiving this response posses a number of interesting questions around the similarities and differences between the motivations, methods and principles of a project like Wikileaks, and the seemingly wide growth of open government data projects world wide, and the open government or "gov2.0" movement.
 * 6) There has been a very poor response rate to the open survey (9 responses), despite the survey going out to major forums, twitter channels, to Offices of Information Ministers known to be engaging in open data initiatives, and direct telephone calls with offers to enter information to the survey on behalf of projects, if those called could just nominate a project. This poor response rate raises a number if old and new issues, such as whether open surveys are an effective instrument and method; whether the design and implementation of this particular survey was suitable (we did have it reviewed by several critical friends however), if simply we did not reach far enough into the open data networks (suggested by the majority of the entries being local to us)... or perhaps the poor response signals some other areas in need of consideration. If there has been a poor response from people inside the open data movement, and if part of their premise of that movement is that open data (especially government data) will improve democratic engagement, or enable crowd based resourcing, then a poor response rate to an open survey targeting people engaged in open data suggests that such a premise may be questionable, at least in this point in time...