It’s been ten years since open data first broke onto the global stage. Over the past decade, thousands of programmes and projects around the world have worked to open data and use it to address a myriad of social and economic challenges. Meanwhile, issues related to data rights and privacy have moved to the centre of public and political discourse. As the open data movement enters a new phase in its evolution, shifting to target real-world problems and embed open data thinking into other existing or emerging communities of practice, big questions still remain. How will open data initiatives respond to new concerns about privacy, inclusion, and artificial intelligence? And what can we learn from the last decade in order to deliver impact where it is most needed? The State of Open Data brings together over 60 authors from around the world to address these questions and to take stock of the real progress made to date across sectors and around the world, uncovering the issues that will shape the future of open data in the years to come.

The Future of Open Data flows from a multi-year Social Sciences and Humanities Research Council (SSHRC) Partnership Grant project that set out to explore open government geospatial data from an interdisciplinary perspective. Researchers on the grant adopted a critical social science perspective grounded in the imperative that the research should be relevant to government and civil society partners in the field. This book builds on the knowledge developed during the course of the grant and asks the question, “What is the future of open data?” The contributors’ insights into the future of open data combine observations from five years of research about the Canadian open data community with a critical perspective on what could and should happen as open data efforts evolve. Each of the chapters in this book addresses different issues and each is grounded in distinct disciplinary or interdisciplinary perspectives. The opening chapter reflects on the origins of open data in Canada and how it has progressed to the present date, taking into account how the Indigenous data sovereignty movement intersects with open data. A series of chapters address some of the pitfalls and opportunities of open data and consider how the changing data context may impact sources of open data, limits on open data, and even liability for open data. Another group of chapters considers new landscapes for open data, including open data in the global South, the data priorities of local governments, and the emerging context for rural open data.

The rise of open data in the public sector has sparked innovation, driven efficiency, and fueled economic development. While still emerging, we are seeing evidence of the transformative potential of open data in shaping the future of our civic life, and the opportunity to use open data to reimagine the relationship between residents and government, especially at the local level. As we look ahead, what have we learned so far from open data in practice and how we can apply those lessons to realize a more promising future for America's cities and communities? Edited by Brett Goldstein, former Chief Data Officer for the City of Chicago, with Code for America, this book features essays from over twenty of the world's leading experts in a first-of-its-kind instructive anthology about how open data is changing the face of our public institutions. Contributors include: Michael Flowers, Chief Analytics Officer, New York City Beth Blauer, former director of Maryland StateStat Jonathan Feldman, CIO, City of Asheville Tim O'Reilly, founder & CEO, O'Reilly Media Eric Gordon, Director of Engagement Game Lab, Emerson College Beth Niblock, CIO, Louisville Metro Government Ryan & Mike Alfred, Co-Founders, Brightscope Emer Coleman, former director of the London Datastore Mark Headd, Chief Data Officer, City of Philadelphia "As an essential volume for anyone interested in the future of governance, urban policy, design, data-driven policymaking, journalism, or civic engagement, "Beyond Transparency" combines the inspirational glow and political grit of Profiles in Courage with the clarity of an engineer's calm explanation of how something technical actually works. Here are the detailed how-to stories of many members of the first generation of open government pioneers, written in a generous, accessible style; this compilation presents us with a great deal to admire, ample provocation, and wise guidance from a group of remarkable individuals." -Susan Crawford, author of Captive Audience "Just as he did during his time in my administration, Goldstein has brought together industry leaders to discuss issues of relevance in the open data movement and the practical implications of implementing these policies... This book will help continue the work to make open government a reality across the country." - Mayor Rahm Emanuel, City of Chicago "A must-read for anyone who is passionate about what open data can do to transform city living." - Boris Johnson, Mayor of London

This book looks at open data practices historically and from the perspective of those currently involved in advocating for making government data freely available. Based on interviews with practitioners, users and evangelists across three Australian-based case studies illustrating contemporary open data practices, this book discusses how open data has evolved, why certain barriers to openness exist and what the future of open data might look like. It highlights both the challenges and approaches to ‘best practice’ in government departments and agencies as they adapt to changing data ecosystems and public expectations around access, transparency, risk and responsible stewardship.

Introduction -- Array-based lists -- Linked lists -- Skiplists -- Hash tables -- Binary trees -- Random binary search trees -- Scapegoat trees -- Red-black trees -- Heaps -- Sorting algorithms -- Graphs -- Data structures for integers -- External memory searching.

In a world where web services can make real-time data accessible to anyone, how can the government leverage this openness to improve its operations and increase citizen participation and awareness? Through a collection of essays and case studies, leading visionaries and practitioners both inside and outside of government share their ideas on how to achieve and direct this emerging world of online collaboration, transparency, and participation. Contributions and topics include: Beth Simone Noveck, U.S. Deputy Chief Technology Officer for open government, "The Single Point of Failure" Jerry Brito, senior research fellow at the Mercatus Center at George Mason University, "All Your Data Are Belong to Us: Liberating Government Data" Aaron Swartz, cofounder of reddit.com, OpenLibrary.org, and BoldProgressives.org, "When Is Transparency Useful?" Ellen S. Miller, executive director of the Sunlight Foundation, "Disrupting Washington's Golden Rule" Carl Malamud, founder of Public.Resource.Org, "By the People" Douglas Schuler, president of the Public Sphere Project, "Online Deliberation and Civic Intelligence" Howard Dierking, program manager on Microsoft's MSDN and TechNet Web platform team, "Engineering Good Government" Matthew Burton, Web entrepreneur and former intelligence analyst at the Defense Intelligence Agency, "A Peace Corps for Programmers" Gary D. Bass and Sean Moulton, OMB Watch, "Bringing the Web 2.0 Revolution to Government" Tim O'Reilly, founder and CEO of O'Reilly Media, "Defining Government 2.0: Lessons Learned from the Success of Computer Platforms" Open Government editors: Daniel Lathrop is a former investigative projects reporter with the Seattle Post Intelligencer who's covered politics in Washington state, Iowa, Florida, and Washington D.C. He's a specialist in campaign finance and "computer-assisted reporting" -- the practice of using data analysis to report the news. Laurel Ruma is the Gov 2.0 Evangelist at O'Reilly Media. She is also co-chair for the Gov 2.0 Expo.

Recent years have witnessed considerable speculation about the potential of open data to bring about wide-scale transformation. The bulk of existing evidence about the impact of open data, however, focuses on high-income countries. Much less is known about open data’s role and value in low- and middle-income countries, and more generally about its possible contributions to economic and social development. Open Data for Developing Economies features in-depth case studies on how open data is having an impact across the developing world-from an agriculture initiative in Colombia to data-driven healthcare projects in Uganda and South Africa to crisis response in Nepal. The analysis built on these case studies aims to create actionable intelligence regarding: (a) the conditions under which open data is most (and least) effective in development, presented in the form of a Periodic Table of Open Data; (b) strategies to maximize the positive contributions of open data to development; and (c) the means for limiting open data’s harms on developing countries.