Visualization continues to mature and focus more on the data first than on novel designs and size. People improved on existing forms and got better at analysis. Readerships seemed to be more ready and eager to explore more data at a time. Fewer spam graphics landed in my inbox. So all in all, 2013 was a pretty good year for data and visualization. Let's have a look back.
Saturday, December 21, 2013
The Best Data Visualizations of 2013 - Gizmodo
From: http://gizmodo.com/the-best-data-visualizations-of-2013-1485611407
Tuesday, December 10, 2013
The use of registers in the context of EU–SILC - Eurostat
From: http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/KS-TC-13-004/EN/KS-TC-13-004-EN.PDF
The European Union Statistics on Income and Living Conditions (EU-SILC) instrument is the main data source on income, poverty, social exclusion and living conditions in Europe. It provides the data for the
calculation of the Europe 2020 social inclusion target and further EU flagship indicators in the social field. In the current financial and economic crisis, the pressure for timelier and more comprehensive data on poverty and social exclusion has become very acute. In view of the flexibility of the EU-SILC instrument, which allows countries to combine survey and administrative data source(s), and given the advantages of administrative data in terms of burden, cost and survey error reduction, a broader use of registers, and in particular register income data, for EU-SILC is envisaged among Member States.
Friday, December 6, 2013
China turns to big data to gauge inflation - China Daily
2013-12-06 13:42
China DailyWeb Editor: qindexing
China DailyWeb Editor: qindexing
Share on sinaweiboShare on twitterShare on facebookMore Sharing Services
Through teaming up with high-tech companies, China's National Bureau of Statistics will start using big data technology to improve the collecting, processing and producing of the country's consumer price index, a key gauge of inflation.
Xian Zude, chief statistician with the NBS, said in an interview with xinhuanet.com on Wednesday that his bureau will use big data to achieve a "breakthrough" in the census of the CPI.
He added that the bureau will include data from Chinese e-commerce companies in official statistics in an effort to bring the CPI census to the next level and ease the time-consuming tasks of those doing the censuses and surveys.
Monday, December 2, 2013
Solving Big Data’s big skills shortage - The Conversation
From: http://theconversation.com/solving-big-datas-big-skills-shortage-20352
The skills required to tap Big Data include statistics, mathematics, computer science and engineering. Shutterstock.com
According to analyst firm vpnMentor, Big Data is at the portion of the hype cycle called the “peak of inflated expectations”.
The business world is awash with all sorts of claims about the magic of Big Data and how it will transform industries by increasing productivity and profits and opening up opportunities that nobody even knew existed.
But this will only happen if companies are able to hire enough people who actually understand what Big Data is, how to collect it, and preserve it. Computing and analytical skills are also required to get Big Data to reveal its hidden secrets and visualise it in novel ways. And there unfortunately, is the rub. There are just not enough data scientists, people with the required skills to satisfy this unmet demand.
The shortfall in Big Data experts is set to rise and in the UK alone, one digital industries employer body has predicted there will be a need for 69,000 of these experts in the next five years. This claim is not original. Back in 2011, McKinsey & Co was claiming a US shortfall in Big Data experts of 140,000 - 190,000 by 2018.
The shortfall in Big Data experts is being manifested in a number of ways. The first and most obvious is through recruiters casting an ever-widening net in their search for appropriate talent.
There is some agreement that Big Data analysis and data visualisation requires skills in computing as well as statistics and mathematics. This has meant that university graduates with statistics, computer science and engineering have been the main source of potential employees. --------
|
Friday, November 1, 2013
Charts that changed the world—way before big data
By: Eric Rosenbaum | CNBC.com
|
|
|
Source: Tableau Software
Some years ago I was sent by an employer to a one-day course taught by Yale professor emeritus Edward Tufte on presenting data and information. This was a decade before big data was a buzz term and companies in the business of data visualization, like Tableau Software, were going public to a very enthusiastic investor market.
Data visualization is a growing field in which massive amounts of data are measured in quantities reaching exabytes and crunched by an ever-increasing number of Silicon Valley servers ultimately to be presented in visual displays. How the intersection of data, analytics and business evolves is an open question. But according to Tableau CEO Christian Chabot in a presentation to data geeks earlier this year, some of the world's greatest thinkers gained tremendous insight and changed the world simply by organizing and deciphering basic data sets in new ways.
UK Government publishes data capability strategy
From: StatsLife
Written by Web News Editor on . Posted in News
Written by Web News Editor on . Posted in News
The government, in partnership with the recently formed Information Economy Council, has just published its Data Capability Strategy, which outlines how the opportunities in open/big data might be utilised for the benefit of all.
Titled ‘Seizing the Data Opportunity’, the strategy begins with the premise that the increasing significance of data is ‘one of the greatest opportunities and challenges facing policymakers today.’ It cites figures by the Centre for Economics and Business Research which estimates that the big data marketplace could create 58,000 new jobs in the UK between 2012 and 2017.
Read more...
Read more...
Thursday, October 31, 2013
Wednesday, October 30, 2013
Simply Statistics Unconference on the Future of Statistics
From: http://www.youtube.com/watch?v=Y4UJjzuYjfM&feature=share
Twitter flow: https://twitter.com/search?q=%23futureofstats&src=typd
Twitter flow: https://twitter.com/search?q=%23futureofstats&src=typd
Tuesday, October 1, 2013
Tuesday, September 10, 2013
Essential Collection of Visualisation Resources
From: http://www.visualisingdata.com/index.php/resources/
More ......
Here is a collection of some of the most important, effective, useful and practical data visualisation tools. The content covers the many different resources used to create and publish visualisations, tools for working with colour, packages for handling data, places to obtain data, the most influential books and educational programmes and qualifications in visualisation itself.
Data and visualisation tools
Saturday, August 31, 2013
EU - Consultation on best ways to open up more public data
From: http://www.investineu.com/content/consultation-best-ways-open-more-public-data-12c3
Consultation on best ways to open up more public data
The Commission is asking for help in drawing up guidance and practical advice for boosting the re-use of weather data, traffic data, publicly funded research data, statistics, digitised books, and other types of public sector information (PSI).
Commission Vice President Neelie Kroes said: “The open data revolution is all about individuals and entrepreneurs and that includes the giving them a role in policy design.”
Interested parties can contribute until 22 November 2013, and with their input help ensure effective implementation of the newly revised PSI Directive, which aims to ensure public authorities release more information at little or no cost to users.
“We were successful in finalising a new directive for public sector information. Now we need to implement it in a way that creates a single market for these data, so that companies can build pan-European apps and other innovations. To get Europe-wide value from this data we need the rules to be applied in a clear, common way,” Kroes said
Background
The results of this consultation will support guidelines to be published in 2014. A recent study shows that economic benefits for the EU from easier availability of PSI could reach 40 billion euros annually. The growth rate of companies having access to free PSI is 15% higher than those who need to pay.
Opening up public data resources for re-use is one of the key actions of the Digital Agenda for Europe, however uncertainties surrounding compliance with the licensing and charging provisions have discouraged innovation and commercial deployment of PSI in many parts of the Union.
30 August 2013
Commission Vice President Neelie Kroes said: “The open data revolution is all about individuals and entrepreneurs and that includes the giving them a role in policy design.”
Interested parties can contribute until 22 November 2013, and with their input help ensure effective implementation of the newly revised PSI Directive, which aims to ensure public authorities release more information at little or no cost to users.
“We were successful in finalising a new directive for public sector information. Now we need to implement it in a way that creates a single market for these data, so that companies can build pan-European apps and other innovations. To get Europe-wide value from this data we need the rules to be applied in a clear, common way,” Kroes said
Background
The results of this consultation will support guidelines to be published in 2014. A recent study shows that economic benefits for the EU from easier availability of PSI could reach 40 billion euros annually. The growth rate of companies having access to free PSI is 15% higher than those who need to pay.
Opening up public data resources for re-use is one of the key actions of the Digital Agenda for Europe, however uncertainties surrounding compliance with the licensing and charging provisions have discouraged innovation and commercial deployment of PSI in many parts of the Union.
30 August 2013
Open data & storytelling - 4 presentations from the Nordic Statistical Meeting 2013
Open Data - Experiences from a National statistical office's point of view
Heli Mikkelä
Statistics Finland
Statistical storytelling and quality in the age of open data
Maija Metsä-Pauri and Kirsti Ahlqvist
Statistics Finland
Åpne data – en ny åpning for statistikkbyråene
Jan Bruusgaard
Statistisk sentralbyrå
API:er ett nytt sätt att tillhandahålla öppna data, nyttan för oss och våra användare
Åsa Olsson
Statistiska centralbyrån
Sunday, August 4, 2013
CIO - Big data may build better profile of Australians
From: http://www.cio.com.au/article/522550/big_data_may_build_better_profile_australians_statistician_/
Information could be used in future censuses, says Jonathan Palmer
Hamish Barwick (CIO)
01 August, 2013
Location information from mobile phones could lead to more dynamic pictures of population counts according to an Australian statistician.
Speaking at a Teradata summit in Sydney, Australian Bureau of Statistics (ABS) deputy Australian statistician, Jonathan Palmer, told delegates that this may enhance census information in the future.
Information could be used in future censuses, says Jonathan Palmer
Hamish Barwick (CIO)
01 August, 2013
Location information from mobile phones could lead to more dynamic pictures of population counts according to an Australian statistician.
Speaking at a Teradata summit in Sydney, Australian Bureau of Statistics (ABS) deputy Australian statistician, Jonathan Palmer, told delegates that this may enhance census information in the future.
Friday, August 2, 2013
itnews - ABS prepares big data transformation
From: http://www.itnews.com.au/News/352003,abs-prepares-big-data-transformation.aspx
By Paris Cowan on Aug 2, 2013 7:10 AM (15 hours ago)
The Australian Bureau of Statistics has begun an IT transformation aimed at tackling an incoming "big data tsunami" which the agency's COO is hoping will include more personal data from citizens.
The ABS' technology infrastructure transformation will be the biggest undertaken at the department and will include serious work on renewing metadata systems and processes.
By Paris Cowan on Aug 2, 2013 7:10 AM (15 hours ago)
The Australian Bureau of Statistics has begun an IT transformation aimed at tackling an incoming "big data tsunami" which the agency's COO is hoping will include more personal data from citizens.
The ABS' technology infrastructure transformation will be the biggest undertaken at the department and will include serious work on renewing metadata systems and processes.
Tuesday, July 23, 2013
Statistics and open data
11 July 2013
The Public Administration Select Committee (PASC) is conducting an inquiry into statistics and open data in Government, with a focus on the progress of the Government in implementing its Open Data strategy. This is part of PASC’s programme of work on statistics and their use in Government.
Monday, June 3, 2013
Is Quandl the easiest way to find and use numerical data on the internet?
From: http://www.quandl.com/about
Quandl has indexed over 5 million time-series datasets from over 400 sources. All of Quandl's datasets are open and free.
You can download any Quandl dataset in any format that you want. You can also visualize, save, share, authenticate, validate, upload, index, merge and transform data .
Our long-term goal is to make all the numerical data on the internet easy to find and easy to use.
Quandl has indexed over 5 million time-series datasets from over 400 sources. All of Quandl's datasets are open and free.
You can download any Quandl dataset in any format that you want. You can also visualize, save, share, authenticate, validate, upload, index, merge and transform data .
Our long-term goal is to make all the numerical data on the internet easy to find and easy to use.
Further Reading
Learn more about Quandl:
Learn more about Quandl:
- Quandl's long-term goal is to make all the numerical data on the internet easy to find and easy to use. Read more on our vision page.
- Quandl currently has over 5 million datasets from over 400 sources. Explore Quandl's data on our sources page.
- Every dataset on Quandl is available via a simple and consistent API.
- You can also access Quandl data using our R, Python, Matlab, Excel, Maple, Julia, Clojure, and Stata packages.
- Check out what's new on Quandl (data, features, topics).
- Explore Quandl's features and what we've got planned for the future. If you have suggestions, please email us.
- Learn how developers are building innovative applications that use the Quandl data platform, on our partners page.
- Questions or comments? See help or email us.
- Quandl is a collaborative project. Find out how you can get involved on our community page.
Monday, April 22, 2013
Statistics Sweden’s statistics are available for new services
From: http://www.scb.se/Pages/List____354067.aspx
Now companies and private individuals have access to Statistics Sweden’s statistics, which can be used for new products and services. This involves data from the Statistical Database that can be digitally transferred via a programming interface called an API.
APIs (Application Programming Interface) can be processed and used, for example, to build apps for smartphones or new web services. You can use tables or parts of tables from the Statistical Database at Statistics Sweden free of charge.
The ambition of the Swedish Government's digital agenda is to improve conditions for the reuse of public information from government agencies for both commercial and non-profit purposes. This is also regulated in the PSI Directive and the INSPIRE directive from the EU.
Now companies and private individuals have access to Statistics Sweden’s statistics, which can be used for new products and services. This involves data from the Statistical Database that can be digitally transferred via a programming interface called an API.
APIs (Application Programming Interface) can be processed and used, for example, to build apps for smartphones or new web services. You can use tables or parts of tables from the Statistical Database at Statistics Sweden free of charge.
The ambition of the Swedish Government's digital agenda is to improve conditions for the reuse of public information from government agencies for both commercial and non-profit purposes. This is also regulated in the PSI Directive and the INSPIRE directive from the EU.
Saturday, April 13, 2013
Friday, April 12, 2013
New U.S and World Population Clock from the Census Bureau
View THE CENSUS BUREAU’S NEW POPULATION CLOCK to see an interactive projection of the population, including the rate of births, deaths and net migration. Explore tables on the most populous countries in the world, as well as the most populous states, cities and counties in the U.S.
Friday, April 5, 2013
US Census Bureau Named a 2013 Computerworld Honors Laureate for Open Data API
From: http://blog.programmableweb.com/2013/04/04/us-census-bureau-named-a-2013-computerworld-honors-laureate-for-open-data-api/
Janet Wagner, April 4th, 2013
Computerworld has named the US Census Bureau a 2013 Honors Laureate for the development of the US Census Bureau API which was released in July 2012 and is the first-ever API released to the public by the US Census Bureau.
Wednesday, March 27, 2013
Big Data and official statistics
From: http://www.bruegel.org/nc/blog/detail/article/1059-blogs-review-big-data-aggregates-and-individuals/#.UVL84BxhWCk
Big Data is relevant to the production, relevance and reliability of key official statistics such as GDP and inflation.
Michael Horrigan, the head of the Bureau of Labor Statistics (BLS) Office of Prices and Living Conditions, provides a definition that helps clarify where the border lies between Big Data and traditional data. Big Data are non-sampled data that are characterized by the creation of databases from electronic sources whose primary purpose is something other than statistical inference.
Read more....
Big Data is relevant to the production, relevance and reliability of key official statistics such as GDP and inflation.
Michael Horrigan, the head of the Bureau of Labor Statistics (BLS) Office of Prices and Living Conditions, provides a definition that helps clarify where the border lies between Big Data and traditional data. Big Data are non-sampled data that are characterized by the creation of databases from electronic sources whose primary purpose is something other than statistical inference.
Read more....
Wednesday, March 13, 2013
UNSD - Big Data for Policy, Development and Official Statistics
From: http://unstats.un.org/unsd/statcom/statcom_2013/seminars/Big_Data/default.html
The theme of this year’s Friday Seminar on Emerging Issues is: “Big Data for Policy, Development and Official Statistics”. The advent of the Internet, mobile devices and other technologies has caused a fundamental change to the nature of data. Big Data has important, distinct qualities that differentiate it from “traditional” institutional data, in particular the timeliness of the data. If governments wanted to, they could already let Big Data (and the private sector) play a role in providing information on topics that are currently under the purview of national statistical offices. Should these NSOs change their business operations to take on the opportunities of using Big Data for official government purposes?
Please find below the provisional programme, the Key Questions and the Concept Note on Big Data for Policy, Development and Official Statistics. We encourage you to carefully read the key questions and to consider what they would imply for the work of your office. We are looking forward to your participation in this year’s Friday Seminar on Big Data.
Organizer: United Nations Statistics Division (UNSD) |
Morning Session, 10:00 - 13:00
| |
Chairperson: T.C. Anant, Chief Statistician, India | |
Panelists:
| - Hal Varian, Chief Economist, Google (Video) |
- Matt Wood, Chief Data Scientist, Amazon Web Services | |
- James Goodnight, Chief Executive Officer, SAS | |
- Robert Kirkpatrick, Director, UN Global Pulse | |
- Andrew Wyckoff, Director, Science, Technology and Industry, OECD | |
Discussion | |
Demonstrations Session, 14:00 - 15:00
| |
- Howard Hamilton, Statistical Institute of Jamaica | |
- Statistical Institute of Jamaica , Video | |
- Matthias Helble, Universal Postal Union | |
- SAS | |
Afternoon Session, 15:00 - 18:00
| |
Chairperson: Brian Pink, Chief Statistician, Australia | |
Panelists:
| - Gosse Van der Veen, Chief Statistician, Netherlands , Video |
- William Bostic Jr., Associate Director, US Census Bureau | |
- Ki-Jong Woo, Commissioner, Statistics Korea | |
- Pali Lehohla, Chief Statistician, South Africa | |
Discussion | |
Background documents
| |
1. Key questions | |
2. Concept note | |
Thursday, March 7, 2013
Placing Big Data in Official Statistics: A Big Challenge?
From: http://www.cros-portal.eu/content/ntts-2013-programme
Slides: http://www.cros-portal.eu/sites/default/files//15A02_214_0.pdf
Monica Scannapieco1, Antonino Virgillito2, Diego Zardetto3
1Istat - Italian National Institute of Statistics, e-mail: scannapi@istat.it
2Istat - Italian National Institute of Statistics, e-mail: virgilli@istat.it
3Istat - Italian National Institute of Statistics, e-mail: zardetto@istat.it
Abstract
Big Data refers to data sets that are impossible to store and process using common
software tools, regardless of the computing power or the physical storage at hand. The
Big Data phenomenon is rapidly spreading in several domains including healthcare,
communication, social sciences and life sciences, just to cite some relevant examples.
However, the opportunities and challenges of Big Data in Official Statistics are matter of
an open debate that involves both statisticians and IT specialists of National Statistical
Institutes.
In this paper, we first analyse the concept of Big Data under the Official Statistics
perspective by identifying its potentialities and risks. Then, we provide some examples
that show how NSIs can deal with such a new paradigm by adopting Big Data
technologies, on one side, and rethinking methods to enable sound statistical analyses on
Big Data, on the other side.
Paper: http://www.cros-portal.eu/sites/default/files/NTTS2013fullPaper_214.pdf
Tuesday, March 5, 2013
Live webstreaming of NTTS 2013
If you're not able to attend NTTS 2013 in Brussels, you may still follow the conference online.
All sessions in the main auditorium (including the opening session, the closing session and all keynote speeches) will be transmitted via live webstreaming on the following addresses (separate address for each day):
5 March
http://scic.ec.europa.eu/streaming/index.php?es=2&sessionno=b994697479c5716eda77e8e9713e5f0f
6 March
http://scic.ec.europa.eu/streaming/index.php?es=2&sessionno=eb1848290d5a7de9c9ccabc67fefa211
7 March
http://scic.ec.europa.eu/streaming/index.php?es=2&sessionno=91e50fe1e39af2869d3336eaaeebdb43
All sessions in the main auditorium (including the opening session, the closing session and all keynote speeches) will be transmitted via live webstreaming on the following addresses (separate address for each day):
5 March
http://scic.ec.europa.eu/streaming/index.php?es=2&sessionno=b994697479c5716eda77e8e9713e5f0f
6 March
http://scic.ec.europa.eu/streaming/index.php?es=2&sessionno=eb1848290d5a7de9c9ccabc67fefa211
7 March
http://scic.ec.europa.eu/streaming/index.php?es=2&sessionno=91e50fe1e39af2869d3336eaaeebdb43
Subscribe to:
Posts (Atom)