Earth Science Data Analytics/2014-10-23 Telecon
ESDA Telecom notes – 10/23/14
Known Attendees:
To Be Provided
Agenda:
1 – Steve Kempler - Recap of our last telecon on Descriptive Analytics
2 – Guest Speakers: George Djorgovski, Cal Tech, who is interested in the roles of computation in knowledge discovery.
3 – Discussion: Diagnostic Analytics
4- Steve Kempler - Planning Ahead Discussion
Presentations:
Notes:
Thank you all for attending a very interesting and 'getting more focused' telecon. Much appreciation goes to our speaker, Dr. George Djorgovski, who gave his all interesting insights on the complexity of data analysis, as we are beginning to know it, today.
After a review of the highlights from our Frisco Cluster Meeting, and the discussion about Descriptive Data Analytics from our August telecon (see link to presentation, above), Dr. Djorgovski provided discussion (unfortunately no slides) on his experiences in working with large amounts of multi-variant data. Some of the main points I was able to extract (others please edit in your highlights) include:
- Not only are we dealing with large amounts of data, but we are also dealing with increasing data growth
Next, we reviewed the various types of Data Analytics, with the objective to clarify and specifically define, one by one, each type of data analytics. Our goal is to clearly characterize data analytics by types in terms of their purpose, available tools, users, usages, and use cases. Through this ordering, we (hopefully) will be able to enable analytics connections, and identify gaps per specific community. Right now, as we learn more about this data analytics, we seem to be throwing every use case, user, etc. in the same sink. However, by applying definitions, we will be able to make clear connections between particular data analytics usage scenarios: of the same type; that share tools; have common methodologies.
Types of Data Analytics
Descriptive Analytics: You can quickly understand "what happened" during a given period in the past and verify if a campaign was successful or not based on simple parameters.
Diagnostic Analytics: If you want to go deeper into the data you have collected from users in order to understand "Why some things happened," you can use … intelligence tools to get some insights.
Discoveritive Analytics: The use of data and analysis tools/models to discover information
Predictive Analytics: If you can collect contextual data and correlate it with other user behavior datasets, as well as expand user data … you enter a whole new area where you can get real insights.
Prescriptive Analytics: Once you get to the point where you can consistently analyze your data to predict what's going to happen, you are very close to being able to understand what you should do in order to maximize good outcomes and also prevent potentially bad outcomes. This is on the edge of innovation today, but it's attainable!
At this telecon, we tackled the first type of Data Analytics: Descriptive Analytics.
The following Descriptive Analytics definitions were offered:
Descriptive Analytics: You can quickly understand "what happened" during a given period in the past and verify if a campaign was successful or not based on simple parameters.
What does Descriptive Data Analytics mean? What does it do? How it is used? Examples! Where in Earth science would this be used? Which users? - Purpose of descriptive analytics is to summarize and tell you what has happened in the past
- "the simplest class of analytics," one that allows you to condense big data into smaller, more useful nuggets of information. http://community.lithium.com/t5/Science-of-Social-blog/Big-Data-Reduction-2-Understanding-Predictive-Analytics/ba-p/79616
- compute descriptive statistics (i.e. counts, sums, averages, percentages, simple arithmetic) that summarizes certain groupings or filtered version of the data, which are typically simple counts of some events. They are mostly based on standard aggregate functions http://community.lithium.com/t5/Science-of-Social-blog/Big-Data-Reduction-1-Descriptive-Analytics/ba-p/77766
- The purpose of descriptive analytics is simply to summarize and tell you what happened. For example, number of post, mentions, fans, followers, page views, kudos, +1s, check-ins, pins, etc. …simple event counters.
- Other descriptive analytics may be results of simple arithmetic operations, such as share of voice, average response time, % index, average number of replies per post, etc. http://community.lithium.com/t5/Science-of-Social-blog/Big-Data-Reduction-1-Descriptive-Analytics/ba-p/77766
- Following the NetFlix approach, Amazon uses "Descriptive" analytics to process what you have purchased in the past, to predict what books, videos, and things you might like in the future
- Descriptive analytics answers the question, "What happened…?" It looks at data and information to describe the current situation in a way that trends, patterns and exceptions become apparent http://www.mu-sigma.com/analytics/ecosystem/dipp.html
- Descriptive statistics is the discipline of quantitatively describing the main features of a collection of information or the quantitative description http://en.wikipedia.org/wiki/Descriptive_statistics
- Natural Hazards: Looking for Patterns and Trends; Bringing in heterogeneous datasets, together summarized, to detect patterns Erin to provide slides: air quality ‘use case’
Providing additional examples, experiences, and understanding is highly encouraged. Our research, and collective notes could be a huge understanding to the usage of data analytics to advance Earth science.
REMINDER: AGU sessions that pertain to Data Analytics:
- Teaching Science Data Analytics Skills Needed to Facilitate Heterogeneous Data/Information Research: The Future Is Here - Session ID#: 1879
- Identifying and Better Understanding Data Science Activities, Experiences, Challenges, and Gaps Areas - Session ID#: 1809
- Advancing Analytics using Big Data Climate Information System - Session ID#: 3022
- Big Data in the Geosciences: New Analytics Methods and Parallel Algorithm - Session ID#: 3292
- Leveraging Enabling Technologies and Architectures to enable Data Intensive Science - Session ID#: 3041
- Open source solutions for analyzing big earth observation data - Session ID#: 3080
- Technology Trends for Big Science Data Management - Session ID#: 2525
Next Telecon -> Meeting in Frisco:
- October 16, 3:00 EST (Apologies, I will be out of the office 3 Thursdays in September)
- Agenda (as of now)
- Listen and Learn - We will have 2 guest speakers to discuss their Analytics activities
- ESDA Activities - Discuss definitions for Diagnostics and Discoveritive Analytics
- Publish potential - Discuss Cluster collaborative paper loosely entitled: Data Analytics in Earth Science Research… but we can discuss
- Proposed Winter ESIP Meeting sessions
