Difference between revisions of "Cloud Computing"

From Earth Science Information Partners (ESIP)
m (Updates to calendar links)
 
(115 intermediate revisions by 11 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
<big><center>'''Welcome to the Cloud Computing Cluster'''</center></big>
+
<big>See also</big> [[Cloud Computing Cluster Plan 2021]]<big><center>'''Welcome to the Cloud Computing Cluster'''</center></big>
  
The objective of the Cloud Computing Cluster ... Description here. ..
+
==Description and Objectives==
{| width="100%" cellpadding="0" cellspacing="0" style="zborder-top:1px solid #aaaaaa; border-collapse: collapse;"
+
<big>As geospatial computing continues to demand more volume, variety, and velocity, the core characteristics of big data, the Cloud Computing Cluster helps ESIP members tackle these challenges through cloud-based architectures, technologies, and software. By bringing together users, developers, and researchers from industry, government, and academia, this Cluster provides a virtual platform for ESIP members and broader communities to share relevant knowledge and experience. The Cluster also aims to help foster collaborations among different organizations and individuals to work together to better apply cloud technologies to today’s data challenges.</big>
|- valign="top" bgcolor="#FFFFFF"
 
|bgcolor="lightgreen" style="border: 1px solid gray;padding-left:0.5em;padding-right:0.5em;" width="50%"|
 
===What's New ===
 
* 2011-09-.. : Cloud Computing Telecon
 
* July, 2011 Summer Meeting Cluster Formed
 
|bgcolor="lightblue" style="border: 1px solid gray;padding-left:0.5em;padding-right:0.5em;" width="50%"|
 
 
 
===Active Collaborations===
 
|}
 
 
{| width="100%" cellpadding="0" cellspacing="0" style="zborder-top:1px solid #aaaaaa; border-collapse: collapse;"  
 
{| width="100%" cellpadding="0" cellspacing="0" style="zborder-top:1px solid #aaaaaa; border-collapse: collapse;"  
 
|- valign="top" bgcolor="pink"
 
|- valign="top" bgcolor="pink"
|bgcolor="pink" style="border: 1px solid gray;padding-left:0.5em;padding-right:0.5em;" width="50%"|
+
| bgcolor="#FFFFBB" style="border: 1px solid gray;padding-left:0.5em;padding-right:0.5em;" width="50%" |
  
===Resources===
+
===Get Involved===
|bgcolor="#FFFFBB" style="border: 1px solid gray;padding-left:0.5em;padding-right:0.5em;" width="50%"|
 
  
=== Get Involved===
+
*'''Email List:''' [http://lists.esipfed.org/mailman/listinfo/esip-cloud ESIP-Cloud]
* '''Email List:''' [http://rtpnet.org/mailman/listinfo/esip-cloud]
+
*'''Email archive:''' [http://lists.esipfed.org/pipermail/esip-cloud/ ESIP-Cloud Web Email Archive]
* '''Email archive:''' http://rtpnet.org/pipermail/esip-cloud/ ESIP-Cloud Web Email Archive]
+
*Join the conversations on our '''[https://esip-slack-invite.herokuapp.com/ ESIPFed Slack Channel]''' and say hello on #general and #cloud-computing
* '''[[Cloud_Telecons|Telecons:]]'''
+
*'''Join the cloud computing cluster knowledge sharing at the last Monday of the month 1PM EDT via the ESIP Zoom Meeting links'''
** Telecon TIME
+
**https://www.esipfed.org/get-involved/community-calendar
* [[Facebook Instructions|'''Facebook''']]
 
* '''Contact Cluster Chair:''
 
|}
 
  
[[WS::{{PAGENAMEE}}]]
+
Or add the recurring calendar event to your calendar by clicking the following link:
 +
https://calendar.google.com/calendar/render?cid=sb9cnmaknqpsifs7ttn9ksobu0%40group.calendar.google.com
  
 +
*
 +
*'''Contact Cluster Chair:''' Aimee Barciauskas, Jim Coll, Sudhir  Shrestha
 +
*'''Other leads:''' Rich Signell, Rob Casey
  
 +
=== Knowledge Base and Shared Information ===
  
 +
* Cloud Computing Cluster (CCC) Knowledge Base:  https://esipfed.github.io/cloud-computing-cluster/intro.html
  
 +
[[WS::{{PAGENAMEE}}]]
 +
[[category:CollabArea]]
 +
|-
 +
|
 +
|}
  
 +
{| width="100%" cellpadding="0" cellspacing="0" style="zborder-top:1px solid #aaaaaa; border-collapse: collapse;"
 +
|- valign="top" bgcolor="#FFFFFF"
 +
| bgcolor="lightgreen" style="border: 1px solid gray;padding-left:0.5em;padding-right:0.5em;" width="50%" |
 +
We have a regularly scheduled cluster meeting on '''the last Monday of the month 1PM EDT'''. This is a knowledge sharing session with the schedule typically being:
  
  
'''Cloud Computing for Earth Science
+
'''Agenda'''
'''
 
  
Moderator: Phil Yang, NASA Goddard/GMU
+
* 5-10 minutes - Announcements
 +
* 20-30 minutes presentation
 +
* Questions and discussion
  
  
Tuesday Jan 4
+
Meeting Information
  
* 2:00-2:30pm [http://wiki.esipfed.org/images/2/26/GeoCloudBriefing0111.pdf GeoCloud, Doug Nebert, FGDC]
+
'''Join Zoom Meeting'''
* 3:00-3:00pm [http://wiki.esipfed.org/images/1/12/Esip2011cloudcomputing.pdf Cloud Enabled GEOSS clearinghouse, Qunying Huang, GMU]
 
  
 +
https://www.google.com/url?q=https://us02web.zoom.us/j/86535177705?pwd%3Day9yVDJ6UzNiSGRMWTFxbkNXdEJXUT09&sa=D&source=calendar&usd=2&usg=AOvVaw2wk5iYeLOpyw5qCiMdquWO
  
Many Earth science problems cannot be explored by single computers and solved within a single science community, but through distributed computing paradigms and models interdisciplinary efforts, such problems can be tackled effectively. The emergence of cloud computing provides a potential solution to enable the addressing of the Earth science problems. This session provides the latest development on how cloud computing can help Earth sciences and how Earth sciences can help to shape cloud computing?
 
  
This session will include three talks:
 
  
1) Doug Nebert from FGDC will introduce GeoCloud, a cross-agency initiative led by FGDC. In early 2010, FGDC summoned government agencies such as Census, NOAA, USGS, and USDA to deploy their geospatial products and applications onto a cloud environment.  Objectives of this initiative are to define common operating system and software suites for geospatial applications, explore and document deployment and management strategies, monitor usage and costing of Cloud services in an operational environment, and pursue shared system security profiles for such solutions. The result of the project will serve as an guidance for governmental agencies in the future when considering Cloud service adoption for geospatial capabilities.
 
  
2) Qunying Huang from George Mason University Center for Intelligent Spatial Computing will introduce a joint project between the GeoCloud and GEO from their experiences on deploying the GEOSS clearinghouse to a cloud platform. The deployment of geospatial applications onto Amazon EC2 cloud computing platform will be introduced. Issues and Research will be reported about the leverage of cloud computing for the operational system.  
+
'''Notes:''' https://docs.google.com/document/d/1vuzQVqIcsKpbOiWEoxhrmcQGYg73uSQtL8M5l7YS65Y/edit#
  
  
=== Notes from Session ===
+
YouTube channel with presentations from 2021 and 2022: https://www.youtube.com/playlist?list=PL8X9E6I5_i8i3ZEl7mIrt2meHI3z8KzqB
 +
----------Previous years of the cluster had a different format, more discussion-based:
  
* Geocloud Sandbox initiative was created as an Architecture and technology working group activity in December of 2009. Created to nominate geospatial applications for testing in the Cloud environment for 1 year prototype.
+
*2019-05-06: Cloud Computing Lightning Talks: [https://youtu.be/BAH3Eo39I8E View Recording]
* 2 deployment environments were abstracted from the projects, 1 open source service stack on linux64 other is windows 2008 stack.
+
*2016-10-24: [[Cloud_Telecons_10/24/2016|Cloud Computing Telecon]]
* Cloud computing could create a ceiling payment for use similar to that of a utility bill.
+
*2016-09-26: [[Cloud_Telecons_09/26/2016|Cloud Computing Telecon]]
* Platform is the main idea of going for cloud computing. Platform is a service that delivers solution stack as a service generally consuming cloud infrastructure and supporting cloud applications. It facilitates deployment of applications without the cost and complexity of buying and managing the underlying hardware and software layers.
+
*2016-06-28: [[Cloud_Telecons_06/28/2016|Cloud Computing Telecon]]
* Geocloud is piloting the deployment of infrastructure as a service
+
*2016-05-23: [[Cloud_Telecons_05/23/2016|Cloud Computing Telecon]]
* Hope to save money in hardware operations and scalability, reduce maintenance, cost effective testing
+
*2016-04-25: [[Cloud_Telecons_04/25/2016|Cloud Computing Telecon]]
* Platform consists of application servers platform enablers app frameworks and runtime systems.
+
*2016-03-28: [[Cloud_Telecons_03/28/2016|Cloud Computing Telecon]]
* Basic image :Windows 2008 hardened open source linex centos then harden and build base platforms to open source additions such as java, php, etc and open souce core like apache, postgres, java, ruby on rails, specialize for target apps * * * ArcGIS server Geospatial platform semantic drupal glassfish, open geo, geoserver network, thredds, geospatial hhs and semantic apps
+
*2016-02-22: [[Cloud_Telecons_02/22/2016|Cloud Computing Telecon]]
* Cost evaluation for each of the initial project was performed based on data transfer story
+
*2016-01-25: [[Cloud_Telecons_01/25/2016|Cloud Computing Telecon]]
* Most projects could be hosted inAWS at 350-500$ a month
+
*2015-01-07: ESIP Winter Meeting 2015
* Amazon Web Services was selected as the primary public cloud computing environement for various sizes and numbers of virtual machines.
+
**Zhenlong Li: [http://wiki.esipfed.org/index.php/File:Enabling_Big_Geoscience_Data_Analytics_with_a_Cloud-based,_MapReduce-enabled_and_Service-oriented_Workflow_Framework.pdf - Enabling Big Geoscience Data Analytics with a Cloud-based, MapReduce-enabled and Service-oriented Workflow Framework]
* Dell vmwarevcloud environment was selected for government hosted cloud infrastructure.
+
**George Chang: [http://wiki.esipfed.org/index.php/File:CLoudburstingDebriefV1ESIP2.pdf - Cloudbursting Debrief]
* USA Arc GIS Geoss LINUx64 NOAA Linux64
+
*2014-07-10: ESIP Summer Meeting 2014
* Working on this January- march
+
**Thomas Huang and Phil Yang: [http://wiki.esipfed.org/images/f/f6/2014_esip_summer_c3.pdf Agenda - Science Data Analysis on the Cloud]
 
+
**Petr Votava [http://wiki.esipfed.org/images/b/bb/Votava-OpenNEX-v2.pdf NASA Earth Exchange (NEX): Community Engagement in the Cloud through OpenNEX]
 
+
**Wes Lloy: [http://wiki.esipfed.org/images/e/ef/Lloy_vm_scaler.pdf The Virtual Machine (VM) Scaler: Supporting Environmental Modeling for the Cloud Serivces Innovation Platform (CSIP)]
* Geocloud deployed ten geospatial application projects in the vloud network
+
*2014-04-28: [http://wiki.esipfed.org/images/6/66/Euca_overview_-_2014.pdf Eucalyptus Overview by Rich Lee, Eucalyptus Systems, Inc {lee.rich@eucalyptus.com}]
* Cloud computing a model that enables shareing on demand network access to share pooled computing resources that can be rapidly provisioned and released
+
*2014-03-31: [http://wiki.esipfed.org/images/f/f7/ESIPC3-3312014-MonthlyTeleconMinutes.pdf Cloud Computing Telecon]
* On demand self service, multitenancy measured services device and location independence rapid elasticity
+
*2014-01-27: [[Cloud_Telecons_12|Cloud Computing Telecon]]
* SaaS software as service gmail skype facebook
+
*2014-01-08: ESIP Winter Meeting 2014
* PaaS platform as a service windows Azure google app engine
+
**Cloud Governance
* Infrastructure as a service IAAS AWS
+
***Hook Hua: [http://wiki.esipfed.org/index.php/File:Esip2013winter-ariamh-20140109.pdf Leveraging On‐premise and Public Cloud Computing to Enable Advanced Rapid Imaging & Analysis for Monitoring Hazards]
* Elastic Compute Cloud EC2 IAAS
+
***Jonathan Chiang: [http://wiki.esipfed.org/index.php/File:ESIP-Governance-jchiang.pdf Overcoming “Cloud Creep”]
* Simple Storage service S3 Iaas
+
***Matthew Derenski: [http://wiki.esipfed.org/index.php/File:ESIP_Cloud_Security.pdf Cloud Security]
* Elastic Block storage EBS IAAS
+
*2013-08-26: [http://wiki.esipfed.org/images/e/e5/Cloud_101_ESIP.pdf Webinar: Introduction to Cloud Computing]
* EC2 a web service that provides resizable compute capacity in the cloud
+
*2013-07-22: [http://wiki.esipfed.org/images/1/15/C3-minutes-20130722.pdf Cloud Computing Telecon]
* AMI amazon machine image a bootable vm image which can be launched as a
+
*2013-1-09: [[2013Winter_Cloud_Talks|2013 ESIP Winter Slides]]
* EC2 instance
+
*2012-9-24: [[Cloud_Telecons_11|Cloud Computing Telecon]]
* Scalability load balancer
+
*2012-8-27: [[Cloud_Telecons_10|Cloud Computing Telecon]]
* Reliability network disaster recovery
+
*2012-6-25: [[Cloud_Telecons_8|Cloud Computing Telecon]]
* Reducing duplicated efforts infrastructure and development
+
*2012-6-4: [[Cloud_Telecons_7|Cloud Computing Telecon]]
* We are at a prescient time
+
*2012-4-23: [[Cloud_Telecons_6|Cloud Computing Telecon]]
* Technologies cloud architecture, platform independent languages, Open data standards
+
*2012-3-26: [[Cloud_Telecons_5|Cloud Computing Telecon]]
* Challenges?: network bottlenecks data transfer, performance unpredictability, data and personal privacy, scalable storage computing power Amazon EBS, Bugs in  large distributed systems
+
*2012-2-27: [[Cloud_Telecons_4|Cloud Computing Telecon]]
 +
*2012-1-23: [[Cloud Computing Telecon]]
 +
*2012-1-5: [[ESIP Cloud Computing Testbed Initiative]]
 +
*2012-1-5: [[NASA Cloud Computing Panel]]
 +
*2012-1-5: [http://wiki.esipfed.org/index.php/File:Cloud_Computing_Talk_by_Adrian_Gartner.pdf Cloud Computing Talk by Adrian Gartner, CIO, NASA Goddard]
 +
*2011-12-19: [[Cloud_Telecons_3|Cloud Computing Telecon]]
 +
*2011-10-25: [[Cloud_Telecons_2|Cloud Computing Telecon]]
 +
*2011-09-16: [[Cloud_Telecons|Cloud Computing Telecon]]
 +
*July, 2011 Summer Meeting Cluster Formed
 +
|}
 +
[[category:CollabArea]]

Latest revision as of 11:48, April 3, 2023

See also Cloud Computing Cluster Plan 2021

Welcome to the Cloud Computing Cluster

Description and Objectives

As geospatial computing continues to demand more volume, variety, and velocity, the core characteristics of big data, the Cloud Computing Cluster helps ESIP members tackle these challenges through cloud-based architectures, technologies, and software. By bringing together users, developers, and researchers from industry, government, and academia, this Cluster provides a virtual platform for ESIP members and broader communities to share relevant knowledge and experience. The Cluster also aims to help foster collaborations among different organizations and individuals to work together to better apply cloud technologies to today’s data challenges.

Get Involved

Or add the recurring calendar event to your calendar by clicking the following link: https://calendar.google.com/calendar/render?cid=sb9cnmaknqpsifs7ttn9ksobu0%40group.calendar.google.com

  • Contact Cluster Chair: Aimee Barciauskas, Jim Coll, Sudhir Shrestha
  • Other leads: Rich Signell, Rob Casey

Knowledge Base and Shared Information

Cloud_Computing

We have a regularly scheduled cluster meeting on the last Monday of the month 1PM EDT. This is a knowledge sharing session with the schedule typically being:


Agenda

  • 5-10 minutes - Announcements
  • 20-30 minutes presentation
  • Questions and discussion


Meeting Information

Join Zoom Meeting

https://www.google.com/url?q=https://us02web.zoom.us/j/86535177705?pwd%3Day9yVDJ6UzNiSGRMWTFxbkNXdEJXUT09&sa=D&source=calendar&usd=2&usg=AOvVaw2wk5iYeLOpyw5qCiMdquWO



Notes: https://docs.google.com/document/d/1vuzQVqIcsKpbOiWEoxhrmcQGYg73uSQtL8M5l7YS65Y/edit#


YouTube channel with presentations from 2021 and 2022: https://www.youtube.com/playlist?list=PL8X9E6I5_i8i3ZEl7mIrt2meHI3z8KzqB


Previous years of the cluster had a different format, more discussion-based: