Machine Learning and Parallel Computing Data Engineering – ITS70504 Week 6 • Google Cloud Platform • Introduction to Google Cloud Platform (GCP) • GCP Services • Big Data on Google Cloud Platform • Google Cloud Platform VS Competitors • GCP Demos Data Engineering – ITS70504 Week 6 • Google Cloud Platform • What is Cloud Computing: Cloud computing is the use of off-site systems to help computers store, manage, process, and/or communicate information. These off-site systems are hosted on the cloud (or the internet) instead of on your computer or other local storage. They can encompass anything from email servers to software programs, data storage, or even increasing your computer’s processing power. You typically pay only for cloud services you use, helping you lower your operating costs, run your infrastructure more efficiently, and scale as your business needs change. Data Engineering – ITS70504 Week 6 • Google Cloud Platform • Examples of Cloud Computing: • SaaS or Software as a Service. SaaS means instead of installing software on your computer, you access the platform online. Examples would include: ◦ Square, which processes payments online ◦ Google Apps such as Google Drive or Calendar ◦ Slack, which allows collaboration and chat between other users • IaaS or Infrastructure as a Service. IaaS provides infrastructure components such as servers, storage, networking, security, and moreover the cloud. Examples would include: ◦ ◦ ◦ Dropbox, a file storage and sharing system Microsoft Azure, which offers backup and disaster recovery services, hosting, and more Rackspace, which offers data, security, and infrastructure services. Data Engineering – ITS70504 Week 6 • Google Cloud Platform • Examples of Cloud Computing: • PaaS or Platform as a Service. PaaS provides computing platforms such as operating systems, programming language execution environments, databases, and web servers. Examples would include: ◦ Google App Engine and Heroku, which allow developers to develop and serve apps Serverless Computing. Serverless computing (also called simply “Serverless”) is simply using a server on the cloud. This offers more elasticity, easier maintenance, and is often more price effective than hosting servers on-site. • Data Engineering – ITS70504 Week 6 • Google Cloud Platform Function As A Service Data As A Service Storage As A Service Data Engineering – ITS70504 Week 6 • Google Cloud Platform Data Engineering – ITS70504 Week 6 •a • Types of Cloud Computing: Public cloud: Public clouds are owned and operated by a third-party cloud service providers, which deliver their computing resources, like servers and storage, over the Internet. Private cloud: A private cloud refers to cloud computing resources used exclusively by a single business or organization. A private cloud can be physically located on the company’s on-site datacenter. Hybrid cloud: Hybrid clouds combine public and private clouds, bound together by technology that allows data and applications to be shared between them. Data Engineering – ITS70504 Week 6 • Google Cloud Platform • Cloud Computing Service Provider Data Engineering – ITS70504 Week 6 • Google Cloud Platform Data Engineering – ITS70504 Week 6 • Google Cloud Platform Google Cloud is a suite of Cloud Computing services offered by Google. The platform provides various services like compute, storage, networking, Big Data, and many more that run on the same infrastructure that Google uses internally for its end users like Google Search and YouTube. Data Engineering – ITS70504 Week 6 • Google Cloud Platform Data Engineering – ITS70504 Week 6 • Google Cloud Platform Google Cloud Platform VS Competitors Data Engineering – ITS70504 Week 6 • Google Cloud Platform 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. access control Why Google Cloud Platform? An infrastructure tailored to individual business needs Industry-dedicated solutions GCP security Per-second billing Budget control An own GCP network GCP scalability Availability Real-time migration Data Engineering – ITS70504 Week 6 • Google Cloud Platform Google Cloud Platform Services Data Engineering – ITS70504 Week 6 • Google Cloud Platform Compute Services Data Engineering – ITS70504 Week 6 • Google Cloud Platform Network Services Data Engineering – ITS70504 Week 6 • Google Cloud Platform Cloud AI Services Data Engineering – ITS70504 Week 6 • Google Cloud Platform Storage Services Data Engineering – ITS70504 Week 6 • Google Cloud Platform Big Data Services Data Engineering – ITS70504 Week 6 • Google Cloud Platform GCP Products to Big Data Data Engineering – ITS70504 Week 6 • Google Cloud Platform INGESTION Data Engineering – ITS70504 Week 6 • Google Cloud Platform PROCESSING Data Engineering – ITS70504 Week 6 • Google Cloud Platform STORAGE Data Engineering – ITS70504 Week 6 • Google Cloud Platform EXPLORATION Data Engineering – ITS70504 Week 6 • Google Cloud Platform ANALYTICS Data Engineering – ITS70504 Week 6 • Google Cloud Platform EXAMPLE Data Engineering – ITS70504 Week 6 • Google Cloud Platform CLOUD STORAGE • VERSIONING • STATIC SITES • RESUMABLE TRANSFERS • OBJECT CHANGE NOTIFICATIONS • TB SCALE Data Engineering – ITS70504 Week 6 • Google Cloud Platform CLOUD SQL • FULLY MANAGED • EASE OF USE • HIGHLY RELIABLE • FLEXIBLE CHARGING • SECURITY, AVAILABILITY, OU RABILITY • EASY MIGRATION & DATA PORTA BI I ITY • OPTIMIZED MYSQL VERSIONS Data Engineering – ITS70504 Week 6 • Google Cloud Platform BIG QUERY • FULLY MANAGED BIG DATA ANALYTICS SERVICE • SUPPORT SQL • FAST • SCALABLE • FLEXIBLE AND FAMILIAR • SECURITY AND RE IABILITY Data Engineering – ITS70504 Week 6 • Google Cloud Platform BIG QUERY • INCLUDES • APACHE HADOOP • APACHE PIG • APACHE HIVE • APACHE SPARK • FAST AND SCALABLE DATA PROCESSING • FLEXIBLE VIRTUAL MACHINES • RESIZABLE CLUSTER Data Engineering – ITS70504 Week 6 • Google Cloud Platform DATA LAB • POWERFUL DATA EXPLORATION • SCALABLE • DATA MANAGEMENT • VISUALIZATION • 0PEN SOURCE (JUPYTER) Data Engineering – ITS70504 Week 6 • Google Cloud Platform GCP REGIONS & ZONES Data Engineering – ITS70504 Week 6 • Google Cloud Platform PRACTICING FREE ACCOUNT ON GOOGLE CLOUD Data Engineering – ITS70504