DevOps项目实战班

Initial talk: DevOps Concept and Career Perspective

• What is DevOps?

- Target audiences

- The Google definition

- History

- The ultimate goal

• Career Path

- Why DevOps is a better choice?

- Highlights

- The career ladder

- Salary guideline

• Course outline

- What do we teach?

- Dev side

- Ops side

- Tech stack

- Linux and Python-Based WebApp Pipeline

• What is the goal

- The hands-on projects

- Demo

Pre-Course Preparation

● Install Git

● Bring a laptop with at least 4GB memory

● Clone a git repo that contains automation to set up a development environment, the homework folders and projects skeletons

● Set up the development environment before attending the class

The Big Picture and Project Motivation - Introduce the common WebApp architecture

1. 了解这九大模块，网站应用开发Web App架构尽在掌握

2. 常见商业网站架构介绍，从更高点审视架构Architecture

3. 学习DNS，CDN，什么是前端和后端，反向代理Reverse Proxy，以及分布式内存对象缓存系统Memcache的基本概念，数据库，以及基本的安全指导Security Guideline

4. 开发即运维对于网站的重要性

5. 动手课程：简单部署一个本地网站负载均衡器Set up a reverse proxy on Linux

The Big Picture and Project Motivation - Projects motivation

1. 带领学生熟悉全球最常用云服务AWS(Amazon Web Service) ， 结合美国独角兽Pluralsight视频，补偿学习基本AWS内容

2. 介绍DevOps的生命周期，以及每一阶段使用的具体工具，从Hight Level了解DevOps文化：持续发展、持续集成、持续测试、持续反馈、持续监测、持续部署、持续运维。

3. DevOps课程完成的大项目介绍，以及架构和拓扑图

4. 通过常见网站测试工具测试网站性能，探索网站的问题，引导给出解决方案

5. 通过配置AWS的CDN与DNS提升用户访问网站的速度 ，学习SSH，以及实战配置

6. 话题：网站软件开发完成就能上线运营了吗？带你通过一个常见的客户关系管理系统CRM项目了解没有开发即运维可能遇到的十大深坑

Development Workflow - Git Basics with practices

1. 什么是git？什么是pull request？常见Git Cloud介绍

2. 实操五大常用git命令：Git clone, commit, checkout, branch, rebase, merge and cherry-pick

3. 像高级程序员那样配置一个项目仓库repo的不同环境

4. 有过工作和非工作区别：理解Master/Staging/Prod flow

5. 学习使用Git高级用法，如何做好Branch策略，学会使用Git Rebase等功能

6. 工作常见问题：如何正确熟练解决提交代码冲突Resolve Conflicts，保住你的工作

7. 迈出成为开发即运维工程师的第一步：提交你的第一份代码

Development Workflow - Agile Development

1. Agile 的由来、开发宣言、原则、主要关注点，什么是价值

2. Scrum 框架的各个流程概述，“3355”方法论

3. 结合实际工作讲解各个流程：scrum planning，daily standup，scrum board，scrum review meeting，spring retrospective meeting

4. 班级进行模拟 retrospective meeting，回顾课程至今的成果与不足

5. 怎样写 backlog，怎样写用户故事：“完成”的定义，故事拆分和故事估算

6. 怎样改进流程、提高效率，为什么企业需要 T 型人才

7. 介绍精益方法和 Kanban，实际使用中 Kanban 和 Scrum 的结合

- 敏捷开发是什么？它对现代软件开发的影响

- 敏捷开发最佳实践

- Scrum和Kanban又是什么

- 实战Jira Software

Coding Basics CLI and WebApp Introduction - Python Basics CLI

- HelloWorld for DevOps

- Set up Virtualenv for python (30m)

- Understand the basic concepts with practices (30m)

- The Python community, PEPs, and Python3.7 features

- Functions, Classes and How to run python

- Libraries and practices (1h)

- Data structure

- os

- re

- request

- Logger

- CLI development (45m)

- Use Click to build a command-line app and publish through pip

Coding Basics CLI and WebApp Introduction - Hands-on

1. 学会这五个library，写DevOps命令行界面工具得心应手

2. 打包发布你的DevOps工具 -- 学会这套软件包管理系统知识，所有语言都不怕

3. AWS components 和 aws-cli 赏析

WebApp Introduction - WebApp

1. API和CRUD实战

2. 了解常见的三种Authentication方式方法

3. 实战通过不同验证方法访问商业网站API

WebApp Introduction - Hands-on

- Hands-on - Add a new feature

- Agile (Jira Software)

- Git

- Test-driven (1.5h)

- How to write Exceptions (45m)

- Unittest Basics (45m)

- Pip management

- Deploy manually to Beanstalk (Optional)

DevOps Overview and Linux - DevOps Overview

1. DevOps开发即运维到底是什么？DevOps的生命周期是什么？以及每个生命周期常用的工具和最佳方案是什么？本节课会具体展开讲DevOps内容

2. 什么是SRE Site Reliability Engineering? 什么是DevOps? 他们的挑战是什么

3. 软件开发工程师与SRE DevOps的区别

4. 系统学习DevOps，介绍Service Level Indicators (SLI)，Service Level Objectives (SLO)，Service Level Agreement (SLA)，以及三个概念实际课堂练习

5. 讲解UI, Service Tier, Data TiIer, Ingest, Network

6. 结合公司实际情况，理解Accident，Error Budget处理，以及Monitoring Logging

7. 学习什么是常见的Microservices，Containerisation容器化，为什么对于现代开发这么重要，什么是CICD，以及在AWS里的使用

8. 从大局出发 - 了解开发流程4、

9. 从大局出发 - 看透运维的过程

10. 常见工具分类

11. 实际生活应用举例

DevOps Overview and Linux - Linux and Bash Basics

1. Linux系统文件，权限漫谈

2. 常用的十大Bash命令及它们的应用场景

3. Bash Pipeline对于DevOps的日常

4. 实践：

文件搜索与内容调取

解决bash脚本的错误

Containerization Basics (Docker) and Orchestration - Containerization

-Docker Basics and practices (2h30m)

-Concept: Dockerfile, Docker image, Docker container

-Practical Hands-on (2h):

-Write Dockerfile to build a Docker image

-Upload to docker registry and pull the image

-Use Docker Compose to start docker containers

-Examine logs

-Project: Dockerise web application

-Wk1,2,3 Homework review (30m)

Containerization Basics (Docker) and Orchestration - Orchestration

- Kubernetes

- Project: Manually deploy web application to k8s

Infrastructure Automation (Terraform) and Configuration Management - Terraform basics and practices

Terraform Providers

Terraform Modules

Terraform Commands

- Wk6 Homework review and Wk7 Homework requirements (30m)

Hands-on (3h)

Project: Use Terraform to set up infrastructure automation for our project

Infrastructure Automation (Terraform) and Configuration Management - Ansible/Packer basics and practices

- Managing inventory

- Running Commands

- Playbook, Roles, Vaults, Facts …

- Hands-on

- Set up an environment for our web app using Ansible

CI/CD - Basic concepts and practices

1. 持续集成和持续交付的概念解析

2. 持续集成和持续交付的三大常用工具对比

3. 深入了解Jenkins在持续集成和持续交付的作用

配置Jenkins服务器和代理

搭建一条Jenkins Pipeline

自动化持续集成两步走：build and test

自动化持续交付软件到三种不同环境

CI/CD - Hands-on

1. 手动为实战项目配置持续集成和持续交付

2. 自动化实战项目的持续集成和持续交付

Logging & Monitoring - Logging Basics

17 Logging Basics (3h)

- What to log

- Why log

- Tools for logging

- ELK, Splunk

- Hands-on

- Search Logs

Logging & Monitoring - Monitoring Basics

- Infrastructure Performance Monitoring (2h30m)

- CPU

- Memory

- Disk

- Network related

- Hands-on

- Collect the data from the Linux and docker container of our project

- Application Metrics Monitoring

- Handon: Setup monitoring using statsd, prometheus, grafana

- Wk7 Homework review and Wk8 Homework requirements (30m)

High Availability and Auto Scaling - Industrial trends

- SLI/SLO/SLA

- Four Golden Signals

- Chaos Engineering

- High Availability Setup

- Auto Scaling Basics

- Wk8 Homework review and Wk10 Homework requirements (30m)

High Availability and Auto Scaling - Hands-on

- Setup HA for our project

- Load balancer chaos monkey

- Simulate concurrent user requests (locust)

- Setup auto-scaling to handle traffic

Incident Management - Incident report and management

- Jira Service Desk

- Status Page

- Incident management process

Incident Management

- #22 Alerts (30m)

- Opsgenie/Pagerduty

- #22 Webhook Integrations (10m)

- #22 Wk10 Homework review and Wk11 Homework requirements (30m)

- #22 SlackOps (0m)

- SlackOps

- Errbot (Python), Hubot(Coffee Script)

- #22 Zoom

Summary

- #23 Project #3: Interactive class: from agile development to handling a real incident (2.5h)

- Create a backlog, scrum planning ( Scrum master volunteer needed)

- Trigger our automation for CI/CD, configuration and Logging/Metrics/Monitoring

- Sprint review and retro

- Trigger a real-time incident ( Incident manager needed)

Resume and Interview Preparation