AWS my architecture--160+

aws 10 minutes

aws quick labs

aws reinvent

aws faqs---exam

====================

Pre-Req

github account

AWS account

Infrastructure

---->Data center

-->Storage components( object--s3(google drive) and block storage(disc))

-->Network components--DNS--Route53

-->Computing components(CPU and RAM)--Bare metal ---Hypervisor

Route53---NS, Hosted zones and record sets, TLD

how name will be converted into ip address ?(name resolution)

why we need external storage ?

internal storage

computing components --------n/w----------------------storage--SAN/NAS

On-prem

every company has their own dc

power-----

Projects---power stations ----substations---poles------home

cloud

dc----computing+network+storage-------client

cloud ----pay per service

cloud providers(aws+azure+aliabab+gcp..)

infra cost + upgradation + maintanance

danone---on-prem

aws--

DC--region--geo separated location of dc related to aws

az--availability zones

regiono =2 az

for ex:us-east-2 ( ohio)--Region name

az names

us-east-2a

us-east-2b

us-east-2c

hypervisor

vmware(workstation + ESxi), virtualbox, kvm,xen

personal--windows 10

enterprise--windows server 2016

softlayer---IBM private cloud

on-site/on-prem

Akamai

Edge(h/w) location-cache component (AWS cloudfront)--static content

------------------------------

CDN- Content delivery network

machine never understands names and it requires ip address for the n/w communication.

what is the need of n/w ?

n/w--data sharing

servers always use physical communication with the ethernet/NIC card

every nic is have ip address.

=============================================

Day:3

IP address- Private ip and public ip(ifconfig/ipconfig)

DNS(nslookup,host,digi)

port ( netstat,lsof)

ssh ( ssh,telnet)

RDS,mstsc

Remote login

Operating systems and flavours

lab:block website

find your gateway and ip address and subnet mas

ping 10 websites(3 wront and 7 success) and increase the packet count

nslookup for 10 websites(5 wrong websites and 5 success)

IP address versions:IPv4(numeric) and IPV6(128bit---alpha numeric)

IPV4(32 bit)

(0-255)

xxx.xxx.xxx.xxx

Computer---------------Router/Nat Gateway/Nat Instance/Proxy(fwd)--------------------------internet

if servers want to go to internt we use proxy or nat gateway

ip addresses public and private

Private ip address

10.xx.xx.xx

192.

172

it can be duplicate based on network zone.

private ip adress area called a intranet.

Privaete websites always have private ip.

Public ip

other than private series

public ip address area called a internet(0.0.0.0).

can be accessed from anywhere and unique(no duplicate)

public websites will have public ip address.

To know ipaddress of your website/hostname/servername

nslookup <websitename>/<hostname>/<servername>

www.google.com ---------------------->DNS Server(NS)----www.google.com | 172.217.xxx and ipv6

ping used to check up <websitename>/<hostname>/<servername> or responding or not.

ping will send icmp(Internet chat msg protocal) packets.

in AWS ping is disabled by default.

in windows ping will send 4 icmp

in unix its unlimited

www.google.com

Request format:

protocal://<websitename>/Hostname/servername/IPaddress :<port>/contextroot

mandatory: protocal

ipaddress

port

ex:1

https://www.google.com/

protocal: https

websitename: www.google.com

port: 443

contextroot: /

http://www.eenadu.net/

ex:-2

protocal: http

websitename: www.eenadu.net

port: 80

contextroot: /

port : numerical number and assigned to a service in your machine.

to access that service you have to use port number.

india

www.eenadu.net------------>DNS(www.eenadu.net | 100x.xx)

------->chennai---->singaport---xxx...xx..

eenadu.net (US)--dc--Physical sserver(ethernet port---80 service)--lan cables----

100.xxx.x.x.x

www.eenadu.net------>hosts(local dns)----->

every machine 127.0.0.1 ---loop backup ip --lo

=============================================

Day-4:

----------------------------------------------

Block the websites

Review of yesterday and previous day

AWS account login

basics of software installation(.exe,.bat,rpm,yum,apt-get)

Basics of windows, login and admin login

Normal user and system admin

Block the website: C:\Windows\System32\drivers\etc\hosts

/etc/hosts -Unix environment

www.eenadu.net------hosts-----ISP---DNS(tld)---peerDNS----destination server

protocal: http

port:80

websitename : www.eeandu.net---127.0.0.1

open the notepad in administrator mode-->file-->open-->C:\Windows\System32\drivers\etc\hosts

Connection refused: you have ip address and you are reaching to server and your port not listening.

the service on the port number stopped.

DNS_PROBE_xxx: wrong dns name or dns entry not found(check with nslookup)

Windows: how do you install the software ?

browser--->internet--->Repository--software/package/artifacts(store all the packages)------>download into your local-->

repository/artifactory--software packages storing location.

.exe (executable)--windows-GUI-Graphical user interface/CLI(command line interface)

.bat(batch)

.dll

.bin

.msi (microsoft installer)

c:\ProgramFiles

wizard installation(accept--next --next).

Unix ---CLI

.rpm ( redhat package manager)

.tar

.zip

.tar.gz

.tgz

and with yum ( yellowdog update manager) , apt-get

/usr/

laptop ---bios---os----kernel---Desktop----C

Windows--Drives--Format C:\

command prompt----C:\Users\<username>

C:\Users\<username>\Desktop

user home directory: C:\Users\<username>

user profile directories and files

Desktop

Downloads

Pictures

Videos

Documents

mutli user os

multe user accounts

c:\Users\a(Desktop,Downloads..etc)

c:\Users\b(Desktop,Downloads..etc)

c:\Users\c(Desktop,Downloads..etc)

lab: create one user in your laptops with devops name and put a password for that user.

login with that user into system and see desktop and compare with the previouosly used user.

cd - change directory

cd .. ( come back one directory back)

cls (clear screen) -- clear or ctrl+l(unix)

any os during installation user will be created(administrator/Power user/root user)

Administrator can create multiple users(normal users).

port numbers: 1-1024 port admin users

1025 to 35k -- normal users.

=========================

what is the need of cloud ?

what is the need of devops ?

basics of networking ?

ping--icmp -4-

nslookup/host

dig

traceroute/tracepath (unix)

tracert (windows)

=========================

SDLC

ETA

Waterfall-legacy

drafting---analsis---prototype---poc(demo project)(dev+testing(qa)+build infra+deploy)-----end users

Agile/Kanban

devops---delivering the product fast approach and getting feedback also fast apporach.

every day meeting --scrum call/stand up call

sprints---20 days ---deployment in prod(end users access)sprint meeting---jira tickets--dev/testing/devops---stroy points(days)

environments

dev

qal

perf

------------all goes well in lower environments -- tester/qa creates a CR(change request) for deployment ,,SNOW/BMC remedy.

prod--bug(dev issue or infra)-----jira ticket

jira--ticket--queued --progress--completed---review--closed.--blocked

jira(dev+test+devops)

Servicenow(SNOW)--prod

jenkins(CI)--dev+devops+tester+load test

CD--chef+ansible+spinnaker+argoCD

testing/load test/code analysis---SonarCube/TestNG/Cobertura/Jmeter(load)

devops --

test driven devoplopment approach

dev team (local laptop)--coding-----source code management systems---github/svn/cvs--(raw/source code)

---->compile/execute/pack(build)---ant,maven,msi builders and graddle----

code quality test cases

junit test cases(intergration test cases)---developers

---->deployment(dev)--smoke test/sanity testing

---->testing(qa--functinal testing)--green

---->go for deployment --qal

----> testing(qa--functional)---green

--->deployment in perf---

---->load testing (performance testing team--jmeter/load runner)

QA team Create a CR and assing to devops team.

CR contains.

schedule start date/time ,duration, apporvals and plan of execution(documents/release docs).

program(source code)---compile---execute

code---scm--build--deploy--test(lower)--release--prod-

s3

ec2

ebs

admin team:

Browser------>AWS console----Infrastrcture----DC--Region---AZ

aws cli--------------->infra---DC---Region---AZ

dev team

java/.net/python..etc------>infra--DC--Region---AZ

Day-5:

======

aws account--ec2 launch

Day-6:

======

devops intro

Day-7:

========

launch windows and linux

laptop(mstsc/rdp)------>aws--region--zone--securty group(3389)--windows ec2/instance/vm/server

laptop--ssh clients(putty)-------------->unix(redhat)

protocal: ssh

port:22

user=redhat--ec2-user

ubuntu-- ubuntu

pem file

Adminitrator and password(pem)/private key

lab:launch linux

step-1: create sg- allow inbound 22-ssh - anywhere

step-2: launch ec2 machine

userdata: during ec2 launch time if you want to install any services , provide those info userdata.

windows--

username

password

-------------->Desktop

C:\Users\<username>\Desktop,Downloads,Pictures,Videos,Documents..etc

linux:

username:ec2-user

password/pem

/home/ec2-user/

/home=C:\Users

/home/ --normal users home directory

/root -- root user home directory

/ =Mycomouter/This PC

dir=ls

putty---puttygen and putty

puttygen--generate public and private key and to convert pem into ppk

putty - to connect unix envionments

C:\

[ec2-user@ip-172-31-28-125 ~]$

[username@servername ~]$

$=normal user prompt

~=home directory

/home/<username>

/home

commands:

1. uname

2. hostname

3. pwd

4. date

5. whoami

6. history

7. cd .. ( back one directory)

8. cd ( takes to home directory)

9. ls -l ( long list and sort based on names)

d=directory

- = file

10.chmod

11.chown

12. touch

13. w or who(pending on multi user)

14.uptime

filetype permissions ownership size date of creation/update filename/dirname

r=read=4

w=write=2

x=execute=1

7=rwx

--- --- --- =9

owner

group

others

rw-r--r--

644

755

rwxr-xr-x

chmod 777 filename

chmod -R 777 directory

r=recursively

ssh -i <pemfile> username@ip/dnsname

AWS Deployment models

blue/green deployment

blue=live=1.0----green

green=latest=2.0---live--blue

devops deployment models

b/g

canary

ec2 --security group--firewall

0.0.0.0

LAB:

create two ec2 machines

make one as bastion

another one as application

create two security groups

name: bastion-sg and application-sg

bastion-sg

ssh-22-0.0.0.0

application-sg

ssh--22--bastion-sg

first connect to the bastion

ssh -i devops.pem ec2-user@18.206.154.64

ssh clients: putty , gitbash and mobxterm

to copy from local to remote server

filezilla--gui

winscp--gui

scp

scp -i devops.pem devops.pem ec2-user@18.206.154.64:/home/ec2-user/

remote port open or not

s3 is simple storage service==google drive==object storage

its unlimited

buckets--->5TB

standard----default--immidiately

infreequent--minuites

glacier--archive data----hours time

s3 life cycle management

telnet ip/name port

nc (netcat)

nc -v ip port

connection failed to application ec2 machine

success for bastion ec2 machine

ping

connection timeout(ssh -22)

Cloudtrail

0.0.0.0--sg---notification--cloudtrail-------------lamda functions-----email--us---redsignal

==================

Day-8--Week-2

=================

bastion- done-security group -- 0.0.0.0/0 ---22--ssh---pem: bastion

web: security group --- 22--ssh -- bastion-sg

vpn--

lab: assign a elastic ip to ec2 machine and deassociate.

[ec2-user@ip-172-31-90-96 ~]$ whoami

ec2-user

[ec2-user@ip-172-31-90-96 ~]$

[user@hostname]$

[root@hostname]#

gangi

typing commands---shell(bash/ksh/csh/zsh)----kernel---hardware

kernel==high level language to low level

english to machine level understand language.

bash = shell and checks your commands synatax and semantic.

lab:-

Changing the hostname of ec2 machine.

/etc/hostname

/etc/hosts

users: Administrator(root) and normal user(ec2-user)

/home/<username>

/home/ec2-user

Normal uuser------->root

su - root

su

su -

---------------------------->need password of root user.

su - otheruser

--------->other user password

============================================

ec2-user-------------->sudoers

vi /etc/hostname -----------

modes: readonly(escape) /insert /execution

after entering into insert mode --enter your cotnent---to save

esc + shift + ; ---wq!

w=write/save

q=quit

!=forceful come out of vi

/etc/hosts

privateip bastion

hostname -F /etc/hostname

bastion--

webserver

Loginto the webserver

yum install httpd -y -----------instal httpd/apache webserver--80--

systemctl start httpd -----------start httpd/apache

bastion-webserver

[root@webserver ec2-user]#

[root@webserver ec2-user]# systemctl start httpd

[root@webserver ec2-user]# ps -ef | grep httpd

protocal://ip:port/

http://54.89.102.180/------------------web-sg--(80)-----ec2---80---apache

tell your webserver ip--

what is ssh and telent ?

diff

==============

Day-9--Week-2

==============

lab:-

bastion-webserver(apache/httpd)

changing the hostname

assigning EIP

to play the videos of our recording--install the web.exe( upload in sometime to webserver).

IAM basics

Need of IAM

-->creating the users in IAM

-->Roles

-->Assigning the roles to aws services--ec2

-->basics of linux

next?

Select the security group as myip--tell me the ip address ?

Cloudtrail=all the aws console clicks and activities will be saved into cloudtrail(auditing).

Poweruser--Root user of AWS console--has access to all the services.

--->all the people not use all services.

users will be used by us.

roles will be used by aws services.

https://644308608816.signin.aws.amazon.com/console

AWS console--username and password---MFA.

----->policy--json format.

set of instructions(permissions) and actions.

default policy(aws gave default) and custom policy(we need to create--policy generator).

lab:create devmember1 and assign ec2read only .

login with that user.

create the group -- testing and assign cloudwatchfull access policy.

ARN: amazon resource name.

authentication: username and password

authorization : level of policy/role.

create user: devops-admin

provvide : administrator

create role called: ec2-member and give s3 access, assign the role to ec2 machine.

what is the IAM user and power user and role ?

types of access to users ?

next ? how to create cross account IAM role ?

ec2---linux , windows

==============

Day-10--Week-2

==============

lab:-

launch ec2--windows as bastion

launche--ec2--linux--webserver

------>bastion--->3389--0.0.0.0/0----bastion-sg

------>webserver-->22---bastion-sg

bastion---gitbash or putty----

s3----simple storage service

-->bucket (objects--files or directories)

-->bucket level policy

-->s3 cross region

-->bucket level security and encryption

-->Versioning

-->command line access to s3 service

-->s3 as a static website hosting

-->Cloudfront (CDN)

s3 bucket can be public or private.

s3 is a regional service and can be accessed from anywhere.

IAM role--->ec2-member---->full s3------>ec2 machine

s3 --storage types in s3.

standard

infreequent

glacier

Apache--http server/web server--80-----------ec2---OS

static content

s3

how do enable the bucket level policy ?

how do you enable lifecycle, versioning, cross region and other account access ?

make bucket as a static hosting ?

what is s3 ?

lab: Hosting a Static Website on Amazon S3

https://www.free-css.com/free-css-templates/page233/innova

Route--53---hosted zone---record set---www.awsmiddleware.in------------s3 endpoint

http://awsmiddleware-admin.s3-website-us-east-1.amazonaws.com/s3.wrf

http://awsmiddleware-admin.s3-website-us-east-1.amazonaws.com/web.exe

AWS Deployment models

blue/green deployment

blue=live=1.0----green

green=latest=2.0---live--blue

devops deployment models

b/g

canary

ec2 --security group--firewall

0.0.0.0

LAB:

create two ec2 machines

make one as bastion

another one as application

create two security groups

name: bastion-sg and application-sg

bastion-sg

ssh-22-0.0.0.0

application-sg

ssh--22--bastion-sg

first connect to the bastion

ssh -i devops.pem ec2-user@18.206.154.64

ssh clients: putty , gitbash and mobxterm

to copy from local to remote server

filezilla--gui

winscp--gui

scp

scp -i devops.pem devops.pem ec2-user@18.206.154.64:/home/ec2-user/

remote port open or not

s3 is simple storage service==google drive==object storage

its unlimited

buckets--->5TB

standard----default--immidiately

infreequent--minuites

glacier--archive data----hours time

s3 life cycle management

telnet ip/name port

nc (netcat)

nc -v ip port

connection failed to application ec2 machine

success for bastion ec2 machine

ping

connection timeout(ssh -22)

Cloudtrail

0.0.0.0--sg---notification--cloudtrail-------------lamda functions-----email--us---redsignal

==================

Day-8--Week-2

=================

bastion- done-security group -- 0.0.0.0/0 ---22--ssh---pem: bastion

web: security group --- 22--ssh -- bastion-sg

vpn--

lab: assign a elastic ip to ec2 machine and deassociate.

[ec2-user@ip-172-31-90-96 ~]$ whoami

ec2-user

[ec2-user@ip-172-31-90-96 ~]$

[user@hostname]$

[root@hostname]#

gangi

typing commands---shell(bash/ksh/csh/zsh)----kernel---hardware

kernel==high level language to low level

english to machine level understand language.

bash = shell and checks your commands synatax and semantic.

lab:-

Changing the hostname of ec2 machine.

/etc/hostname

/etc/hosts

users: Administrator(root) and normal user(ec2-user)

/home/<username>

/home/ec2-user

Normal uuser------->root

su - root

su

su -

---------------------------->need password of root user.

su - otheruser

--------->other user password

============================================

ec2-user-------------->sudoers

vi /etc/hostname -----------

modes: readonly(escape) /insert /execution

after entering into insert mode --enter your cotnent---to save

esc + shift + ; ---wq!

w=write/save

q=quit

!=forceful come out of vi

/etc/hosts

privateip bastion

hostname -F /etc/hostname

bastion--

webserver

Loginto the webserver

yum install httpd -y -----------instal httpd/apache webserver--80--

systemctl start httpd -----------start httpd/apache

bastion-webserver

[root@webserver ec2-user]#

[root@webserver ec2-user]# systemctl start httpd

[root@webserver ec2-user]# ps -ef | grep httpd

protocal://ip:port/

http://54.89.102.180/------------------web-sg--(80)-----ec2---80---apache

tell your webserver ip--

what is ssh and telent ?

diff

==============

Day-9--Week-2

==============

lab:-

bastion-webserver(apache/httpd)

changing the hostname

assigning EIP

to play the videos of our recording--install the web.exe( upload in sometime to webserver).

IAM basics

Need of IAM

-->creating the users in IAM

-->Roles

-->Assigning the roles to aws services--ec2

-->basics of linux

next?

Select the security group as myip--tell me the ip address ?

Cloudtrail=all the aws console clicks and activities will be saved into cloudtrail(auditing).

Poweruser--Root user of AWS console--has access to all the services.

--->all the people not use all services.

users will be used by us.

roles will be used by aws services.

https://644308608816.signin.aws.amazon.com/console

AWS console--username and password---MFA.

----->policy--json format.

set of instructions(permissions) and actions.

default policy(aws gave default) and custom policy(we need to create--policy generator).

lab:create devmember1 and assign ec2read only .

login with that user.

create the group -- testing and assign cloudwatchfull access policy.

ARN: amazon resource name.

authentication: username and password

authorization : level of policy/role.

create user: devops-admin

provvide : administrator

create role called: ec2-member and give s3 access, assign the role to ec2 machine.

what is the IAM user and power user and role ?

types of access to users ?

next ? how to create cross account IAM role ?

ec2---linux , windows

==============

Day-10--Week-2

==============

lab:-

launch ec2--windows as bastion

launche--ec2--linux--webserver

------>bastion--->3389--0.0.0.0/0----bastion-sg

------>webserver-->22---bastion-sg

bastion---gitbash or putty----

s3----simple storage service

-->bucket (objects--files or directories)

-->bucket level policy

-->s3 cross region

-->bucket level security and encryption

-->Versioning

-->command line access to s3 service

-->s3 as a static website hosting

-->Cloudfront (CDN)

s3 bucket can be public or private.

s3 is a regional service and can be accessed from anywhere.