Commit Graph

1300 Commits

Author SHA1 Message Date
Benjamin Chastanier
32714cae00 feat: aws kubeconfig retrieval improvment
This CL tries to introduce a better handling of S3 eventual consitency.
https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html#ConsistencyModel

Issue was at cluster creation, we try to get a kubeconfig which doesn't
exists yet in order to know whether or not the cluster exists and needs
to be upgraded. It leads to S3 caching the fact this bucket doesn't
exists and reject later s# get while the bucket actually exists.

By introducing a retry mechanism, we allow s3 to properly propagate new
file / bucket creation and reach consistency.

lint: remove redundant clone()

build: fix moved value

chore: upgrade ec2 terraform libs

feat: add kubeconfig to s3 + firewall rules + clean + EC2 helm charts

fix: fix several issues

feat: adding EC2 port open check to avoid random issues
2022-05-03 16:02:55 +02:00
Romaric Philogene
601e9d083c Merge remote-tracking branch 'origin/feat/edge_init' into feat/edge_init
# Conflicts:
#	lib/aws-ec2/bootstrap/documentdb.tf
#	lib/aws-ec2/bootstrap/ec2-sec-group.tf
#	lib/aws-ec2/bootstrap/ec2-vpc.j2.tf
#	lib/aws-ec2/bootstrap/ec2.j2.tf
#	lib/aws-ec2/bootstrap/elasticcache.tf
#	lib/aws-ec2/bootstrap/elasticsearch.tf
#	lib/aws-ec2/bootstrap/qovery-vault.j2.tf
#	lib/aws-ec2/bootstrap/rds.tf
#	lib/aws-ec2/services/common/providers.j2.tf
#	src/cloud_provider/aws/kubernetes/ec2.rs
#	src/cloud_provider/aws/kubernetes/eks.rs
#	src/cloud_provider/aws/kubernetes/mod.rs
#	test_utilities/src/aws.rs
#	test_utilities/src/common.rs
#	test_utilities/src/digitalocean.rs
#	test_utilities/src/scaleway.rs
#	tests/aws/aws_kubernetes_ec2.rs
2022-04-29 11:47:13 +02:00
Benjamin Chastanier
95f3f15fbf fix: setup proper tf values for ec2 2022-04-28 18:17:45 +02:00
Benjamin Chastanier
d9d04a93f7 fix: setup proper tf values for ec2 2022-04-28 17:48:31 +02:00
Benjamin Chastanier
e01b17b030 comment: flag EKS k8s provider 2022-04-28 10:28:23 +02:00
Benjamin Chastanier
b8d0923d2c comment: flag EC2 k8s provider 2022-04-27 16:14:51 +02:00
Benjamin Chastanier
4567fbf9d5 review: applying review feedbacks 2022-04-27 14:54:08 +02:00
Benjamin Chastanier
68810bf05e fix: linter 2022-04-27 14:10:04 +02:00
Benjamin Chastanier
0856a7b8a4 tests: create tag for AWS EC2 infra tests
AWS EC2 infrastructure tests will have a dedicated CI pipeline bucket.

Ticket: ENG-1179
2022-04-27 13:22:28 +02:00
Romaric Philogene
f0f8100090 chore: fix linter 2022-04-27 13:22:28 +02:00
Romaric Philogene
e2bf484cf2 chore: fix linter 2022-04-27 13:22:28 +02:00
Romaric Philogene
66246db3a5 chore: fix linter 2022-04-27 13:22:28 +02:00
Romaric Philogene
5b19a52657 wip: fix ec2 tests 2022-04-27 13:22:27 +02:00
Romaric Philogene
302eafc23e wip: fix ec2 tests 2022-04-27 13:22:27 +02:00
Romaric Philogene
039a45e848 wip: refactor according to Benjamin C. feedback 2022-04-27 13:22:27 +02:00
Pierre Mavro
b5d71b2abb feat: add security rules to aws EC2 2022-04-27 13:22:27 +02:00
Pierre Mavro
b1062387d6 feat: update tf config for aws ec2 2022-04-27 13:22:27 +02:00
Romaric Philogene
ab77b8f46f wip: add ec2 subnets 2022-04-27 13:22:27 +02:00
Romaric Philogene
d29de40e26 wip: fix clippy errors 2022-04-27 13:22:27 +02:00
Romaric Philogene
259a7a6093 wip: fix multi kubernetes provider tests 2022-04-27 13:22:27 +02:00
Romaric Philogene
6e7c8b9e60 wip: prepare AWS EC2 Kubernetes provider 2022-04-27 13:22:20 +02:00
Romaric Philogene
da2e465320 wip: add EC2.new(..) with inner properties 2022-04-27 13:18:57 +02:00
Romaric Philogene
2e0cd0fc90 wip: add ec2 Kubernetes.kind 2022-04-27 13:18:57 +02:00
Romaric Philogene
143660cb46 fix: make ToTeraContext public trait 2022-04-27 13:18:57 +02:00
Pierre Mavro
bd95f272c6 feat: add edge aws struct 2022-04-27 13:18:57 +02:00
Erèbe - Romain Gerard
0a5a7eba1f Add cluster-agent installation (#699) 2022-04-27 10:23:00 +02:00
Romaric Philogene
c6571629ea chore: fix linter 2022-04-26 11:14:31 +02:00
Romaric Philogene
2b713aa80b chore: fix linter 2022-04-26 11:03:42 +02:00
Romaric Philogene
2446c7241f chore: fix linter 2022-04-26 09:37:58 +02:00
Romaric Philogene
49bfcdc327 wip: fix ec2 tests 2022-04-23 00:02:24 +02:00
Romaric Philogene
3a5fb696ca wip: fix ec2 tests 2022-04-22 23:56:43 +02:00
Romaric Philogene
5e0739586b wip: refactor according to Benjamin C. feedback 2022-04-22 21:06:25 +02:00
Pierre Mavro
d18d8e745a feat: add security rules to aws EC2 2022-04-22 19:58:06 +02:00
Pierre Mavro
0f193fbde5 feat: update tf config for aws ec2 2022-04-22 16:43:16 +02:00
Romaric Philogene
6c06fd7e54 wip: add ec2 subnets 2022-04-22 10:48:48 +02:00
Erèbe - Romain Gerard
d603c04920 Fix: revert clusterId to be a short id (#697)
- Managed Databases use the clusterId in order find back the VPC
2022-04-22 09:27:45 +02:00
Romaric Philogene
79b7bea8af wip: fix clippy errors 2022-04-21 22:19:46 +02:00
Romaric Philogene
1a2c96b122 wip: fix multi kubernetes provider tests 2022-04-21 22:13:57 +02:00
Romaric Philogene
50ed72b331 wip: prepare AWS EC2 Kubernetes provider 2022-04-21 22:05:38 +02:00
Romaric Philogene
d21a867cc6 wip: add EC2.new(..) with inner properties 2022-04-21 11:49:23 +02:00
Erèbe - Romain Gerard
bb85c03724 Change quay.io to docker.io as bitnami move their registry (#695) 2022-04-21 09:25:59 +02:00
Romaric Philogene
eb21185c41 wip: add ec2 Kubernetes.kind 2022-04-20 22:10:28 +02:00
Romaric Philogene
759c521fb2 fix: make ToTeraContext public trait 2022-04-20 18:44:45 +02:00
Pierre Mavro
2959567198 feat: add edge aws struct 2022-04-20 18:14:58 +02:00
Erèbe - Romain Gerard
7b57f7de0d Remove cluster name from tag, as it may contain invalid characters (#692) 2022-04-19 14:34:27 +02:00
Romain GERARD
6a6a836308 Revert "Revert "feat: add new tag to cloud providers""
This reverts commit f93a07b2dd.
2022-04-19 14:26:17 +02:00
Romain GERARD
f93a07b2dd Revert "feat: add new tag to cloud providers"
This reverts commit 1303e2e668.
2022-04-19 14:20:53 +02:00
BenjaminCh
0bcf535414 fix: avoid exposing env vars in helm logs (#691) 2022-04-19 11:58:22 +02:00
BenjaminCh
50b58064fc feat: add application commit ID to logs (#689)
This CL adds:
- application commit ID to some application actions logs.
- application commit ID annotation / label to application deployment
  yaml so it can be retrieved later on from other services

Ticket: ENG-1170
2022-04-19 11:57:48 +02:00
Pierre Mavro
1303e2e668 feat: add new tag to cloud providers 2022-04-18 10:38:57 +02:00