Skip to content

Commit

Permalink
update images and spacing
Browse files Browse the repository at this point in the history
  • Loading branch information
DanRoscigno committed Aug 5, 2022
1 parent f71bc60 commit e42f9ea
Show file tree
Hide file tree
Showing 19 changed files with 53 additions and 35 deletions.
88 changes: 53 additions & 35 deletions docs/en/guides/sre/configuring-s3-for-clickhouse-use.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,69 +12,86 @@ You should work with your security team to determine the permissions to be used,
In this procedure, we'll be creating a service account user, not a login user.
1. Log into the AWS IAM Management Console.

2. In "users", select `add users`
![create_iam_user_0](https://user-images.githubusercontent.com/18219420/177866864-871e7bf2-714d-4bc5-9876-ee6833c1e9da.png)
2. In "users", select **Add users**

3. Enter the user name and set the credential type to `Access key - Programatic access` and select `Next: Permissions`
![create_iam_user_1](https://user-images.githubusercontent.com/18219420/177867270-18009113-6098-4c36-94ea-a4d61b62461b.png)
![create_iam_user_0](./images/s3-1.png)

4. Do not add the user to any group, select `Next: Tags`
![create_iam_user_2](https://user-images.githubusercontent.com/18219420/177867667-19fcd2f6-5806-4466-8d64-b6de58ba48fa.png)
3. Enter the user name and set the credential type to **Access key - Programmatic access** and select **Next: Permissions**

5. Unless you need to add any tags, select `Next: Review`
![create_iam_user_3](https://user-images.githubusercontent.com/18219420/177867791-1c9340ab-d242-4349-abc0-0ba5cf313566.png)
![create_iam_user_1](./images/s3-2.png)

6. Select `Create User`
4. Do not add the user to any group; select **Next: Tags**

![create_iam_user_2](./images/s3-3.png)

5. Unless you need to add any tags, select **Next: Review**

![create_iam_user_3](./images/s3-4.png)

6. Select **Create User**
:::note
The warning message stating that the user has no permissions can be ignored; permissions will be granted on the bucket for the user in the next section
:::
![create_iam_user_4](https://user-images.githubusercontent.com/18219420/177868141-eabed9bb-087a-4db3-918a-84739e1d7487.png)

7. The user is now created, click on `show` and copy the access and secret keys.
![create_iam_user_4](./images/s3-5.png)

7. The user is now created; click on **show** and copy the access and secret keys.
:::note
Save the keys somewhere else, this is the only time that the secret access key will be available.
Save the keys somewhere else; this is the only time that the secret access key will be available.
:::
![create_iam_user_5](https://user-images.githubusercontent.com/18219420/180260372-8f3e7d3d-9c5e-430f-9e86-54079127c7ff.png)

8. Click close, then find the user created in the users screen.
![create_iam_user_6](https://user-images.githubusercontent.com/18219420/177869430-919c4fc2-3226-43ce-ba19-1bd21eab16c1.png)
![create_iam_user_5](./images/s3-6.png)

9. Copy the ARN (Amazon Resource Name) and save for use when configuring the access policy for the bucket.
![create_iam_user_7](https://user-images.githubusercontent.com/18219420/180262876-4d65cf19-4427-4ac7-b68d-1982e4f27610.png)
8. Click close, then find the user in the users screen.

![create_iam_user_6](./images/s3-7.png)

9. Copy the ARN (Amazon Resource Name) and save it for use when configuring the access policy for the bucket.

![create_iam_user_7](./images/s3-8.png)

## Create an S3 bucket
1. In the S3 bucket section, select `Create bucket`
![create_s3_bucket_0](https://user-images.githubusercontent.com/18219420/177871069-041b1d78-7c85-4fdf-ab78-134b71506d9b.png)
1. In the S3 bucket section, select **Create bucket**

![create_s3_bucket_0](./images/s3-9.png)

2. Enter a bucket name, leave other options default
:::note
The bucket name must be unique across AWS, not just the organization, or it will emit an error.
:::
3. Leave `Block all Public Access` enabled, it is not needed.
![create_s3_bucket_2](https://user-images.githubusercontent.com/18219420/177871668-68460623-cb73-445d-9e2d-0b3393e7f152.png)
3. Leave `Block all Public Access` enabled; public access is not needed.

4. Select `Create Bucket` at the bottom of the page
![create_s3_bucket_3](https://user-images.githubusercontent.com/18219420/177872284-4c1732d1-c56b-4cea-8f52-049dd341ebfe.png)
![create_s3_bucket_2](./images/s3-a.png)

5. Select the link and Copy the ARN and save for use when configuring the access policy for the bucket.
4. Select **Create Bucket** at the bottom of the page

![create_s3_bucket_3](./images/s3-b.png)

5. Select the link, copy the ARN, and save it for use when configuring the access policy for the bucket.

6. Once the bucket has been created, find the new S3 bucket in the S3 buckets list and select the link
![create_s3_bucket_4](https://user-images.githubusercontent.com/18219420/177872474-fde2e93f-7920-4f2d-8d3e-4c60c61b115f.png)

7. Select `Create folder`
![create_s3_bucket_5](https://user-images.githubusercontent.com/18219420/177872808-31b90ddb-c276-4f96-baf7-da3987c70244.png)
![create_s3_bucket_4](./images/s3-c.png)

7. Select **Create folder**

![create_s3_bucket_5](./images/s3-d.png)

8. Enter a folder name which will be the target for the ClickHouse S3 disk and select **Create folder**

8. Enter a folder name which will be the target for the ClickHouse S3 disk and select `Create folder`
![create_s3_bucket_6](https://user-images.githubusercontent.com/18219420/177872959-5ba3dd99-7a27-4831-bc8b-f8288c5ae663.png)
![create_s3_bucket_6](./images/s3-e.png)

9. The folder should now be visible on the bucket list
![create_s3_bucket_7](https://user-images.githubusercontent.com/18219420/180263927-9e95b98e-92bf-4bf7-86f2-b155452d8209.png)

10. Select the checkbox for the new folder and click on `Copy URL`. Save the URL copied to be used in the ClickHouse storage configuration in the next section.
![create_s3_bucket_8](https://user-images.githubusercontent.com/18219420/177873720-85cd708e-f84f-4854-8347-b385e8172da1.png)
![create_s3_bucket_7](./images/s3-f.png)

11. Select the `Permissions` tab and click on the `Edit` button in the `Bucket Policy` section
![create_s3_bucket_9](https://user-images.githubusercontent.com/18219420/177874477-f0949992-8fbd-4ed4-898b-a0912f11ead9.png)
10. Select the checkbox for the new folder and click on **Copy URL** Save the URL copied to be used in the ClickHouse storage configuration in the next section.

![create_s3_bucket_8](./images/s3-g.png)

11. Select the **Permissions** tab and click on the **Edit** button in the **Bucket Policy** section

![create_s3_bucket_9](./images/s3-h.png)

12. Add a bucket policy, example below:
```json
Expand Down Expand Up @@ -257,7 +274,8 @@ Query id: 967a8f0c-3b67-4154-830f-33bd6ad386ce
```
6. In the AWS console, navigate to the buckets, select the new one and the folder.
You should see something like the following:
![create_s3_bucket_10](https://user-images.githubusercontent.com/18219420/177881470-b8a14d62-f4a6-466f-8a86-95390623f25f.png)

![create_s3_bucket_10](./images/s3-j.png)

## Summary
This article provided simple step-by-step instructions on configuring AWS S3 bucket for access and use as a disk for ClickHouse.
Expand Down
Binary file added docs/en/guides/sre/images/s3-1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-4.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-5.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-6.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-7.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-8.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-9.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-a.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-b.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-c.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-d.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-e.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-f.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-g.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-h.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/en/guides/sre/images/s3-j.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit e42f9ea

Please sign in to comment.