md example for extra field in custom SSHSparkOperator

ahmadMuhammadGd · Sep 13, 2024 · ddfb51f · ddfb51f
1 parent d8f9746
commit ddfb51f
Showing 1 changed file with 6 additions and 4 deletions.
diff --git a/airflow/plugins/operators/sparkSSH.md b/airflow/plugins/operators/sparkSSH.md
@@ -1,13 +1,15 @@
 # SSHSparkOperator
 
-This is an extra field example
-> It's important to submit minio-related spark jobs
-
+## How to use?
+- Create an SSH connection with hostname, password, and port
+- In case of using Minio-related spark submits, add this extra field:  
 ```json
 {
   "AWS_ACCESS_KEY_ID": "admin",
   "AWS_SECRET_ACCESS_KEY": "password",
   "AWS_REGION": "us-east-1",
   "AWS_DEFAULT_REGION": "us-east-1"
 }
-```
+```
+## Important Note 
+DO NOT USE THIS IN PRODUCTION !!!!!!!!