Skip to content

Conversation

@james-willis
Copy link
Collaborator

Did you read the Contributor Guide?

Is this PR related to a JIRA ticket?

  • No, this is a documentation update. The PR name follows the format [DOCS] my subject.

I am addressing this github issue: #1399

What changes were proposed in this PR?

This PR proposes adding an AWS Glue setup tutorial to the Sedona documentation website

How was this patch tested?

  • built and ran the docs site locally.
    Screenshot 2024-06-03 at 5 43 43 PM

  • followed the tutorial using the wherobots jars in an account other than the one hosting the jars bucket.

Did this PR include necessary documentation updates?

  • Yes, I have updated the documentation.

[Wherobots](https://wherobots.com/) provides a public S3 bucket with the necessary jars. You can point to these directly in your glue jobs'
configurations. For 1.6.0, the sedona and geotools jars are available at the following locations:

* `s3://wherobots-sedona-jars/1.6.0/sedona-spark-shaded-3.0_2.12-1.6.0.jar`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you use the variable {{ sedona.current_version }} instead of hard coded version. See the example in other tutorial.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how can we ensure that these are updated when a new version of sedona is released?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because I will update the variable name after each release: https://github.com/apache/sedona/blob/master/mkdocs.yml#L161

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I mean the jars in the s3 bucket.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sadly, someone needs to add it manually.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a release checklist or something to which we can add to ping me to update the bucket?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@james-willis james-willis requested a review from jiayuasu June 5, 2024 05:57
@james-willis james-willis requested a review from jiayuasu June 5, 2024 06:36
@jiayuasu jiayuasu merged commit 3960db8 into apache:master Jun 6, 2024
Kontinuation pushed a commit to Kontinuation/sedona that referenced this pull request Oct 11, 2024
* add glue tutorial

* revise glue tutorial with PR feedback

* add spark/scala warning for picking out the jars

---------

Co-authored-by: jameswillis <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants