Support custom spark procedure in plugin mode for iceberg

[zhangjun0x01]

Feature Request / Improvement

When we want to use SQL to perform a complex function, we can encapsulate it as an spark action and spark procedure, but we must write it in the source code of Iceberg. We expect Iceberg to support this function through plugins without modifying its source code, just like UDF function

Query engine

Spark

Willingness to contribute

• I can contribute this improvement/feature independently
• I would be willing to contribute this improvement/feature with guidance from the Iceberg community
• I cannot contribute this improvement/feature at this time

[manuzhang]

You may check out SQL UDFs in Iceberg proposal and join discussions on the dev list.

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'