Commits

Branch selector

 master

User selector

xinrong-meng

Datepicker

All time

Commit History

Commits on Mar 28, 2023

• [SPARK-42908][PYTHON] Raise RuntimeError when SparkContext is required but not initialized

  Show description for 70f6206
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  70f6206

  Copy full SHA for 70f6206

Commits on Mar 23, 2023

• [SPARK-42903][PYTHON][DOCS] Avoid documenting None as as a return value in docstring

  Show description for ece156f
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  ece156f

  Copy full SHA for ece156f

• [SPARK-42891][CONNECT][PYTHON] Implement CoGrouped Map API

  Show description for 1fbc794
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  1fbc794

  Copy full SHA for 1fbc794

Commits on Mar 20, 2023

• [SPARK-42340][CONNECT][PYTHON] Implement Grouped Map API

  Show description for fee47c7
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  fee47c7

  Copy full SHA for fee47c7

Commits on Mar 15, 2023

• [SPARK-42765][CONNECT][PYTHON] Enable importing pandas_udf from pyspark.sql.connect.functions

  Show description for 149e020
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  149e020

  Copy full SHA for 149e020

Commits on Mar 10, 2023

• [SPARK-42739][BUILD] Ensure release tag to be pushed to release branch

  Show description for 785188d
  xinrong-meng

  committed
  785188d

  Copy full SHA for 785188d

• [SPARK-42726][CONNECT][PYTHON] Implement DataFrame.mapInArrow

  Show description for f35c2cb
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  f35c2cb

  Copy full SHA for f35c2cb

Commits on Mar 9, 2023

• [SPARK-42710][CONNECT][PYTHON] Rename FrameMap proto to MapPartitions

  Show description for 7a67be1
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  7a67be1

  Copy full SHA for 7a67be1

Commits on Mar 8, 2023

• [SPARK-42712][PYTHON][DOC] Improve docstring of mapInPandas and mapInArrow

  Show description for bacab6a
  

  xinrong-meng

  and

  HyukjinKwon

  committed
  bacab6a

  Copy full SHA for bacab6a

• [SPARK-42643][CONNECT][PYTHON] Register Java (aggregate) user-defined functions

  Show description for 92aa087
  xinrong-meng

  committed
  92aa087

  Copy full SHA for 92aa087

Commits on Feb 24, 2023

• [SPARK-42510][CONNECT][PYTHON] Implement DataFrame.mapInPandas

  Show description for 9abccad
  xinrong-meng

  committed
  9abccad

  Copy full SHA for 9abccad

Commits on Feb 22, 2023

• [SPARK-42524][BUILD] Upgrade numpy and pandas in the release Dockerfile

  Show description for d09742b
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  d09742b

  Copy full SHA for d09742b

Commits on Feb 14, 2023

• [SPARK-42428][CONNECT][PYTHON] Standardize __repr__ of CommonInlineUserDefinedFunction

  Show description for 676332a
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  676332a

  Copy full SHA for 676332a

• [SPARK-42263][CONNECT][PYTHON] Implement spark.catalog.registerFunction

  Show description for c619a40
  xinrong-meng

  committed
  c619a40

  Copy full SHA for c619a40

Commits on Feb 13, 2023

• [SPARK-42269][CONNECT][PYTHON] Support complex return types in DDL strings

  Show description for 3985b91
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  3985b91

  Copy full SHA for 3985b91

Commits on Feb 9, 2023

• [SPARK-42210][CONNECT][PYTHON] Standardize registered pickled Python UDFs

  Show description for e7eb836
  xinrong-meng

  committed
  e7eb836

  Copy full SHA for e7eb836

Commits on Feb 2, 2023

• [SPARK-42271][CONNECT][PYTHON] Reuse UDF test cases under pyspark.sql.tests

  Show description for 461e1b1
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  461e1b1

  Copy full SHA for 461e1b1

Commits on Jan 31, 2023

• [SPARK-42125][CONNECT][PYTHON] Pandas UDF in Spark Connect

  Show description for 0db63df
  xinrong-meng

  committed
  0db63df

  Copy full SHA for 0db63df

Commits on Jan 26, 2023

• [SPARK-42126][PYTHON][CONNECT] Accept return type in DDL strings for Python Scalar UDFs in Spark Connect

  Show description for dbd667e
  xinrong-meng

  committed
  dbd667e

  Copy full SHA for dbd667e

Commits on Jan 25, 2023

• [SPARK-42184][BUILD] Setting version to 3.5.0-SNAPSHOT

  Show description for 1322c86
  

  xinrong-meng

  authored and

  dongjoon-hyun

  committed
  1322c86

  Copy full SHA for 1322c86

• [SPARK-42124][PYTHON][CONNECT] Scalar Inline Python UDF in Spark Connect

  Show description for e363e9d
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  e363e9d

  Copy full SHA for e363e9d

Commits on Jan 17, 2023

• [SPARK-42095][CONNECT][PYTHON][TESTS] Fix gRPC check in tests

  Show description for 4810c86
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  4810c86

  Copy full SHA for 4810c86

Commits on Jan 12, 2023

• [SPARK-40307][PYTHON] Introduce Arrow-optimized Python UDFs

  Show description for 1d3ec69
  xinrong-meng

  committed
  1d3ec69

  Copy full SHA for 1d3ec69

Commits on Dec 15, 2022

• [SPARK-41472][CONNECT][PYTHON] Implement the rest of string/binary functions

  Show description for bbbacfb
  

  xinrong-meng

  and

  zhengruifeng

  committed
  bbbacfb

  Copy full SHA for bbbacfb

Commits on Dec 10, 2022

• [SPARK-41414][CONNECT][PYTHON] Implement date/timestamp functions

  Show description for 435f6b1
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  435f6b1

  Copy full SHA for 435f6b1

Commits on Dec 7, 2022

• [SPARK-41397][CONNECT][PYTHON] Implement part of string/binary functions

  Show description for d9c7908
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  d9c7908

  Copy full SHA for d9c7908

Commits on Dec 1, 2022

• [SPARK-41227][CONNECT][PYTHON] Implement DataFrame cross join

  Show description for 93b9dee
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  93b9dee

  Copy full SHA for 93b9dee

Commits on Nov 24, 2022

• [SPARK-41243][CONNECT][PYTHON][DOCS] Update the protobuf version in README

  Show description for 3627b3e
  

  xinrong-meng

  authored and

  zhengruifeng

  committed
  3627b3e

  Copy full SHA for 3627b3e

Commits on Nov 23, 2022

• Revert "Update pom.xml"

  Show description for 03cc935
  xinrong-meng

  committed
  03cc935

  Copy full SHA for 03cc935

• Update pom.xml

  xinrong-meng

  authored
  c0746df

  Copy full SHA for c0746df

Commits on Nov 18, 2022

• [SPARK-41107][PYTHON][INFRA][TESTS] Install memory-profiler in the CI

  Show description for 12a77bb
  

  xinrong-meng

  and

  Yikun

  committed
  12a77bb

  Copy full SHA for 12a77bb

Commits on Nov 17, 2022

• [SPARK-41150][PYTHON][DOCS] Document debugging with PySpark memory profiler

  Show description for d1b88a7
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  d1b88a7

  Copy full SHA for d1b88a7

Commits on Nov 16, 2022

• Revert "add Memory Profile for UDFs"

  Show description for 560560a
  xinrong-meng

  committed
  560560a

  Copy full SHA for 560560a

• add Memory Profile for UDFs

  xinrong-meng

  committed
  5babd13

  Copy full SHA for 5babd13

Commits on Nov 11, 2022

• [SPARK-40281][PYTHON] Memory Profiler on Executors

  Show description for 0cb79a4
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  0cb79a4

  Copy full SHA for 0cb79a4

Pagination

Previous

Next