Skip to content

Commit

Permalink
[MINOR][SS] Fix kafka-0-10-sql trivials
Browse files Browse the repository at this point in the history
## What changes were proposed in this pull request?

Fix unused imports & outdated comments on `kafka-0-10-sql` module. (Found while I was working on [SPARK-23539](apache#22282))

## How was this patch tested?

Existing unit tests.

Closes apache#22342 from dongjinleekr/feature/fix-kafka-sql-trivials.

Authored-by: Lee Dongjin <[email protected]>
Signed-off-by: Sean Owen <[email protected]>
  • Loading branch information
dongjinleekr authored and srowen committed Sep 7, 2018
1 parent 22a46ca commit 458f501
Show file tree
Hide file tree
Showing 3 changed files with 2 additions and 4 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,6 @@ import org.apache.spark.sql.sources.v2.DataSourceOptions
private[kafka010] class KafkaOffsetRangeCalculator(val minPartitions: Option[Int]) {
require(minPartitions.isEmpty || minPartitions.get > 0)

import KafkaOffsetRangeCalculator._
/**
* Calculate the offset ranges that we are going to process this batch. If `minPartitions`
* is not set or is set less than or equal the number of `topicPartitions` that we're going to
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,6 @@

package org.apache.spark.sql.kafka010

import java.{util => ju}
import java.util.UUID

import org.apache.kafka.common.TopicPartition
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -54,8 +54,8 @@ class KafkaStreamingWriteSupport(
}

/**
* A [[DataWriterFactory]] for Kafka writing. Will be serialized and sent to executors to generate
* the per-task data writers.
* A [[StreamingDataWriterFactory]] for Kafka writing. Will be serialized and sent to executors to
* generate the per-task data writers.
* @param topic The topic that should be written to. If None, topic will be inferred from
* a `topic` field in the incoming data.
* @param producerParams Parameters for Kafka producers in each task.
Expand Down

0 comments on commit 458f501

Please sign in to comment.