Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func SecurityOptions ¶
func SecurityOptions(protocol string, sslConf *config.KafkaSSL, saslConf *config.KafkaSASL) ([]kgo.Opt, error)
SecurityOptions translates the security_protocol / ssl / sasl config blocks into franz-go client options. The config keys mirror librdkafka's, which is what the Python engine configures.
Types ¶
type Option ¶
type Option func(*Source)
func WithChannelBuffer ¶
func WithLogger ¶
func WithReadTimeout ¶
type Source ¶
type Source struct {
// contains filtered or unexported fields
}
func (*Source) CommitMarks ¶ added in v1.0.4
CommitMarks commits exactly the positions the pipeline has finished with.
Commit above commits everything this source has fetched, and the poll goroutine fetches well ahead of the pipeline: after one 20,000-message batch it had committed offset 70,086. A crash then lost the difference with the consumer group showing no lag. Kafka commits the next offset to read, so a mark at offset N commits N+1.
Source Files
Click to show internal directories.
Click to hide internal directories.