**How to Get Consumer Group Offsets in Golang Kafka 10?**
Getting Consumer Group Offsets in Golang Kafka 10
With the introduction of consumer group support in Golang's Kafka library (Sarama) in Kafka 10, developers now have access to consumer group-related features without relying on external libraries. One common task is retrieving the current message offset being processed by a consumer group. Previously, this required the use of Zookeeper-based solutions, such as Kazoo-go. Now, with Sarama-cluster, this can be achieved through the following code:
<code class="go">package main
import (
"context"
"log"
"strings"
"github.com/Shopify/sarama"
)
func main() {
groupName := "testgrp"
topic := "topic_name"
offset, err := GetCGOffset(context.Background(), "localhost:9092", groupName, topic)
if err != nil {
log.Fatal(err)
}
log.Printf("Consumer group %s offset for topic %s is: %d", groupName, topic, offset)
}
type gcInfo struct {
offset int64
}
func (g *gcInfo) Setup(sarama.ConsumerGroupSession) error {
return nil
}
func (g *gcInfo) Cleanup(sarama.ConsumerGroupSession) error {
return nil
}
func (g *gcInfo) ConsumeClaim(_ sarama.ConsumerGroupSession, claim sarama.ConsumerGroupClaim) error {
g.offset = claim.InitialOffset()
return nil
}
func GetCGOffset(ctx context.Context, brokers, groupName, topic string) (int64, error) {
config := sarama.NewConfig()
config.Consumer.Offsets.AutoCommit.Enable = false // we're not going to update the consumer group offsets
client, err := sarama.NewConsumerGroup(strings.Split(brokers, ","), groupName, config)
if err != nil {
return 0, err
}
info := gcInfo{}
if err := client.Consume(ctx, []string{topic}, &info); err != nil {
return 0, err
}
return info.offset, nil
}</code>The above is the detailed content of **How to Get Consumer Group Offsets in Golang Kafka 10?**. For more information, please follow other related articles on the PHP Chinese website!
Hot AI Tools
Undress AI Tool
Undress images for free
Undresser.AI Undress
AI-powered app for creating realistic nude photos
AI Clothes Remover
Online AI tool for removing clothes from photos.
ArtGPT
AI image generator for creative art from text prompts.
Stock Market GPT
AI powered investment research for smarter decisions
Hot Article
Hot Tools
Notepad++7.3.1
Easy-to-use and free code editor
SublimeText3 Chinese version
Chinese version, very easy to use
Zend Studio 13.0.1
Powerful PHP integrated development environment
Dreamweaver CS6
Visual web development tools
SublimeText3 Mac version
God-level code editing software (SublimeText3)
Go interface: Necessity under non-forced implementation
Sep 09, 2025 am 11:09 AM
Although Go's interfaces do not force explicit declaration implementations of types, they are still crucial in implementing polymorphism and code decoupling. By defining a set of method signatures, the interface allows different types to be processed in a unified way, enabling flexible code design and scalability. This article will explore the characteristics of the Go interface in depth and demonstrate its application value in actual development through examples.
How to determine the files involved in compilation during Go build?
Sep 09, 2025 am 11:57 AM
This article aims to help developers understand how to determine which files will be compiled and linked in a Go project, especially if system-specific files exist. We will explore two methods: parse the output using the go build -n command, and use the Import function of the go/build package. With these methods, you can have a clear understanding of the build process and better manage your project.
Resolve Go WebSocket EOF error: Keep the connection active
Sep 16, 2025 pm 12:15 PM
This article aims to resolve EOF (End-of-File) errors encountered when developing WebSocket using Go. This error usually occurs when the server receives the client message and the connection is unexpectedly closed, resulting in the subsequent messages being unable to be delivered normally. This article will analyze the causes of the problem, provide code examples, and provide corresponding solutions to help developers build stable and reliable WebSocket applications.
How do you read and write files in Golang?
Sep 21, 2025 am 01:59 AM
Goprovidessimpleandefficientfilehandlingusingtheosandbufiopackages.Toreadasmallfileentirely,useos.ReadFile,whichloadsthecontentintomemorysafelyandautomaticallymanagesfileoperations.Forlargefilesorincrementalprocessing,bufio.Scannerallowsline-by-liner
Start an external editor in the Go program and wait for it to complete
Sep 16, 2025 pm 12:21 PM
This article describes how to start an external editor (such as Vim or Nano) in a Go program and wait for the user to close the editor before the program continues to execute. By setting cmd.Stdin, cmd.Stdout, and cmd.Stderr, the editor can interact with the terminal to solve the problem of startup failure. At the same time, a complete code example is shown and precautions are provided to help developers implement this function smoothly.
What is the empty struct struct{} used for in Golang
Sep 18, 2025 am 05:47 AM
struct{} is a fieldless structure in Go, which occupies zero bytes and is often used in scenarios where data is not required. It is used as a signal in the channel, such as goroutine synchronization; 2. Used as a collection of value types of maps to achieve key existence checks in efficient memory; 3. Definable stateless method receivers, suitable for dependency injection or organization functions. This type is widely used to express control flow and clear intentions.
How to read configuration from files in Golang
Sep 18, 2025 am 05:26 AM
Use the encoding/json package of the standard library to read the JSON configuration file; 2. Use the gopkg.in/yaml.v3 library to read the YAML format configuration; 3. Use the os.Getenv or godotenv library to overwrite the file configuration; 4. Use the Viper library to support advanced functions such as multi-format configuration, environment variables, automatic reloading; it is necessary to define the structure to ensure type safety, properly handle file and parsing errors, correctly use the structure tag mapping fields, avoid hard-coded paths, and recommend using environment variables or safe configuration storage in the production environment. It can start with simple JSON and migrate to Viper when the requirements are complex.
What are middleware in the context of Golang web servers?
Sep 16, 2025 am 02:16 AM
MiddlewareinGowebserversarefunctionsthatinterceptHTTPrequestsbeforetheyreachthehandler,enablingreusablecross-cuttingfunctionality;theyworkbywrappinghandlerstoaddpre-andpost-processinglogicsuchaslogging,authentication,CORS,orerrorrecovery,andcanbechai
