kafka学习

  1. kafka学习资料
  2. python使用kafka代码

kafka学习资料

    https://cloud.tencent.com/developer/article/1991788
    https://blog.csdn.net/weixin_42837961/article/details/104796766
    https://cloud.tencent.com/developer/article/1547380
    https://www.w3ccoo.com/apache_kafka/

python使用kafka代码

    # 1.代码地址:https://github.com/wwsit/python_files/tree/master/005_python/001_kafka
    # 文档地址:https://cloud.tencent.com/document/product/597/63537


    # 2.生产者:
        from kafka import KafkaProducer
        import json
        
        # pip install kafka-python
        
        producer = KafkaProducer(
            bootstrap_servers=['ip地址:公网地址'],
            api_version=(1, 1),
        
            # SASL_PLAINTEXT 公网接入
            security_protocol="SASL_PLAINTEXT",
            sasl_mechanism="PLAIN",
            sasl_plain_username="用户名",
            sasl_plain_password="密码",
        )
        
        # 写入消息
        for _ in range(10):
            message = "Hello World! Hello Ckafka!"
            msg = json.dumps(message, ensure_ascii=False).encode()
        
            # topic_test:topic名称
            producer.send('topic_test', value=msg)
            print("produce message " + message + " success.")
        
        producer.close()



    # 消费者:
        from kafka import KafkaConsumer
        
        # topic_test: topic名称
        # group_test:消费组的名称
        consumer = KafkaConsumer(
            'topic_test',
            group_id="group_test",
            bootstrap_servers=['ip地址:公网地址'],
            api_version=(1, 1),
        
            # SASL_PLAINTEXT 公网接入
            security_protocol="SASL_PLAINTEXT",
            sasl_mechanism="PLAIN",
            sasl_plain_username="用户名",
            sasl_plain_password="密码",
        )
        
        # 读取消息
        for message in consumer:
            print(message)
            print("Topic:[%s] Partition:[%d] Offset:[%d] Value:[%s]" %
                  (message.topic, message.partition, message.offset, message.value))
            print()

转载请注明来源,欢迎对文章中的引用来源进行考证,欢迎指出任何有错误或不够清晰的表达。

文章标题:kafka学习

本文作者:伟生

发布时间:2024-06-23, 22:07:15

最后更新:2024-06-23, 22:17:14

原始链接:http://yoursite.com/2024/06/23/db_04_kafka/

版权声明: "署名-非商用-相同方式共享 4.0" 转载请保留原文链接及作者。

目录
×

喜欢就点赞,疼爱就打赏