kafka学习
kafka学习资料
https://cloud.tencent.com/developer/article/1991788
https://blog.csdn.net/weixin_42837961/article/details/104796766
https://cloud.tencent.com/developer/article/1547380
https://www.w3ccoo.com/apache_kafka/
python使用kafka代码
# 1.代码地址:https://github.com/wwsit/python_files/tree/master/005_python/001_kafka
# 文档地址:https://cloud.tencent.com/document/product/597/63537
# 2.生产者:
from kafka import KafkaProducer
import json
# pip install kafka-python
producer = KafkaProducer(
bootstrap_servers=['ip地址:公网地址'],
api_version=(1, 1),
# SASL_PLAINTEXT 公网接入
security_protocol="SASL_PLAINTEXT",
sasl_mechanism="PLAIN",
sasl_plain_username="用户名",
sasl_plain_password="密码",
)
# 写入消息
for _ in range(10):
message = "Hello World! Hello Ckafka!"
msg = json.dumps(message, ensure_ascii=False).encode()
# topic_test:topic名称
producer.send('topic_test', value=msg)
print("produce message " + message + " success.")
producer.close()
# 消费者:
from kafka import KafkaConsumer
# topic_test: topic名称
# group_test:消费组的名称
consumer = KafkaConsumer(
'topic_test',
group_id="group_test",
bootstrap_servers=['ip地址:公网地址'],
api_version=(1, 1),
# SASL_PLAINTEXT 公网接入
security_protocol="SASL_PLAINTEXT",
sasl_mechanism="PLAIN",
sasl_plain_username="用户名",
sasl_plain_password="密码",
)
# 读取消息
for message in consumer:
print(message)
print("Topic:[%s] Partition:[%d] Offset:[%d] Value:[%s]" %
(message.topic, message.partition, message.offset, message.value))
print()
转载请注明来源,欢迎对文章中的引用来源进行考证,欢迎指出任何有错误或不够清晰的表达。
文章标题:kafka学习
本文作者:伟生
发布时间:2024-06-23, 22:07:15
最后更新:2024-06-23, 22:17:14
原始链接:http://yoursite.com/2024/06/23/db_04_kafka/版权声明: "署名-非商用-相同方式共享 4.0" 转载请保留原文链接及作者。