what or who benefits from this amount of time being non-0. I'd like to know why you would do that, i.e. The documentation just states "The amount of time to wait before deleting a file from the filesystem". I'm wondering what .ms is for, and if I can safely set it to 0 (or some very small value - 5?). (You can even pull stunts like determining your maximum write rate (disk or network bound) and then subtract a safety margin based on that and .ms, and maybe some absolute offset of the 10MB head index file.) That's all been discussed in other questions, I'm not asking about any of that. Mostly, this amounts to some calculation like segment=min(1GB, 0.1 * $max_space / $partitions) and setting tes=($max_space / $partitions - $segment),tes=$segment and reducing .ms. ![]() or a single instance for the whole team.I'm trying to put an absolute limit to the size of a topic so it won't fill up disks in case of unexpectedly high write speeds.As a Docker container deployed closer to your Kafka cluster. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |