The batch size is a function of the model's size alone: getStreamingBatchSize
reads fileSizeMB (falling back to the buffer's own length when it is absent
or zero) and picks a fixed value from a size ladder. There is no ramp-up, and
no other field on this object is consulted.
Dynamic batch configuration for streaming.
The batch size is a function of the model's size alone:
getStreamingBatchSizereadsfileSizeMB(falling back to the buffer's own length when it is absent or zero) and picks a fixed value from a size ladder. There is no ramp-up, and no other field on this object is consulted.