Summary
Track code cleanup tasks after the distributed architecture is fully implemented.
Parent Epic
When to Execute
After all distributed features are complete and tested (Phase 10+)
Code to Remove
1. TiKV Backup Directory
Code to Refactor
2. OssStorage Full-Object Buffering
3. Sequential Multipart Uploads
4. Sequential Batch Processing
5. Sequential Reader Usage
Code to Deprecate
6. Python Examples
TODOs to Address
Tests to Update
Acceptance Criteria
Summary
Track code cleanup tasks after the distributed architecture is fully implemented.
Parent Epic
When to Execute
After all distributed features are complete and tested (Phase 10+)
Code to Remove
1. TiKV Backup Directory
crates/roboflow-distributed/src/tikv_backup/(duplicate oftikv/)Code to Refactor
2. OssStorage Full-Object Buffering
crates/roboflow-storage/src/oss.rslines 213-239bytes().await.to_vec()with streaming reader3. Sequential Multipart Uploads
crates/roboflow-storage/src/multipart.rslines 281-3374. Sequential Batch Processing
crates/roboflow-pipeline/src/fluent/builder.rslines 439-4565. Sequential Reader Usage
crates/roboflow-pipeline/src/orchestrator/orchestrator.rslines 398-403Code to Deprecate
6. Python Examples
examples/python/roboflow_utils.py::BatchProcessorexamples/python/batch_conversion.pyTODOs to Address
crates/roboflow-pipeline/src/fluent/builder.rsline 397 - Standard pipelinecrates/roboflow-pipeline/src/fluent/builder.rslines 543, 596, 609, 657, 672, 690examples/rust/lerobot_convert.rslines 51, 73, 92tests/kps_integration_tests.rsline 18Tests to Update
tests/sequential_parallel_comparison_tests.rs- Add distributed teststests/pipeline_round_trip_tests.rs- Add job processing teststests/streaming_converter_tests.rs- Add distributed streaming testsAcceptance Criteria