Initial Checks
Description
Since we want to move away from DVC there is a need for native file-system based caching.
The BaseStepExecuter needs to be extended to accomodate the following features:
- On execute_step check if inputs have previously been seen
- If so don't do anything
- If not run step
- Cleanup of old outputs (Problem: a previously executed step
Wurzel CLI needs to be extended to also accept a list of files as input, so that we can do caching based on either folder or file base
Initial Checks
Description
Since we want to move away from DVC there is a need for native file-system based caching.
The BaseStepExecuter needs to be extended to accomodate the following features:
Wurzel CLI needs to be extended to also accept a list of files as input, so that we can do caching based on either folder or file base