kfickel/streamd
1
0
Fork 0
Code Issues 6 Pull requests 2 Projects 1 Releases 7 Wiki Activity Actions

feat(localize): extract file_type from filename prefix

Browse source 
Add `extract_file_type_from_file_name` to parse prefixes like `_daily`
from filenames (e.g. `20260412-123456_daily.md` → `"daily"`).

Insert the result into `initial_location` in `localize_stream_file` so
all localized shards carry a `file_type` dimension value.

Also register the `file_type` dimension in `TaskConfiguration` so the
propagation contract is documented.
This commit is contained in:
Konstantin Fickel 2026-04-13 19:30:59 +02:00
parent e15e6f1053
commit b653590c36
Signed by: kfickel
GPG key ID: A793722F9933C1A5
4 changed files with 86 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/localize/mod.rs
View file

@ -9,7 +9,7 @@ pub use configuration::{
};
pub use datetime::{
extract_date_from_marker, extract_datetime_from_file_name, extract_datetime_from_marker,
extract_datetime_from_marker_list, extract_time_from_marker,
extract_datetime_from_marker_list, extract_file_type_from_file_name, extract_time_from_marker,
};
pub use preconfigured::TaskConfiguration;
pub use shard::{localize_shard, localize_stream_file};