Date Train Validation Leakage Duplicates¶
[1]:
from deepchecks.checks.methodology import DateTrainTestLeakageDuplicates
from deepchecks.base import Dataset, Suite
from datetime import datetime
import pandas as pd
def dataset_from_dict(d: dict, datetime_name: str = None) -> Dataset:
dataframe = pd.DataFrame(data=d)
return Dataset(dataframe, datetime_name=datetime_name)
Synthetic example with date leakage¶
[2]:
train_ds = dataset_from_dict({'col1': [
datetime(2021, 10, 1, 0, 0),
datetime(2021, 10, 1, 0, 0),
datetime(2021, 10, 1, 0, 0),
datetime(2021, 10, 2, 0, 0),
datetime(2021, 10, 2, 0, 0),
datetime(2021, 10, 2, 0, 0),
datetime(2021, 10, 3, 0, 0),
datetime(2021, 10, 3, 0, 0),
datetime(2021, 10, 3, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 5, 0, 0),
datetime(2021, 10, 5, 0, 0)
]}, 'col1')
test_ds = dataset_from_dict({'col1': [
datetime(2021, 9, 4, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 5, 0, 0),
datetime(2021, 10, 6, 0, 0),
datetime(2021, 10, 6, 0, 0),
datetime(2021, 10, 7, 0, 0),
datetime(2021, 10, 7, 0, 0),
datetime(2021, 10, 8, 0, 0),
datetime(2021, 10, 8, 0, 0),
datetime(2021, 10, 9, 0, 0),
datetime(2021, 10, 9, 0, 0)
]}, 'col1')
DateTrainTestLeakageDuplicates(n_to_show=3).run(train_dataset=train_ds, test_dataset=test_ds)
Date Train-Test Leakage (duplicates)
Check if test dates are present in train data. Read More...
Additional Outputs
18.18% of test data dates appear in training data
| 0 | |
|---|---|
| Sample of test dates in train: | ['2021/10/04 00:00:00.000000 ', '2021/10/05 00:00:00.000000 '] |
Synthetic example no date leakage¶
[3]:
train_ds = dataset_from_dict({'col1': [
datetime(2021, 10, 3, 0, 0),
datetime(2021, 10, 3, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 4, 0, 0),
datetime(2021, 10, 5, 0, 0),
datetime(2021, 10, 5, 0, 0)
]}, 'col1')
test_ds = dataset_from_dict({'col1': [
datetime(2021, 11, 4, 0, 0),
datetime(2021, 11, 4, 0, 0),
datetime(2021, 11, 5, 0, 0),
datetime(2021, 11, 6, 0, 0),
]}, 'col1')
DateTrainTestLeakageDuplicates().run(train_dataset=train_ds, test_dataset=test_ds)
Date Train-Test Leakage (duplicates)
Check if test dates are present in train data. Read More...
Additional Outputs
✓ Nothing found