Overview


Overview of the dataset, analysis and alerts.

Dataset

Analysis

Alerts

CANCELLED
13 (6%)
9 (4%)
174 (88%)
DEPARTURE_DELAY
11 (5%)
2 (1%)
183 (93%)
AIRLINE
4 (3%)
2 (1%)
99 (94%)
TAXI_OUT
5 (2%)
1 (0%)
190 (96%)
AIR_TIME
4 (2%)
4 (2%)
188 (95%)
DISTANCE
4 (2%)
2 (1%)
190 (96%)

Histograms


This section contains visualisations of individual histograms and heatmaps of them over time.

Heatmap

The heatmap shows the frequency of each value over time. If a variable has a high number of distinct values(i.e. has a high cardinality), then the most frequent values are displayed and the remaining are grouped as 'Others'. The maximum number of values to should is configurable (default: 20).

Column-Normalized Heatmap

The column-normalized heatmap allows for comparing of time bins when the counts in each bin vary.

Row-Normalized Heatmap

The row-normalized heatmaps allows for monitoring one value over time.

Histogram Inspector

Histogram Inspector

Histogram Inspector

Histogram Inspector

Histogram Inspector

Histogram Inspector

Traffic Lights


Traffic light calculation for different statistics (based on the calculated normalized residual, a.k.a. pull). Statistics for which all traffic lights are green are hidden from view by default.

Overview

count pull       
distinct pull       
entropy pull       
filled pull       
nan pull       
overflow pull       
prev1 chi2 zscore       
prev1 ks zscore       
ref chi2 zscore       
ref jsd pull       
ref ks zscore       
ref max prob diff pull       
ref psi pull       
ref unknown labels       
underflow pull       
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

count pull       
distinct pull       
entropy pull       
filled pull       
max pull       
mean pull       
mean trend10 zscore       
min pull       
most probable value pull       
nan pull       
overflow pull       
p01 pull       
p05 pull       
p16 pull       
p50 pull       
p84 pull       
p95 pull       
p99 pull       
prev1 chi2 zscore       
prev1 ks zscore       
ref chi2 zscore       
ref jsd pull       
ref ks zscore       
ref max prob diff pull       
ref psi pull       
ref unknown labels       
std pull       
underflow pull       
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

count pull       
distinct pull       
entropy pull       
filled pull       
max pull       
mean pull       
mean trend10 zscore       
min pull       
most probable value pull       
nan pull       
overflow pull       
p01 pull       
p05 pull       
p16 pull       
p50 pull       
p84 pull       
p95 pull       
p99 pull       
prev1 chi2 zscore       
prev1 ks zscore       
ref chi2 zscore       
ref jsd pull       
ref ks zscore       
ref max prob diff pull       
ref psi pull       
ref unknown labels       
std pull       
underflow pull       
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

count pull       
distinct pull       
entropy pull       
filled pull       
max pull       
mean pull       
mean trend10 zscore       
min pull       
most probable value pull       
nan pull       
overflow pull       
p01 pull       
p05 pull       
p16 pull       
p50 pull       
p84 pull       
p95 pull       
p99 pull       
prev1 chi2 zscore       
prev1 ks zscore       
ref chi2 zscore       
ref jsd pull       
ref ks zscore       
ref max prob diff pull       
ref psi pull       
ref unknown labels       
std pull       
underflow pull       
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

count pull       
distinct pull       
entropy pull       
filled pull       
max pull       
mean pull       
mean trend10 zscore       
min pull       
most probable value pull       
nan pull       
overflow pull       
p01 pull       
p05 pull       
p16 pull       
p50 pull       
p84 pull       
p95 pull       
p99 pull       
prev1 chi2 zscore       
prev1 ks zscore       
ref chi2 zscore       
ref jsd pull       
ref ks zscore       
ref max prob diff pull       
ref psi pull       
ref unknown labels       
std pull       
underflow pull       
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

count pull       
distinct pull       
entropy pull       
filled pull       
max pull       
mean pull       
mean trend10 zscore       
min pull       
most probable value pull       
nan pull       
overflow pull       
p01 pull       
p05 pull       
p16 pull       
p50 pull       
p84 pull       
p95 pull       
p99 pull       
prev1 chi2 zscore       
prev1 ks zscore       
ref chi2 zscore       
ref jsd pull       
ref ks zscore       
ref max prob diff pull       
ref psi pull       
ref unknown labels       
std pull       
underflow pull       
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Alerts


Alerts aggregated by all traffic lights for each feature.

Overview

# green10151415151515
# yellow1010000
# red4000000
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

# green21282827282828
# yellow3001000
# red4000000
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

# green23262626262621
# yellow0002106
# red5220121
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

# green24272725272825
# yellow0001001
# red4112102
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

# green22282828282828
# yellow2000000
# red4000000
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

# green23282728282828
# yellow0010000
# red5000000
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Overview

# green123152150149152153145
# yellow6024107
# red26332223
 2015-06-222015-07-222015-08-212015-09-202015-10-202015-11-192015-12-19

Comparisons


Statistical comparisons of each time period (one bin) to the reference data.

Previous Reference

Comparing each time slot to the preceding time slot.

prev1 max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

prev1 psi

Population Stability Index

prev1 jsd

Jensen-Shannon Divergence

prev1 unknown labels

Are categories observed in a given time slot that are not present in the reference?

prev1 chi2

Chi-squared test statistic

prev1 chi2 norm

Normalized chi-squared statistic

prev1 chi2 zscore

Z-score of the chi-squared statistic

prev1 chi2 pvalue

p-value of the chi-squared statistic

prev1 chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

prev1 chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

External Reference

Comparing each time slot to the reference data.

ref max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

ref psi

Population Stability Index

ref jsd

Jensen-Shannon Divergence

ref unknown labels

Are categories observed in a given time slot that are not present in the reference?

ref chi2

Chi-squared test statistic

ref chi2 norm

Normalized chi-squared statistic

ref chi2 zscore

Z-score of the chi-squared statistic

ref chi2 pvalue

p-value of the chi-squared statistic

ref chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

ref chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

Previous Reference

Comparing each time slot to the preceding time slot.

prev1 max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

prev1 psi

Population Stability Index

prev1 jsd

Jensen-Shannon Divergence

prev1 ks

Kolmogorov-Smirnov test statistic

prev1 ks pvalue

p-value of the Kolmogorov-Smirnov test

prev1 ks zscore

Z-score of the Kolmogorov-Smirnov test

prev1 chi2

Chi-squared test statistic

prev1 chi2 norm

Normalized chi-squared statistic

prev1 chi2 zscore

Z-score of the chi-squared statistic

prev1 chi2 pvalue

p-value of the chi-squared statistic

prev1 chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

prev1 chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

External Reference

Comparing each time slot to the reference data.

ref max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

ref psi

Population Stability Index

ref jsd

Jensen-Shannon Divergence

ref ks

Kolmogorov-Smirnov test statistic

ref ks pvalue

p-value of the Kolmogorov-Smirnov test

ref ks zscore

Z-score of the Kolmogorov-Smirnov test

ref chi2

Chi-squared test statistic

ref chi2 norm

Normalized chi-squared statistic

ref chi2 zscore

Z-score of the chi-squared statistic

ref chi2 pvalue

p-value of the chi-squared statistic

ref chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

ref chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

Previous Reference

Comparing each time slot to the preceding time slot.

prev1 max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

prev1 psi

Population Stability Index

prev1 jsd

Jensen-Shannon Divergence

prev1 ks

Kolmogorov-Smirnov test statistic

prev1 ks pvalue

p-value of the Kolmogorov-Smirnov test

prev1 ks zscore

Z-score of the Kolmogorov-Smirnov test

prev1 chi2

Chi-squared test statistic

prev1 chi2 norm

Normalized chi-squared statistic

prev1 chi2 zscore

Z-score of the chi-squared statistic

prev1 chi2 pvalue

p-value of the chi-squared statistic

prev1 chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

prev1 chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

External Reference

Comparing each time slot to the reference data.

ref max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

ref psi

Population Stability Index

ref jsd

Jensen-Shannon Divergence

ref ks

Kolmogorov-Smirnov test statistic

ref ks pvalue

p-value of the Kolmogorov-Smirnov test

ref ks zscore

Z-score of the Kolmogorov-Smirnov test

ref chi2

Chi-squared test statistic

ref chi2 norm

Normalized chi-squared statistic

ref chi2 zscore

Z-score of the chi-squared statistic

ref chi2 pvalue

p-value of the chi-squared statistic

ref chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

ref chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

Previous Reference

Comparing each time slot to the preceding time slot.

prev1 max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

prev1 psi

Population Stability Index

prev1 jsd

Jensen-Shannon Divergence

prev1 ks

Kolmogorov-Smirnov test statistic

prev1 ks pvalue

p-value of the Kolmogorov-Smirnov test

prev1 ks zscore

Z-score of the Kolmogorov-Smirnov test

prev1 chi2

Chi-squared test statistic

prev1 chi2 norm

Normalized chi-squared statistic

prev1 chi2 zscore

Z-score of the chi-squared statistic

prev1 chi2 pvalue

p-value of the chi-squared statistic

prev1 chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

prev1 chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

External Reference

Comparing each time slot to the reference data.

ref max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

ref psi

Population Stability Index

ref jsd

Jensen-Shannon Divergence

ref ks

Kolmogorov-Smirnov test statistic

ref ks pvalue

p-value of the Kolmogorov-Smirnov test

ref ks zscore

Z-score of the Kolmogorov-Smirnov test

ref chi2

Chi-squared test statistic

ref chi2 norm

Normalized chi-squared statistic

ref chi2 zscore

Z-score of the chi-squared statistic

ref chi2 pvalue

p-value of the chi-squared statistic

ref chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

ref chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

Previous Reference

Comparing each time slot to the preceding time slot.

prev1 max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

prev1 psi

Population Stability Index

prev1 jsd

Jensen-Shannon Divergence

prev1 ks

Kolmogorov-Smirnov test statistic

prev1 ks pvalue

p-value of the Kolmogorov-Smirnov test

prev1 ks zscore

Z-score of the Kolmogorov-Smirnov test

prev1 chi2

Chi-squared test statistic

prev1 chi2 norm

Normalized chi-squared statistic

prev1 chi2 zscore

Z-score of the chi-squared statistic

prev1 chi2 pvalue

p-value of the chi-squared statistic

prev1 chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

prev1 chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

External Reference

Comparing each time slot to the reference data.

ref max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

ref psi

Population Stability Index

ref jsd

Jensen-Shannon Divergence

ref ks

Kolmogorov-Smirnov test statistic

ref ks pvalue

p-value of the Kolmogorov-Smirnov test

ref ks zscore

Z-score of the Kolmogorov-Smirnov test

ref chi2

Chi-squared test statistic

ref chi2 norm

Normalized chi-squared statistic

ref chi2 zscore

Z-score of the chi-squared statistic

ref chi2 pvalue

p-value of the chi-squared statistic

ref chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

ref chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

Previous Reference

Comparing each time slot to the preceding time slot.

prev1 max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

prev1 psi

Population Stability Index

prev1 jsd

Jensen-Shannon Divergence

prev1 ks

Kolmogorov-Smirnov test statistic

prev1 ks pvalue

p-value of the Kolmogorov-Smirnov test

prev1 ks zscore

Z-score of the Kolmogorov-Smirnov test

prev1 chi2

Chi-squared test statistic

prev1 chi2 norm

Normalized chi-squared statistic

prev1 chi2 zscore

Z-score of the chi-squared statistic

prev1 chi2 pvalue

p-value of the chi-squared statistic

prev1 chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

prev1 chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

External Reference

Comparing each time slot to the reference data.

ref max prob diff

The largest absolute difference between all bin pairs of two normalized histograms

ref psi

Population Stability Index

ref jsd

Jensen-Shannon Divergence

ref ks

Kolmogorov-Smirnov test statistic

ref ks pvalue

p-value of the Kolmogorov-Smirnov test

ref ks zscore

Z-score of the Kolmogorov-Smirnov test

ref chi2

Chi-squared test statistic

ref chi2 norm

Normalized chi-squared statistic

ref chi2 zscore

Z-score of the chi-squared statistic

ref chi2 pvalue

p-value of the chi-squared statistic

ref chi2 max residual

The largest absolute normalized residual (|chi|) observed in all bin pairs

ref chi2 spike count

The number of normalized residuals of all bin pairs with absolute value bigger than a given threshold (default: 7).

Profiles


Basic statistics of the data (profiles) calculated for each time period (a period is represented by one bin). The yellow and red lines represent the corresponding traffic light bounds (default: 4 and 7 standard deviations with respect to the reference data).

filled

Number of non-missing entries (non-NaN)

distinct

Number of distinct entries

most probable value

Most probable value

nan

Number of missing entries (NaN)

overflow

Number of values larger than the maximum bin-edge of the histogram.

underflow

Number of values smaller than the minimum bin-edge of the histogram.

count

Number of entries (non-NaN and NaN)

entropy

Entropy in nats

min

Minimum value

max

Maximum value

p01

1% percentile

p05

5% percentile

p16

16% percentile

p50

50% percentile (median)

p84

84% percentile

p95

95% percentile

p99

99% percentile

mean

Mean value

std

Standard deviation

filled

Number of non-missing entries (non-NaN)

distinct

Number of distinct entries

most probable value

Most probable value

nan

Number of missing entries (NaN)

overflow

Number of values larger than the maximum bin-edge of the histogram.

underflow

Number of values smaller than the minimum bin-edge of the histogram.

count

Number of entries (non-NaN and NaN)

entropy

Entropy in nats

min

Minimum value

max

Maximum value

p01

1% percentile

p05

5% percentile

p16

16% percentile

p50

50% percentile (median)

p84

84% percentile

p95

95% percentile

p99

99% percentile

mean

Mean value

std

Standard deviation

filled

Number of non-missing entries (non-NaN)

distinct

Number of distinct entries

most probable value

Most probable value

nan

Number of missing entries (NaN)

overflow

Number of values larger than the maximum bin-edge of the histogram.

underflow

Number of values smaller than the minimum bin-edge of the histogram.

count

Number of entries (non-NaN and NaN)

entropy

Entropy in nats

min

Minimum value

max

Maximum value

p01

1% percentile

p05

5% percentile

p16

16% percentile

p50

50% percentile (median)

p84

84% percentile

p95

95% percentile

p99

99% percentile

mean

Mean value

std

Standard deviation

filled

Number of non-missing entries (non-NaN)

distinct

Number of distinct entries

most probable value

Most probable value

nan

Number of missing entries (NaN)

overflow

Number of values larger than the maximum bin-edge of the histogram.

underflow

Number of values smaller than the minimum bin-edge of the histogram.

count

Number of entries (non-NaN and NaN)

entropy

Entropy in nats

min

Minimum value

max

Maximum value

p01

1% percentile

p05

5% percentile

p16

16% percentile

p50

50% percentile (median)

p84

84% percentile

p95

95% percentile

p99

99% percentile

mean

Mean value

std

Standard deviation

filled

Number of non-missing entries (non-NaN)

distinct

Number of distinct entries

most probable value

Most probable value

nan

Number of missing entries (NaN)

overflow

Number of values larger than the maximum bin-edge of the histogram.

underflow

Number of values smaller than the minimum bin-edge of the histogram.

count

Number of entries (non-NaN and NaN)

entropy

Entropy in nats

min

Minimum value

max

Maximum value

p01

1% percentile

p05

5% percentile

p16

16% percentile

p50

50% percentile (median)

p84

84% percentile

p95

95% percentile

p99

99% percentile

mean

Mean value

std

Standard deviation

filled

Number of non-missing entries (non-NaN)

distinct

Number of distinct entries

most probable value

Most probable value

nan

Number of missing entries (NaN)

overflow

Number of values larger than the maximum bin-edge of the histogram.

underflow

Number of values smaller than the minimum bin-edge of the histogram.

count

Number of entries (non-NaN and NaN)

entropy

Entropy in nats