Skip to main content

Evaluations

Files.com records an Evaluation for every closed window. The Evaluations for an Expectation provide a history of past windows and their outcomes, including the evidence that explains each result.

A result includes which files were matched, how many, their combined size, and which criteria failed and why.

An Evaluation will open an Incident when a scheduled window fails and no Incident is already open for the associated Expectation.

Evaluation Timing

Files.com evaluates Expectations on a periodic schedule. Power plan sites are evaluated approximately every 15 minutes. Premier and Enterprise plan sites are evaluated approximately every 5 minutes.

Evaluation results are derived from file timestamps, not from when the evaluator runs. If your due time is 06:00 and the evaluation runs at 06:02, the due time deadline is still recorded as 06:00.

Details Recorded in Evaluations

Evaluations contain the following information about each closed window.

ITEMDETAILS
StatusThe status or result of the window: Open, Success, Late, Missing, or Invalid.
Opened ViaThe trigger type that was used to open the Expectation window.
Opened AtThe time that the evaluation was started.
Window StartThe start time of the evaluation window.
Window EndThe time at which the window closed.
DeadlineThe scheduled deadline for this window, if applicable.
Late CutoffThe latest time files could arrive and still result in a Late outcome, if a late acceptance interval is configured.
Updated AtThe time that the evaluation was last updated.
Closed AtThe time that the evaluation finished.
Hard CloseThe hard stop time, after which the window may not remain open.
MatchedThe total number of files matched.
MissingThe total number of expected files that are missing.
ErrorsThe number of errors.
SummaryA summary showing the number of matched files, the number of matched bytes, and the outcome for the criteria.
Criteria ErrorsDetails of which criteria were not satisfied, including the specific rules that were violated.

Criteria Errors

The Evaluation's Criteria Errors lists a separate message for each unsatisfied Criteria rule.

File-level criteria rules create pre-defined error messages to indicate the type of error and what went wrong. Errors for content validation rules support customized error messages using a message and detail supplied by your TransformScript.

The Evaluation's Criteria Errors always contains all of the errors from file-level criteria rules. It includes the first 100 content validation errors, limiting each error to 2 KB. If more than 100 errors are generated by a content validation rule, the Criteria Errors indicates how many content validation errors were omitted.

An Open Evaluation only shows the file-level criteria errors that have been found. Content validation rules are evaluated when the window closes. An Evaluation that matched no files at all is Missing rather than Invalid, because there is no content to validate.