ExtendedAutoTestResult#

class ExtendedAutoTestResult[source]#

The extended JSON representation of a result.

global_setup_stdout: Optional[str]#

The stdout produced in the student setup script. Deprecated use global_setup_output.

global_setup_stderr: Optional[str]#

The stderr produced in the student setup script. Deprecated use global_setup_output.

global_setup_output: Sequence[AutoTestGlobalSetupOutput]#

The output for the global setup script. As each unit test script can also cause setup to be produced this is a list of multiple commands and their output.

setup_stdout: Optional[str]#

The stdout produced in the student setup script.

setup_stderr: Optional[str]#

The stderr produced in the student setup script.

step_results: Sequence[AutoTestStepResult]#

The results for each step in this AutoTest. The ordering of this list is arbitrary, and the results for entire suites and or sets might be missing.

approx_waiting_before: Optional[int]#

If the result has not started this will contain the amount of students we expect we still need to run before this result is next. This might be incorrect and should only be used as a rough estimate.

final_result: bool#

If true this is the final result for the student, meaning that without teacher interaction (e.g. restarting the AutoTest) this result will not change and will be used as is to calculate the grade of the student. Reasons why this may not be the case include but are not limited to the test containing hidden steps that will only be run after the deadline.

suite_files: Mapping[str, Sequence[Union[BaseFile, DirectoryWithChildren]]]#

A mapping between suite id and the files written to the AutoTest output folder in that suite.

quality_comments: Sequence[AutoTestQualityComment]#

The quality comments produced by this AutoTest result.

possible_runners: Optional[Sequence[AutoTestRunner]]#

The runners that could be used to run this result. You can use this to provide better feedback about the state of a non started result. If the result is already started this will be None.

id: int#

The id of this result

created_at: datetime#

The time this result was created

updated_at: datetime#

The time this result was last updated

started_at: Optional[datetime]#

The moment this result was started. If this is null the result has not yet started.

work_id: int#

The id of the submission (work) that was tested in this result.

state: AutoTestResultState#

The state the result is in.

points_achieved: float#

The amount of points achieved in this step by the student.