Evaluation

Layer 2: Compose

Evaluator and graph-native contracts

The graph-native path is GenomeBatch → EvaluationAdapter → EvaluationPayload → Evaluator → ObservationBatch.

saealib.Evaluator	Base class for batch evaluators.
saealib.SerialEvaluator	Default evaluator: evaluates each candidate sequentially.
saealib.JoblibEvaluator	Parallel evaluator backed by joblib.
saealib.ThreadPoolEvaluator	alias of AsyncEvaluator
saealib.AsyncEvaluator	Thread-backed asynchronous evaluator.
saealib.EvaluationAdapter	Transform genomes into the payload consumed by a problem evaluation.
saealib.EvaluationRequest	Input payload whose snapshot semantics depend on how it was built.
saealib.EvaluationHandle	Runtime reference to submitted evaluation work.
saealib.EvaluationQuery	Request context supplied to an EvaluationAdapter.
saealib.EvaluationUpdate	One delivered evaluation update.
saealib.PendingEvaluation	Serializable record for submitted work.

Evaluation policies and plans

saealib.EvaluationPlanner	Public contract for planners that may produce multiple requests.
saealib.EvaluationPlan	Composable evaluation work returned by a planner.
saealib.EvaluateAll	Evaluate every candidate.
saealib.TopKEvaluation	Evaluate the stable top-k acquisition scores.
saealib.RatioEvaluation	Evaluate the stable prefix selected by a ratio.
saealib.RepeatedEvaluation	Request candidates with an explicit replicate number.
saealib.FidelityEvaluation	Attach an explicit fidelity level to an evaluation request.
saealib.FidelityPromotion	Represent an explicit promotion from one fidelity level to another.
saealib.ReplicateSummary	Aggregated observations for one candidate batch.
saealib.aggregate_replicates	Aggregate repeated objective observations by stable candidate ID.

Stage compatibility type

On the Stage compatibility path, use Evaluator.evaluate_batch(...) -> EvaluationResult. At this compatibility boundary, EvaluationResult requires shape and row-count consistency for f, g, and cv; when candidate_ids is provided, it must be unique and match the result row count. When Evaluator.submit returns candidate_ids, they must exactly match the request’s candidate IDs.

saealib.EvaluationResult

Validated numeric result for a batch of candidates.