Creating Adapters¶

Guide for creating new eval-hub adapters.

Coming Soon¶

Detailed adapter creation guide is in progress.

Quick Template¶

from evalhub.adapter import FrameworkAdapter, JobSpec, JobResults, JobCallbacks

class MyAdapter(FrameworkAdapter):
    def run_benchmark_job(
        self,
        job_spec: JobSpec,
        callbacks: JobCallbacks
    ) -> JobResults:
        # Your implementation here
        pass

For complete examples, see existing adapters: