LightEval Examples

Configuration examples for common scenarios.

Coming Soon

Detailed examples are in progress.

Single Task

{
  "id": "job-123",
  "benchmark_id": "hellaswag",
  "model": {
    "name": "gpt2",
    "url": "http://localhost:8000/v1"
  },
  "parameters": {
    "provider": "endpoint",
    "num_few_shot": 0
  }
}

For more examples, see the LightEval README.