Russell Ballestrini
d5004c8b78
Fixed the functional test failure by removing MODEL_ENDPOINT_0 from the functional test step in GitHub Actions workflow. The functional test test_initialize_model_map_with_env_vars sets its own test endpoints (MODEL_ENDPOINT_1, MODEL_ENDPOINT_2) and was failing because MODEL_ENDPOINT_0 from the workflow was interfering. Changes: - .github/workflows/test.yml: Removed MODEL_ENDPOINT_0 from functional test step - .github/workflows/test.yml: Updated unit/integration tests to use hermes.ai.unturf.com - tests/functional/test_guarded_ai.py: Fixed patch.dict to use clear=False Unit and integration tests still have MODEL_ENDPOINT_0 configured since they need it for app initialization. Functional tests now run without env var interference and can test their own endpoint configs. All 46 functional tests pass locally.
37 lines
1 KiB
YAML
37 lines
1 KiB
YAML
|
|
default_max_attempts_per_step: 3
|
|
|
|
sections:
|
|
- section_id: "section_1"
|
|
title: "Test Section"
|
|
steps:
|
|
- step_id: "step_1"
|
|
title: "Question 1"
|
|
question: "What is 2+2?"
|
|
tokens_for_ai: "Categorize as 'correct' if answer is 4 or four, otherwise 'incorrect'"
|
|
buckets:
|
|
- correct
|
|
- incorrect
|
|
transitions:
|
|
correct:
|
|
content_blocks:
|
|
- "Great job!"
|
|
next_section_and_step: "section_1:step_2"
|
|
incorrect:
|
|
content_blocks:
|
|
- "Try again!"
|
|
counts_as_attempt: true
|
|
- step_id: "step_2"
|
|
title: "Question 2"
|
|
question: "What is 3+3?"
|
|
tokens_for_ai: "Categorize as 'correct' if answer is 6 or six, otherwise 'incorrect'"
|
|
buckets:
|
|
- correct
|
|
- incorrect
|
|
transitions:
|
|
correct:
|
|
content_blocks:
|
|
- "Excellent!"
|
|
incorrect:
|
|
content_blocks:
|
|
- "Not quite!"
|