📄️ Session unit tests
Unit test of complete user sessions
📄️ Prompt template unit tests
Unit tests to test effects of recent changes in your template
📄️ Unit test evaluation
By default, we use cosine similarity metric to determine how similar the generated result is to the annotated reference example. The main goal here is not to determine whether the generated result is good or bad, but like identify the scenarios where our change introduced changes above specified threshold.
📄️ Unit tests - reference guide
Unit tests in PromptWatch follow code-first principle. This means, that you don't need to do any action in the UI in order to define and run the test cases. Unit test will be created on it's first run.