Automated tests
Set up and quickly test inputs or training data using Automated tests in NLX's Dialog Studio
Last updated
Set up and quickly test inputs or training data using Automated tests in NLX's Dialog Studio
Last updated
A bot build is required before any Automated test may be used. See Deploy.
Automated tests allow you to easily test your AI assistant's performance with recognizing intents (based on your provided training data), or allow you to quickly execute saved conversation inputs when running frequent tests with your intent flows.
Click Automated tests tab of Bot > Select Create test
Enter a test name
Select + Add test
Enter phrase(s) to be tested or modify after using the Generate* feature
Specify the intent you want to test the phrase against
Select Save
*If your intent's training phrases include Slots, the Generate combinations toggle ensures all variations of those slot values are simulated in the test.
Once satisfied and ready to run your test, select the Test executions tab to process your test.
Failed phrases display the expected intent to be matched alongside the actual matched intent:
Manage custom settings for all intent recognition tests created and executed for your bot:
Execute during build: Automatically triggers your test after each new successful bot build.
Failure threshold: Indicates the percentage of tests allowed to fail in the whole test suite before a bot build fails.
Minimum confidence score: Minimum confidence score indicates the NLP confidence value each test must achieve before it fails. This applies to every individual test.
To delete an automated intent recognition test, select the Delete bot test option under Danger zone.
To create an automated conversation flow test, begin by entering Test mode on an intent flow:
Select an intent > Click a flow card
Toggle mode to Test on the bottom of your canvas builder
Provide inputs in the test panel to converse with your bot
To save your sequence of inputs, select the play button ▶️ icon > Choose + New automated test
Enter a test name
Click Save
Your named automated flow test will now be visible to replay. You may proceed from the point of the save and continue testing the conversation or generate additional automated tests.
All saved automated flow tests will be visible from the test panel in the flow or from a bot's Automated tests tab where the flow is attached.
