typesafe have their zero-shot setup that is built upon primitives which should be possible to support an adapter + endpoint in gliclass.
At a high level it is similar to the hierarchical labels where you can specify different levels of questions in a single request. The nuance, is that the question type can be:
- multiclass (choice)
- noul (boolean)
- score (ordered categorical)
each which can have examples, and prompts to go with it (similar to the batch inference that gliclass has)
It would be useful if gliclass speaks the same 'semantics' in the serving layer/inference interface.
Example request format: https://docs.typesafe.ai/introduction/quickstart
{
"state": "Hi, I've been trying to connect my Stripe account for 3 days and the integration keeps failing. I'm losing sales. Please help ASAP.",
"questions": {
"department": {
"type": "choice",
"instructions": "Which team should handle this",
"criteria": {
"billing": "Payment or subscription issues",
"technical": "Bugs or integration problems",
"sales": "Pricing or account questions"
}
},
"frustration": {
"type": "score",
"instructions": "How frustrated the customer appears",
"criteria": [
"Calm, just stating facts",
"Frustrated but civil",
"Very angry, strong language"
]
},
"is_urgent": {
"type": "noul",
"instructions": "The message conveys urgency or time-sensitivity"
}
}
}
typesafe have their zero-shot setup that is built upon primitives which should be possible to support an adapter + endpoint in gliclass.
At a high level it is similar to the hierarchical labels where you can specify different levels of questions in a single request. The nuance, is that the question type can be:
each which can have examples, and prompts to go with it (similar to the batch inference that gliclass has)
It would be useful if gliclass speaks the same 'semantics' in the serving layer/inference interface.
Example request format: https://docs.typesafe.ai/introduction/quickstart
{ "state": "Hi, I've been trying to connect my Stripe account for 3 days and the integration keeps failing. I'm losing sales. Please help ASAP.", "questions": { "department": { "type": "choice", "instructions": "Which team should handle this", "criteria": { "billing": "Payment or subscription issues", "technical": "Bugs or integration problems", "sales": "Pricing or account questions" } }, "frustration": { "type": "score", "instructions": "How frustrated the customer appears", "criteria": [ "Calm, just stating facts", "Frustrated but civil", "Very angry, strong language" ] }, "is_urgent": { "type": "noul", "instructions": "The message conveys urgency or time-sensitivity" } } }