Scores

​

Record a score

export async function answerTicket(ticketId: string) {
  const reply = await nelkap.step.run('reply', () =>
    draftReply(ticketId),
  );

  await nelkap.step.score(
    'resolved without a human',
    reply.resolved,
  );
  await nelkap.step.score(
    'confidence',
    reply.confidence,
  );
}

• A number, like a relevance from 0 to 1 or a rating from 1 to 5, is charted as an average.
• A yes or no, like whether a ticket was solved, is charted as a pass rate: the share of runs that recorded true.

​

Where the values come from

• A value your own code computes, like whether an order shipped on time.
• A judgment from a model, like the relevance of an answer graded by a second model call, made in a step so it’s saved.
• A person’s feedback, received with step.wait, like a thumbs up on a support reply.

​

Read the charts