All tracks

Analytics Agent

max +6 bonus

Chat interface for historical Adaptive event JSON data. Ask questions in plain language, get charts, tables, and answers. Makes procurement analytics accessible to buyers and CS without SQL or a BI tool.

North Star Metric

Query answer accuracy — % of natural language questions answered correctly against the actual dataset.

Bonus Criteria (+6 pts)

+2

Advanced reasoning and analytical intelligence

Understands complex requests, builds a plan, and executes with reasoned output.

Verified by: Visible through demo and in evals

+2

Handles permissions correctly

Takes into account different user permissions for different parts of the JSON data.

Verified by: Engineer demonstrates during demo

+1

Correct chart type selection

Selects the appropriate visualization — time series → line, comparison → bar, distribution → histogram.

Verified by: Jury asks 3 structurally different questions and checks chart types

+1

CS or Sales used it blind and got a useful answer

A non-technical user asked a real question and got a correct, useful answer.

Verified by: CS/Sales person confirms live during demo

Suggested Evals

Correct plan selected based on initial prompt intent
Correct visualization type selected for the type of data
Golden dataset (set of user prompts) with near 100% accuracy
No teams assigned to this track yet. Assignments happen after team submission closes.