whoami

Azerbaijani telecom customers — modeled on Azercell's ~5M subscriber base — routinely lose money to two things they rarely notice until it's too late: unwanted recurring third-party charges they never knowingly signed up for, and mobile plans that no longer match how they actually use data. Industry research (C+R Research) shows people underestimate their real subscription spend by more than 2x ($86 estimated vs. $219 actual), and 42% have been charged for a subscription they'd completely forgotten. Azercell's own AI support bot, AiCell, understands Azerbaijani with 96.6% comprehension accuracy but resolves only 17% of inquiries end-to-end — the other 83% get routed to a human, meaning the customer still has to make the call themselves. Clario targets both halves of this: it notices a suspicious charge before the customer does and actually cancels and refunds it, and it recommends a better-fitting plan based on what the customer says about their own usage — closing the loop AiCell leaves open.

Preliminary score

70.5/ 100Strongaverage of 2 judges
  • Value for the user19.5 / 25

    A specific problem and a clear outcome from solving it.

  • Prototype and use of AI22.0 / 30

    A working core scenario, and what AI actually contributes to the result.

  • Quality testing13.5 / 20

    Tests, examples of failures, and comparison with the current approach.

  • Feasibility9.5 / 15

    Data requirements, running costs and a clear next step.

  • Originality6.0 / 10

    A meaningful difference from common solutions.

What the judges wrote

  • GPT-6 AstraPreliminary72/100
    Strengths
    Your tool-calling workflow connects Azerbaijani conversation to concrete billing actions, with confirmation and disambiguation rather than advice alone. Your reported tests cover repeat-cancel idempotency and a thoughtfully corrected zero-context ambiguity case, while the recommender includes cross-validation and usage-drift checks. Your explicit disclosure of mock bills and synthetic training data makes the prototype's current boundaries clear.
    To improve
    Your evidence would be stronger with tool traces showing both cancellation and refund state changes, plus a case-by-case table separating completed resolutions from clarification-only outcomes. Your 0.992 macro-F1 measures agreement with synthetic personas, not real plan suitability; validate against real usage and a simple cheapest-matching-plan baseline. Your production plan needs operator API access, authentication, refund authorization, and audit controls—not just a replacement data source. Your $0.008 cost estimate should specify the model pricing, token assumptions, and number of calls per resolved case.
  • Claude Opus 5.5Preliminary69/100
    Strengths
    Your prototype goes beyond explaining a charge: Claude calls get_bill and cancel_subscription tools, and asks for confirmation before any irreversible action, which is a real agentic loop. Your test write-up is unusually honest. You admit that your first 'ambiguity' test did not test ambiguity, then you replaced it with a true zero-context case with two active charges. Choosing logistic regression so the recommender runs client-side with no inference cost is a thoughtful engineering trade-off. Your next step of swapping mock data for a real billing system is clearly scoped.
    To improve
    Your 0.992 macro-F1 comes from predicting K-Means labels on the same synthetic features, so it mostly shows the classifier can recover its own clusters. It does not show that real users get better plans. Validate on even a small set of real usage descriptions or anonymised bills. Your comparison with AiCell's 17% is not like-for-like: measure your own resolution rate, time-to-resolution or AZN recovered against the current call-centre path on the same scenarios. Your problem statistics are US subscription data, so local evidence on unwanted VAS charges in Azerbaijan would strengthen your user-value case. Also address how refund and cancellation authority would work under operator policy.

The team

  • Aqshin Quliyev

    developer

  • Hamid AslanovLead

    developer

  • Nicat Əmrəhli

    product

  • Elvin Bayramli

    data

  • Vagif Akbarli

    developer