Contact us

R&D for your task: hypothesis testing and prototype

Model experiments, a prototype and user testing. The result is an assessment of quality, costs and limitations for the pilot decision.

HypothesisAI classifiesrequests more accuratelyMetricaccuracy ≥ 90%Thresholdhours savedMetricModel comparisonLocal · in-house0,78OpenAI · contract0,84Qwen · Alibaba Cloud0,81quality · cost · where it runsUsers9 of 12trust the answerGOnext: pilot
Market context

Sandboxes and pilots in the region’s fintech

Kazakhstan. The regulator itself has become a testing ground: a digital tenge pilot with budgets, a National Bank sandbox for crypto payments, and venture investment in AI has grown fivefold in two years: testing a hypothesis with a prototype is cheaper than learning about it from a competitor. Uzbekistan. The Central Bank has opened its sandbox to foreign fintechs, is launching an innovation hub and expects 20–30 fintech startups a year: the window for pilots with banks is open.

$73 M
venture investment in Kazakhstan’s AI startups in 2025, five times more than in 2023
$1 B
fintech investment in Uzbekistan, the Central Bank’s strategy target for 2030
FintechstanBased on “Market radar” data

R&D for your task tests an AI hypothesis in a limited experiment before full-scale development

Metrics and thresholds are set before the experiment. Models are compared on permitted data; the result may confirm the hypothesis, refute it or call for further testing.

Why test a hypothesis before development

Risk

Risk of spending without results

The Gartner forecast points to risks of agentic projects, not to the outcome of a specific deployment. R&D tests quality and expected value in a limited experiment.

Models

There is no single best model

The choice depends on the task and permissible processing. Comparison on an agreed sample: quality, costs and limitations.

People

User testing

Target users assess the prototype’s clarity, trust and barriers. Observations and metrics complement the technical assessment.

What’s included: nine parts of testing an AI hypothesis

Hypothesis“AI classifies requests more accurately than an operator”Metricaccuracy ≥ 90%Decision thresholdhours savedTimelinein the contract

Hypothesis and success metrics

Hypothesis, metrics, thresholds and possible conclusions. Experiment scope and timeline are set in the contract.

Comparison · 3 modelsLocal · in-perimeter0,780,2 ₸OpenAI · under contract0,841,1 ₸Qwen · Alibaba Cloud0,810,4 ₸quality · cost per request · where it runs

Model selection

Comparison of local and external models by quality, cost and data processing conditions. Options include OpenAI, Anthropic and Qwen. AI partnerships

Data for the experimentRequests48K · 2 yearsLabelling2,000 · expertsPersonal datamaskedOn-premisesbank environmentAccessSampletest 20% · not used in training

Data for the experiment

Access agreed with information security, preparation and labelling with experts, required masking; a separate sample for quality testing.

Iterations · accuracytargetAccuracy86 %Iterations7Prompt · fine-tuningExpert evaluationreport after each

Experiments and quality evaluation

Iterations of prompts and approaches; fine-tuning if needed. Testing on the test sample and with experts, a report on each iteration.

Prototype · assistant“Client: card blocked”Category: cards · 97%Prototype readyruns on the bank’s dataToolsRocket CrewRocket Insight LabEnvironmentagreed

A prototype built on Rocket Tech tools

A prototype on agreed data; Rocket Crew and Rocket Insight Lab are used where they fit the task. Rocket AI Tools

Session 8 of 12 · operatorslab · live streamTrust the answer · 9 of 12What we testis it clear, is it trustedBarriers3 · refining the prototype

User testing

Scenario testing with target users in the UX lab; fixes and retesting. UX lab

Cost · per monthRequests120KTokens₸380KInfrastructure₸220KSavingsin the reportPaybackpaybackin the report

Operating cost estimate

Estimated costs of models, infrastructure and support at the expected load, compared with the expected impact.

Solution requirementsbefore the pilot, not afterBanking secrecy and personal databy agreementModel decision logenabledRegulatory rules for AIaddressedInformation security and compliance before the experiment starts

Security and regulation

Permitted data, processing, access rights and logging are agreed with information security and compliance before the experiment. Constraints are taken into account when choosing the model. AI Control Gate

R&D reportAccuracyat thresholdSavingscalculatedCostcalculatedUserstest passedSolutionGOnextpilot with KPIsby agreement

Report and next-stage plan

Quality, cost estimate, constraints and observations; a recommendation to pilot, to stop or to test further. AI products

Engagement formats: R&D sprint, pilot, audit and joint experiments

R&D

Hypothesis sprint

Experiments, prototype, validation and report; scope and timeline are agreed. Price set in the contract.

Pilot

After a “go”

A pilot with agreed KPIs and suitable tools; scope and estimate are handled separately. AI products

Audit

If there is no hypothesis yet

AI readiness audit: processes, data and potential use cases; expected impact and a validation plan. AI readiness audit

Vendors

Joint R&D

Joint experiments with vendor products for the Kazakhstan and Uzbekistan markets.

Experience: R&D for ourselves

FAQ

R&D tests a hypothesis in a limited experiment. A pilot tests performance on a selected process with KPIs; scope and terms are agreed separately.

Local and external models, including OpenAI, Anthropic and Qwen. The choice depends on the task, the data, availability and processing terms.

Data transfer depends on the chosen environment, model and integrations. Permitted data and processing routes are agreed in advance; masking alone does not guarantee anonymisation.

A negative or inconclusive result is recorded in the report: constraints, possible changes and whether further testing is needed. A pilot is not launched automatically.

The process owner, experts for data preparation and evaluation, information security and compliance, and the target users of the prototype.

A fixed price for an agreed R&D sprint. Models and the environment are billed by usage; limits and payment terms are set in the contract.

Market

Contact us

Your request goes to our business development team: we will get in touch, work out what needs to go live at your bank and propose a solution.

Brief or presentation, up to 10 MB
Bereke Bank
Halyk Bank
Octobank
Davr Bank
Forte Bank
Colvir
OpenAI Select Partner OpenAI Partner Network badge: ChatGPT Deployment PractitionerOpenAI certificate Alibaba CloudReseller Partner Claude Partner Badge: Claude CodeAnthropic certificate Partnerships
Send a request Tell us what needs to go live at your bank, and a manager will get in touch.
Brief or presentation, up to 10 MB