Pulse Job logoPulse Job
HomeJobsBlogPricingContact
Pulse Job logoPulse Job

Trusted global job portal connecting talented professionals with top companies worldwide.

support@pulsjob.com

For Job Seekers

  • Browse Jobs
  • Premium Jobs
  • Create Profile
  • Pricing
  • Career Tips

For Employers

  • Hire someone
  • Employer Dashboard
  • Success Stories

Career Tools

  • AI Auto-Apply
  • Expert Resume Review
  • Set Job Alerts

Company

  • About Us
  • Contact
  • Blog

Support

  • FAQ
  • 14-Day Refund Policy
  • Privacy Policy
  • Terms of Service
  • Community Guidelines

Copyright © 2026 Pulse Job. All rights reserved.

FacebookTwitterLinkedInInstagram

Get the Pulse Job app for the best experience.

Disclaimer: Pulse Job is a platform connecting job seekers with employers. We do not guarantee employment or verify all employer claims. Users should exercise due diligence when applying for jobs or hiring candidates.

  1. Home
  2. Jobs
  3. Product Data Scientist — AI...

Product Data Scientist — AI Evaluation & Quality (Remote)

Back to Jobs
Finom logo

Product Data Scientist — AI Evaluation & Quality (Remote)

Finom

Location

Portugal

Experience

Mid

Posted

Jul 10, 2026

Apply by

August 9, 2026

Applicants

0

Early applicantEasy applyFull-timeWork from Home

Sign in to apply on web or download the app for more options.

Job Description

**About Finom** Finom is a European tech startup headquartered in Amsterdam, and we’re on a journey towards revolutionizing the financial landscape for entrepreneurs worldwide. Our mission is to develop an all-in-one financial B2B solution that integrates banking functions, accounting, financial management, and invoicing into a seamless, mobile-first platform. We recently closed a €115 million Series C equity round (around $133 million), bringing our total funding to approximately $346 million. This significant investment follows a $105 million growth funding round from General Catalyst, a long-term backer since 2021 known for supporting companies like Airbnb, HubSpot, KAYAK, and Stripe. Finom's platform goes beyond traditional banking, offering invoicing and a growing suite of features, including AI-enabled accounting, aiming to simplify financial management for entrepreneurs. We're actively expanding our reach across key EU markets like Germany, France, the Netherlands, Italy, and Spain. At Finom, we’re not just redefining the entrepreneurial experience — we’re empowering our employees to make a real difference. Your work matters, and your impact extends far beyond product metrics. We nurture innovation and an inspiring work environment where bold ideas thrive, prioritizing thorough research, swift implementation of solutions, and ensuring that every effort we make benefits our users, employees, partners, and our business as a whole. Maintaining our start-up spirit, we prioritize thorough research, swift implementation of solutions, and ensuring that every effort we make benefits our users, employees, partners, and, of course, our business. You'll join the **AI Team** — the group driving all AI products and technology at Finom We build and ship AI across the company: AI financial co-pilot, voice agent, and internal AI-powered processes Our belief: **your AI agent is only as good as your eval loop** — we can build AI as good as the evals we run on it Your mission: own that eval loop across every AI product we ship — pre-launch quality gates, post-launch monitoring, continuous improvement You'll work directly with our AI Quality lead, [Igor Kolodkin](https://www.linkedin.com/in/ikolodkin/) Close collaboration with AI engineers, Product, and domain experts across the company Core stack: Databricks, DeepEval, Claude Code ### What You Will Be Doing - Own and extend our offline eval suite across products — datasets (capability + regression), judges, metrics - Build and maintain online quality dashboards: resolution rate, CSAT, thumbs up/down, LLM-as-judge signals, error rate, latency - Close the production feedback loop: mine failure patterns from real traffic → turn them into regression cases → propose fixes to Product and domain experts - Harden methodology: judge stability, non-determinism handling - Translate numbers into decisions – weekly syncs, clear trade-offs, no dashboards for their own sake ### Must-Haves - Python and SQL — you can build an analysis end-to-end - Solid foundation in statistics — sampling, hypothesis testing, variance, understanding what a noisy metric is - Analytical mindset — you start from the business question, not from the tool - 3+ years in analyst / data scientist roles, at least one in a product context ### Nice-to-Haves - Experience in quality analytics for ML systems — ranking, recommendations, classification, etc. - Hands-on experience evaluating LLM applications (RAG, agents, tool use, judges) - Experience building LLM agents — side projects, toy builds, personal experiments all count ### How we work — one thing we mean seriously - AI-assisted coding is our default authoring environment, not a bonus - Claude Code is our main tool — you'll reach for it for SQL, Python, analyses, dashboards, and internal scripts - We're looking for analysts who are already curious and fluent with AI coding — or genuinely excited to become fluent fast - We care about what you ship and how clearly you think - If this idea excites you rather than worries you, you'll feel at home here **What You Will Get In Return** **Make a genuine impact on the product** Join our upward trajectory, and grow with us. We provide the resources and opportunities for continuous personal and professional development, empowering you to make a genuine impact on our evolving product. **Work in the EU** Embark on this exciting journey with us and enjoy the flexibility of traveling and working remotely or in a hybrid model across Europe. **Become a stock options holder** Unlock your inner entrepreneur and align your aspirations with ours through our Stock Options Program. This exciting opportunity is available to every team member, from junior team members to our founders. **Receive unwavering support and care** Finom stands by you at every step, embodying our commitment to your well-being and success reflected in our modern, friendly, and eco-conscious corporate culture. We offer constant support and care to ensure your Finom experience is successful and fulfilling. **Work & Swim program** Immerse yourself in our exclusive Work & Swim Program. Spend one month in a comfortable corporate apartment in enchanting Cyprus. It's the ideal opportunity to strike the perfect work-life balance while enjoying breathtaking Mediterranean views. **Equal Opportunity Statement** At Finom, we're an equal opportunity employer and value diversity at our company. We embrace diversity and invite applications from all walks of life. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, disability status, or other applicable legally protected characteristics.

Key Responsibilities

  • Own and extend the offline eval suite across products, including datasets, judges, and metrics.
  • Build and maintain online quality dashboards for resolution rate, CSAT, error rate, and latency.
  • Close the production feedback loop by mining failure patterns and proposing fixes to Product and domain experts.
  • Harden methodology for judge stability and non-determinism handling.
  • Translate data into decisions through weekly syncs and clear trade-offs.

Skills Required

PythonSQLStatisticsDatabricksDeepEvalClaude CodeAnalytical mindsetCommunicationProblem solvingQuality analytics for ML systemsLLM application evaluationRAGAgentsTool useLLM agent building

Benefits

  • Stock Options Program
  • Remote work
  • Hybrid work model across Europe
  • Work & Swim program (one month in Cyprus)
  • Professional development opportunities
  • Eco-conscious corporate culture

App exclusive · Free

Smart Job AI Coach

Your personal interview coach on every job — readiness tips, profile improvements, and role-specific prep. Available only in the Pulse Job app.

Interview readiness

See how prepared you are and what to improve for each role.

Personalized tips

Actionable suggestions based on your profile and the job.

After you apply

Keep coaching momentum from job detail through application success.

Get Smart Job AI Coach in the appFree on iOS and Android

Job Overview

Salary

—

Job Type

Full-time

Experience

Mid

Location

Portugal

Application Deadline

August 9, 2026

Total Applicants

0

About Finom

Finom logo

Finom is a leading company in the Technology sector, known for innovation and employee-centric culture.

View Company

Similar roles for you

Matched using this role's title and skills. Open the job search anytime to see every listing.

NTT Ltd logo

Data Scientist – Enterprise AI Solutions

NTT Ltd

Full-timeWork from Office
Petaling Jaya·Mid·Jul 10
General Motors logo

Data Scientist Statistician Lead - Product Safety Data Analytics

General Motors

Full-timeEasy applyHybrid
Warren·Senior·Jul 10
Charles Schwab logo

Senior AI and Data Scientist

Charles Schwab

Full-timeWork from Office
Austin·Senior·Jul 10
Innodata logo

Applied Data Scientist, Finance AI Evaluation & Datasets

Innodata

150,000–175,000 / Year

Full-timeWork from Home
Remote - United States·Mid·Jul 7
Bread Financial logo

Data Scientist 2

Bread Financial

Full-timeEasy applyWork from Office
Bangalore·Mid·Jul 10
Markon Solutions logo

Data Scientist - AI/Machine Learning

Markon Solutions

150,000–210,000 / Year

Full-timeEasy applyWork from Office
Annapolis Junction·Mid·Jul 10
Browse all jobs