Metrics & Evaluation Data Scientist Job at Harnham, Austin, TX

ckphTzc0d1FNTHc3NWhxSVRaeWV1UGNFMlE9PQ==
  • Harnham
  • Austin, TX

Job Description

About the Team

Our team develops the metrics and evaluation frameworks that measure the safety, performance, and real-world readiness of autonomous driving systems. We work closely with engineering, simulation, and safety teams to analyze large volumes of real-world and simulated driving data, enabling data-driven decisions that accelerate deployment.

Our work answers critical questions such as:

  • How does the system perform in complex urban scenarios?
  • Does vehicle behavior meet passenger comfort and safety expectations?
  • How do we statistically validate readiness for deployment at scale?

About the Role

We are looking for a Data Scientist to help define, build, and validate metrics that evaluate autonomous driving behavior. In this role, you will design quantitative measures of safety, performance, and passenger experience, apply statistical techniques to large datasets, and partner closely with cross-functional teams to guide system improvements.

This position offers a chance to work on high-impact problems at the intersection of data science, safety, and autonomous systems.

What You’ll Do

  • Analyze large-scale datasets from real-world and simulated autonomous driving experiments
  • Design, implement, and iterate on quantitative metrics (rule-based and ML-driven) for driving behavior, safety, and passenger comfort
  • Apply statistical inference and hypothesis testing to assess metric reliability, sensitivity, and significance
  • Collaborate with autonomy software, simulation, and safety teams to prioritize improvements based on data insights
  • Build and maintain scalable pipelines to automate metric computation and reporting
  • Review driving logs and participate in test rides to ground analysis in real-world system behavior

What You’ll Need

  • 2+ years of experience in data science, applied statistics, or metrics development
  • Strong proficiency in Python and SQL for data analysis
  • Solid foundation in statistical methods (e.g., hypothesis testing, confidence intervals, regression, A/B testing)
  • Experience designing metrics for complex systems (e.g., robotics, autonomous systems, or large-scale software platforms)
  • Ability to clearly communicate technical findings to cross-functional partners

Nice to Have

  • Experience with machine learning , including model evaluation or feature engineering
  • Familiarity with big data tools (e.g., Spark, Hadoop, MapReduce)
  • Knowledge of traffic regulations or automotive safety standards

Job Tags

Similar Jobs

Confidential Jobs

Marketing Operations Manager Job at Confidential Jobs

 ...A Brief Overview We are seeking a dynamic Marketing Operations Manager to lead marketing efforts and serve as the key liaison between local leadership and national marketing teams. This role is ideal for a strategic thinker with strong execution skills who thrives in... 

Montalbano Lumber

Outside Sales Representative Job at Montalbano Lumber

Job Title: Outside Sales Representative Department: Sales Reports To: Vice President Job Summary: The Outside Sales Representative is responsible for driving sales growth in the lumber and building materials (LBM) and millwork sectors by cultivating relationships...

Brandon Consulting Associates, Inc.

ITSS with OKTA- Des Moines IA Job at Brandon Consulting Associates, Inc.

Our Client is seeking a skilled Infrastructure Technical Specialist (ITSS) with expertise Print Administration, OKTA, and OKTA ASA. Location: Des Moines, IA (LOCALS ONLY) Seeking an experienced Infrastructure & Identity Systems Engineer with deep technical expertise... 

Leprino

DOD SkillBridge Program - Maintenance Technician Program (Active-Duty Service Members only!) Job at Leprino

 ...Start Your Civilian Career with a Global Leader in Dairy Manufacturing Locations: Greeley, CO Lemoore, CA Fort Morgan, CO...  ...Army: 15-series MOS (Aviation Maintenance Technicians). Navy: Engineman (EN), Machinists Mate (MM), Electricians Mate (EM)... 

BlackRock Resources LLC

Construction & Commissioning Scheduler Job at BlackRock Resources LLC

 ...You must be able to work in the U.S. without sponsorship. No C2C or 3rd parties, please. Location: On-site New Albany, OH Schedule: Full-time | On-site presence required Industry: Industrial/Power/Data Center Construction Were looking for an...