2mo ago

avatar

Snorkel AI

Director, Research - Human Data Systems

$180K - $260K

San Francisco, CA

Senior (10+ years)

AI / ML

Growing (201–500)

[object Object],[object Object],[object Object], ,[object Object],[object Object], ,[object Object],[object Object], ,[object Object],[object Object], ,[object Object],[object Object], ,[object Object],[object Object], ,[object Object],[object Object], ,[object Object],[object Object],[object Object],[object Object]

Questions about the Director, Research - Human Data Systems role at Snorkel AI

What skills are essential for success in applied AI roles?

Essential skills for success in applied AI roles include 5+ years in applied AI, research, or machine learning, with 4+ years managing technical teams. Hands-on expertise in coding, LLMs, and agentic workflows is critical, alongside building data annotation tools. Candidates must thrive in fast-paced, ambiguous settings, bridging research, product, engineering, and operations—leading team culture, prototyping POCs, strategic roadmapping for AI data bottlenecks (e.g., RLHF, model alignment), and validating workflows at scale.[Job Description] These enable programmatic data development for production AI, as emphasized by Snorkel AI's focus on expert-in-the-loop systems and frontier data research.[1][2][3] (108 words)

Which tools do you prioritize for data-centric AI development?

For data-centric AI development at Snorkel AI, I prioritize programmatic labeling tools like Snorkel Flow, which enable automated data curation via rules, heuristics, and weak supervision over manual processes. This aligns with our core mission to transform expert knowledge into scalable AI data, powering frontier models and agentic workflows[1][2][3]. Key tools include rubric-guided pipelines for task execution, expert-in-the-loop refinement, and evaluation frameworks with verifiers for high-precision datasets across 1,000+ topics. These bridge research to production, addressing bottlenecks like RLHF and multi-step reasoning in environments, as emphasized in our platform and NeurIPS insights[3][5]. Hands-on with LLMs, they ensure 2x faster curation without quality loss[3]. (108 words)

What emerging trends in AI should I be aware of?

Key emerging AI trends include data-centric AI, environments for evaluation and RL, and expert-in-the-loop systems for frontier models.

Data-centric approaches prioritize programmatic labeling, curation, and weak supervision over manual processes to build specialized enterprise AI faster[1][2][3]. Environments—scalable simulations like OpenEnv, Terminal-Bench 2.0, and ARE—are poised to dominate 2026, enabling complex RL curricula, agent testing, and realistic evals[5]. Human-in-the-loop workflows integrate experts with automation for high-precision data in LLMs, agentic systems, and alignment tasks like automated RLHF[3][job data]. These address bottlenecks in production AI, bridging research to scalable platforms[5]. (108 words)

How does Snorkel differentiate its approach to AI data management?

Snorkel differentiates its approach to AI data management by shifting from manual data labeling to programmatic data development[3]. Rather than relying on time-intensive manual processes, Snorkel Flow enables enterprises to label and curate data using rules, heuristics, and automation[1]. The company combines programmatic automation with calibrated experts-in-the-loop, helping teams curate high-quality datasets 2× faster[4]. This data-centric philosophy—believing that "meaningful AI doesn't start with the model, it starts with the data"—enables organizations to build specialized AI models faster and cheaper using their proprietary data[3]. Snorkel serves large enterprises across banking, healthcare, government, and insurance, addressing a critical bottleneck in AI development[1][2].

What are the company's goals for AI product integration this year?

Snorkel AI's goals for AI product integration in 2026 center on advancing data-centric platforms for environments, evaluations, and agentic systems, building on 2025 NeurIPS trends like OpenEnv and Terminal-Bench 2.0.[5]

The company aims to operationalize the full AI data loop—planning tasks with rubrics, executing labeling pipelines, refining datasets, and evaluating via realistic simulations—to power frontier models 2× faster with expert-in-the-loop methods.[4] This integrates programmatic data development into enterprise products like Snorkel Flow, hardening research POCs (e.g., human-in-the-loop workflows, RLHF automation) for production scale across banking, healthcare, and more.[1][3] Strategic focus anticipates bottlenecks in agentic evaluation and model alignment.[job data]