Job Description
Job Description
Job Title: NLP Scientist
Location: South San Francisco, CA 94080
Employment Type: W2 Contract – 6 Months with Possibility for Extensions
Pay Rate: $75.23–$83.23/hour – Determined based on experience (Paid Weekly)
Work Model: Hybrid – Minimum 3 days per week onsite
Note: This is a W2 only role — C2C and C2H will not be considered.
Role Overview
BEPC is actively seeking an NLP Scientist to support our client’s team in South San Francisco, CA.
This role focuses on developing evidence-grounded NLP capabilities for claim accuracy, verification, and compliance. The NLP Scientist will help build systems that evaluate generated claims against approved evidence, including product labeling, clinical study results, approved claims, scientific references, and other controlled source materials.
The system will retrieve relevant evidence, break complex statements into verifiable assertions, determine whether the available evidence supports or contradicts each assertion, and provide traceable decisions with supporting citations.
A critical aspect of this position is developing systems that know when to abstain rather than guess. The solution must distinguish between directly supported claims, claims requiring qualification, contradicted claims, and claims for which available evidence is insufficient.
This technology will assist Medical, Legal, and Regulatory review processes; it will not replace human review or independently approve content.
Key Responsibilities
- Design and develop evidence-grounded NLP systems for claim verification and compliance review.
- Build hybrid retrieval solutions combining vector and lexical search.
- Develop methods for retrieving relevant evidence from scientific, regulatory, technical, and approved source materials.
- Create NLP workflows that decompose compound statements into individually verifiable assertions.
- Develop and evaluate natural-language inference (NLI) and entailment approaches.
- Determine whether evidence directly supports, conditionally supports, contradicts, or is insufficient to support a claim.
- Implement evidence attribution and citation capabilities so reviewers can trace decisions to supporting sources.
- Develop confidence thresholds, abstention mechanisms, escalation rules, and safe-failure behaviors.
- Evaluate whether generated claims are genuinely supported by their cited sources rather than simply measuring retrieval success.
- Measure and report error rates by direction, particularly false approvals and false rejections.
- Build expert-labeled evaluation datasets and establish clear annotation guidelines.
- Measure and improve inter-annotator agreement.
- Develop traceable systems that allow previous decisions to be reconstructed using model versions, evidence sets, and reviewer actions.
- Build and maintain production NLP evaluation infrastructure.
- Partner with Medical, Legal, Regulatory, and other stakeholders to translate compliance and process requirements into system capabilities.
- Apply strong Python engineering practices to build reliable and scalable NLP solutions.
- Support human-in-the-loop workflows that maintain qualified reviewer oversight for high-stakes decisions.
Qualifications Required:
- Strong Python production engineering experience.
- Hands-on experience with modern NLP frameworks and model APIs.
- Demonstrated experience developing evidence-grounded NLP systems.
- Experience with hybrid information retrieval, including vector and lexical retrieval.
- Experience with natural-language inference, entailment, claim decomposition, and evidence attribution.
- Demonstrated experience evaluating whether model-generated answers or claims are actually supported by cited sources.
- Experience working with scientific, technical, regulatory, or similarly complex source material, including studies, publications, labeling, specifications, or contracts.
- Experience developing expert-labeled evaluation datasets.
- Experience creating annotation guidelines and measuring inter-annotator agreement.
- Experience measuring error rates by direction rather than relying exclusively on aggregate accuracy.
- Experience designing human-in-the-loop AI systems, including confidence thresholds, abstention, escalation, and safe-failure behavior.
- Experience developing traceable or auditable systems where previous decisions can be reconstructed.
- Experience with production NLP evaluation infrastructure.
- Ability to collaborate effectively with legal, regulatory, and other cross-functional stakeholders.
- Ability to incorporate regulatory and process constraints directly into system design.
Preferred Qualifications
- Experience combining deterministic rules with model-based judgment in a unified decision system.
- Experience with knowledge graphs connecting claims, evidence, references, products, and indications.
- Experience working in regulated or high-stakes review environments such as legal, financial compliance, scientific publishing, or fact-checking.
- Familiarity with scientific or clinical study design.
- Understanding of statistical evidence and citation practices.
- Pharmaceutical, biotechnology, or life sciences experience is beneficial but not required.
- Experience developing AI/NLP systems supporting regulated review workflows.
About BEPC
BEPC Inc., founded in 2007, is a 100% employee-owned company providing top-tier consulting and staffing solutions across industries like technology, engineering, manufacturing, and project management. At BEPC, we are driven by innovation and a commitment to excellence. We take pride in fostering a collaborative and innovative environment where our team members thrive. With competitive benefits, including medical, dental, vision, and life insurance, BEPC is dedicated to supporting our employees' personal and professional growth.
Apply Now!
\nCompany Description
About BEPC
BEPC Inc., founded in 2007, is a 100% employee-owned company providing top-tier consulting and staffing solutions across industries like technology, engineering, manufacturing, and project management. At BEPC, we are driven by innovation and a commitment to excellence. We take pride in fostering a collaborative and innovative environment where our team members thrive.
With competitive benefits, including medical, dental, vision, and life insurance, BEPC is dedicated to supporting our employees' personal and professional growth.
Company Description
About BEPC\n\nBEPC Inc., founded in 2007, is a 100% employee-owned company providing top-tier consulting and staffing solutions across industries like technology, engineering, manufacturing, and project management. At BEPC, we are driven by innovation and a commitment to excellence. We take pride in fostering a collaborative and innovative environment where our team members thrive.\n\nWith competitive benefits, including medical, dental, vision, and life insurance, BEPC is dedicated to supporting our employees' personal and professional growth.