Job Description
About Nyuway:
Nyuway is a generative AI security platform that helps enterprises adopt AI responsibly. We protect AI workflows from data exposure, mitigate prompt vulnerabilities, and enforce compliance policy in real time.
Role Description
- Location: Remote (Work from Anywhere)
- Employment Type: Full-time
- Experience Level: 2–3 Years
- Early Joiners who can join in less than 1 week are preferred
- Design and implement guardrails to protect LLMs against prompt injection, jailbreaks, toxicity, bias, and hallucination risks.
- Build and maintain evaluation frameworks to continuously monitor model safety, fairness, and compliance.
- Develop automated pipelines to process, tag, and evaluate LLM outputs using Python and SQL.
- Use vector databases and embeddings to detect unsafe content, prompt manipulation, or model drift.
- Create internal dashboards or tools (Streamlit, Dash, or lightweight React/JS) to visualize test results and system metrics.
- Collaborate with ML engineers, security analysts, and product teams to integrate safety modules into APIs and production workflows.
- Stay updated with AI safety research and tools like Ragas, LangChain, Guardrails.ai, and frameworks such as NIST AI RMF and EU AI Act.
- 2–3 years of experience in Data Science, Applied ML, or LLM-based product development.
- Proficient in Python and comfortable writing SQL for data exploration or tagging workflows.
- Solid understanding of NLP concepts (Transformers, Attention, Tokenization, Fine-tuning).
- Hands-on experience with LLM APIs (OpenAI, Anthropic, etc.), LangChain, and vector databases (FAISS, Pinecone, Chroma).
- Exposure to evaluation and red-teaming of LLMs for safety or robustness.
- Basic familiarity with Streamlit, Dash, or simple HTML/JS for building internal tools.
- (Preferred) Experience deploying ML systems using Docker, FastAPI, or CI/CD pipelines in a startup or research setting.
How to Apply
Send your resume and a brief note on why you want to join Nyuway to [email protected]
or apply via LinkedIn Jobs.
Similar Jobs
Explore other opportunities that match your interests