E
Senior Distributed Systems Engineer (Machine Learning)
Visa Sponsorship
AI Summary
Join our San Francisco office as a Senior Distributed Systems Engineer focused on Machine Learning. Implement and maintain distributed storage solutions, develop strategies to reduce data storage costs, and optimize input/output operations. Contribute to state-of-the-art research and development initiatives.
Key Highlights
Implement and maintain distributed storage solutions
Develop strategies to reduce data storage costs
Optimize input/output operations
Build and manage backend systems to track and manage different versions of datasets
Work alongside a world-class team developing the future of AI tooling
Technical Skills Required
Benefits & Perks
Competitive compensation (75% percentile of market rates)
Significant equity upside
Visa sponsorship available for global talent
Openness to sponsoring International candidates
Job Description
Job brief
Join our San Francisco office as an ML Engineer focused on Data Engineering. Visa sponsorship available for global talent
- 3 days ago
What You'll Do
- Implement and maintain distributed storage solutions to provide seamless data access across all training machines.
- Develop strategies to reduce data storage costs while ensuring high availability and reliability.
- Optimize input/output operations to accelerate data retrieval and processing during training and inference phases.
- Build and manage backend systems to track and manage different versions of datasets, ensuring reproducibility and consistency in experiments.
- We work full-time and in-person at our waterfront office in San Francisco.
- We believe that demonstrated interest in the creative space is key: our team includes musicians, designers, visual artists and more.
- Experience with distributed storage systems including deployment, configuration, and optimization.
- Strong skills in Python and (ideally) C++ for developing data processing pipelines and integrating storage solutions.
- Experience in building and maintaining data pipelines capable of handling large-scale datasets efficiently.
- Experience with K8s.
- Generalist back-end experience with familiarity in ETL and infrastructure.
- Openness to sponsoring International candidates (e.g STEM OPT, OPT, H1B, O1, E3)
- Work alongside a world class developing the future of AI tooling
- Significant impact on our market presence and growth
- Competitive compensation (75% percentile of market rates) with significant equity upside
Similar Jobs
Explore other opportunities that match your interests
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
Raydar
United State
Visa Sponsorship
Relocation
Remote
Job Type
Full-time
Experience Level
Mid-Senior level
BeaconFire Inc.
United State
Engineering Manager, Internal Tools
••••••
••••••
••••••
Job Type
••••••
Experience Level
••••••
anthropic
United State