Software Engineer, Trust & Safety
Job description
About the role
Gamma is actively building a robust and scalable trust and safety function to protect its growing user base and AI-powered platform. This role is centered on designing, developing, and operating the systems that defend against sophisticated online threats. You will own the implementation of critical safeguards that ensure the integrity and security of the service for millions of potential users. The position requires a proactive mindset to identify emerging risks and translate them into resilient technical solutions. You will work closely with cross-functional partners to align security objectives with product goals and user needs. This is an opportunity to establish the foundational trust infrastructure for a platform at scale from the ground up. Your work will directly impact the safety and reliability of a tool used for creating professional presentations and documents.
Key facts
What you'll do
- Architect and maintain the systems responsible for detecting and preventing fraud, abuse, spam, and malicious content across all user interactions.
- Design and implement a scalable trust infrastructure that incorporates rate limiting, content scanning, anomaly detection, and robust account security measures.
- Engineer and deploy internal tooling that empowers support teams to efficiently investigate and resolve suspicious activities and reported incidents.
- Lead the investigation and resolution of complex security incidents where initial information is incomplete or ambiguous.
- Partner with product and engineering teams to evaluate and balance security requirements against the optimization of user experience and feature development.
- Shape the long-term trust and safety strategy and technical roadmap for Gamma's platform as it evolves and scales.
- Research, integrate, and utilize artificial intelligence and large language models as detection mechanisms to counter AI-generated abuse, phishing, and fraud.
- Develop and manage automated triage and investigation workflows to enable a small, high-impact team to effectively oversee large-scale operational challenges.
- Define and standardize best practices for trust and safety operations to ensure consistency and efficiency across all related engineering projects.
- Collaborate with data science and infrastructure teams to ensure the reliability, performance, and accuracy of safety-critical systems under heavy load.
Requirements
- Possess 5 or more years of professional software engineering experience, with a demonstrated focus on abuse prevention, spam mitigation, or fraud detection systems.
- Demonstrate a strong understanding of distributed systems and proven experience building highly available, reliable web APIs that serve critical functions.
- Show proficiency in at least one core programming language and exhibit comfort and competence when working with a modern web technology stack.
- Have practical, hands-on experience implementing core trust and safety features such as rate limiting, content detection systems, and fraud prevention workflows.
- Bring experience working with event streaming platforms and systems like Redis or Kafka to handle real-time data processing and communication.
- Hold the ability to investigate and troubleshoot issues with limited initial data, drawing logical conclusions to identify root causes.
- Maintain a strong attention to detail to ensure that safety rules and policies are translated accurately and consistently into technical implementations.
- Communicate effectively and professionally in writing and speech to collaborate with both technical and non-technical stakeholders during incident response and planning.
Nice to have
- Direct experience applying artificial intelligence or large language models specifically for content moderation and safety purposes.
- Familiarity with modern frontend and backend tools such as TypeScript, Prisma, Apollo GraphQL, or cloud infrastructure on AWS.
- A background in building or operating AI-assisted moderation pipelines or using frontier models to detect and prevent automated abuse.
- Deep knowledge of the evolving AI threat landscape and how malicious actors leverage generative models for phishing, social engineering, and content abuse.
Practical notes
This position is based in San Francisco and operates with an in-office culture that requires 4-5 days per week in person, with some flexibility for remote work when focused tasks are necessary. The compensation for this full-time role varies based on the candidate's qualifications and relevant experience, falling within the specified range. Applicants must be authorized to work in the country where the position is located without sponsorship for this role at this time. The role demands a high degree of ownership and the ability to manage multiple priorities in a fast-paced, dynamic environment.