Senior/Software Engineer

About the Role

The role centers on architecting and sustaining the core infrastructure that powers advanced AI agents for data analytics within the PubMatic ecosystem. You will own the design of highly scalable and fault-tolerant data platforms capable of processing terabytes of information to deliver deep analytical insights. A primary focus will be developing backend services and orchestrating complex data pipelines that leverage modern big data and GenAI technologies. You will architect real-time processing workflows and build intelligent agents for analytics, operations, and data enrichment. Ultimately, this position drives the enhancement of the company's data-driven insights and analytical workflows through cutting-edge implementation.

Key facts

What you'll do

• Build, design, and implement a highly scalable, fault-tolerant big data platform to process terabytes of data and provide customers with in-depth analytics.
• Develop backend services using Java, REST APIs, JDBC, and AWS to ensure robust and reliable system performance.
• Build and maintain Big Data pipelines using technologies like Spark, Hadoop, Kafka, and Snowflake for efficient data flow.
• Architect and implement real-time data processing workflows and automation frameworks to streamline operations.
• Design and develop GenAI-powered agents for analytics, operations, and data enrichment use cases using frameworks like LangChain, LlamaIndex, or custom orchestration systems.
• Integrate LLMs (e.g., OpenAI, Claude, Mistral) into existing services for query understanding, summarization, and decision support to enhance capabilities.
• Manage end-to-end GenAI workflows including prompt engineering, fine-tuning, vector embeddings, and retrieval-augmented generation (RAG).
• Work closely with cross-functional teams on improving the availability and scalability of large data platforms and the functionality of PubMatic software.
• Participate in Agile/Scrum processes such as sprint planning, sprint retrospective, backlog grooming, user story management, and work item prioritization to ensure iterative progress.
• Frequently discuss with product managers about the software features to include in the PubMatic Data Analytics platform to align development with business goals.
• Support customer issues over email or JIRA (bug tracking system), provide updates, and patches to customers to fix the issues in a timely manner.
• Perform code and design reviews for code implemented by peers or as per the code review process to maintain high standards of quality.

Requirements

• 1-5 plus years of coding experience in Java and backend development to demonstrate foundational expertise.
• Solid computer science fundamentals, including data structure and algorithm design, and creation of architectural specifications to guide complex projects.
• Expertise in implementing professional software engineering best practices for the full software development life cycle, including coding standards and code reviews for quality assurance.
• Hands-on experience with Big Data tools and systems like Scala Spark, Kafka, Hadoop, and Snowflake for managing large-scale data.
• LLM integration (OpenAI, Anthropic, Cohere, etc.) to leverage advanced language models.
• LangChain, or similar agent orchestration libraries for building intelligent workflows.
• Prompt engineering, embedding, and retrieval-based generation (RAG) for optimizing AI interactions.
• Experience in developing and deploying scalable, production-grade AI or data systems to meet enterprise demands.
• Ability to lead end-to-end feature development and debug distributed systems to resolve complex technical challenges.
• Experience in developing and delivering large-scale big data pipelines, real-time systems & data warehouses would be preferred to handle evolving requirements.
• Demonstrated ability to achieve stretch goals in a very innovative and fast-paced environment to drive organizational success.
• Demonstrated ability to learn new technologies quickly and independently to adapt to changing landscapes.
• Excellent verbal and written communication skills, especially in technical communications to ensure clarity and precision.
• Strong interpersonal skills and a desire to work collaboratively with diverse teams to foster a productive environment.

Nice to have

The SOURCE text does not specify any preferred qualifications or skills beyond the stated requirements.

Practical notes

The engagement is Full-time. The position is based in Pune, India. There is no information regarding travel, visa requirements, application deadlines, or official application procedures within the provided source material.