AI Application Architect

About the role

OKX is on the lookout for an AI Application Architect to become a vital member of the Site Reliability Engineering (SRE) team. This role is focused on creating advanced systems that incorporate large language models and AI agents into engineering and operational workflows. The architect will be responsible for designing AI-enhanced solutions aimed at improving reliability engineering, diagnosing faults, and boosting developer productivity. The overarching objective is to transition the organization from traditional tool-based assistance to a more intelligent collaborative environment that spans research and development, stability, and business operations.

Key facts

What you'll do

• Design and implement AI functionalities tailored for SRE and DevOps scenarios, including but not limited to fault detection, change analysis, capacity risk assessment, automated inspections, drill evaluations, and recommendations for recovery.
• Spearhead the creation of an automated root cause analysis system that synthesizes logs, metrics, distributed tracing, events, changes, and topology data to pinpoint causes, evaluate the scope of impact, and facilitate post-incident evaluations.
• Develop features for an AIOps platform that encompass intelligent alert noise reduction, anomaly detection, event correlation, trend forecasting, fault attribution, and automated remediation loops.
• Collaborate closely with teams across R&D, SRE, platform engineering, data, and business sectors to weave AI capabilities into workflows related to Code Review, CI/CD, GitOps, DevOps, incident response, and stability governance.
• Engage in continuous improvement initiatives to refine AI systems and enhance their effectiveness in operational settings.
• Conduct thorough testing and validation of AI-driven solutions to ensure reliability and performance standards are met.
• Mentor junior team members and share knowledge on best practices in AI application architecture and implementation.
• Stay updated on the latest trends and advancements in AI and machine learning to inform architectural decisions and strategic direction.

Requirements

• A Bachelor's degree or higher in Computer Science or a related field is essential.
• At least 8 years of experience in research and development, architecture, or platform engineering is required.
• A robust background in software architecture, particularly with microservices, distributed systems, high-availability design, service governance, observability, and platform engineering.
• Proven hands-on experience in developing applications utilizing large language models, including techniques such as Retrieval-Augmented Generation (RAG), embedding, vector databases, agents, function calling, tool calling, and prompt engineering.
• A solid understanding of the challenges associated with AI production, including hallucination control, result evaluation, permission boundaries, data security, cost management, observability, and fallback mechanisms.
• A successful track record of delivering AI agents or intelligent assistant products that involve complex task decomposition, multi-tool invocation, multi-turn reasoning, context management, and workflows that facilitate human-machine collaboration.
• Experience in developing root cause analysis or AIOps capabilities, covering areas such as log analysis, metric anomaly detection, distributed tracing, event correlation, alert noise reduction, topology analysis, and root cause localization.
• Proficiency in at least one programming language, such as Java, Python, Go, or TypeScript, along with strong engineering and system design skills.
• Familiarity with cloud-native technologies and middleware, including Kubernetes, Docker, Kafka, Redis, MySQL, Elasticsearch, Prometheus, Grafana, and OpenTelemetry.
• Exceptional analytical abilities and a comprehensive architectural mindset to drive solutions across various dimensions, including business, platform, process, and organizational aspects.

Nice to have

• Previous experience in building AI applications, SRE, AIOps, or DevOps platforms would be advantageous.
• Proficiency in both Chinese and English to facilitate cross-regional collaboration is a plus.

Skills & tools

• Expertise in LLM, RAG, embedding, vector databases, agents, function calling, tool calling, and prompt engineering.
• Programming skills in Java, Python, Go, or TypeScript.
• Familiarity with cloud-native stacks and tools such as Kubernetes, Docker, Kafka, Redis, MySQL, Elasticsearch, Prometheus, Grafana, and OpenTelemetry.
• Knowledge of microservices architecture, distributed systems, and observability practices.

Practical notes

• OKX will prioritize candidates who possess the right to work in Singapore and do not require visa sponsorship.
• The position offers a competitive total compensation package.
• Opportunities for learning and development are available, including education subsidies.
• Employees benefit from wellness and meal allowances, as well as comprehensive healthcare coverage for themselves and their dependents.
• The company promotes team-building initiatives and hosts various company events.
• Interested candidates should apply directly through the official OKX careers website to ensure they receive the most accurate information.