About the role
Software Engineer (Python / PySpark / AI)The Software Engineer (Python / PySpark / AI) is responsible for designing, developing, and maintaining production-grade Python applications and services, with a strong emphasis on core software engineering fundamentals, clean design, and solid database work. The role includes writing and tuning PySpark jobs for large-scale data processing, and building AI-enabled capabilities such as LLM-backed services, retrieval pipelines, and ML feature/inference workflows. Depth in Python, databases, and engineering craftsmanship remains the primary focus. AI work is treated as software engineering: the engineer is expected to integrate models into dependable systems with proper evaluation, observability, and cost controls, rather than to conduct original model research. Exposure to broader data engineering practices such as orchestration, lakehouse formats, and pipeline design is valuable. The engineer collaborates closely with other developers, architects
Skills
- Python
- Apache Spark
- Large Language Models
- Machine Learning
- Data Lake