Data Engineer

Posted 4d agochecked 1d ago

Reposted. First listed 28 Oct; the company closed it and listed it again, so it may still be unfilled.

Pay
Not stated
Location
India
Work mode
Remote
Level
Mid level
Job type
Full-time
Posted
4d ago

About the role

๐—ง๐—ต๐—ถ๐˜€ ๐—ฟ๐—ผ๐—น๐—ฒ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ผ๐—ป๐—ฒ ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ช๐—ฒ๐—ฒ๐—ธ๐—ฑ๐—ฎ๐˜†'๐˜€ ๐—ฐ๐—น๐—ถ๐—ฒ๐—ป๐˜๐˜€ ๐—ฆ๐—ฎ๐—น๐—ฎ๐—ฟ๐˜† ๐—ฟ๐—ฎ๐—ป๐—ด๐—ฒ: ๐—ฅ๐˜€ ๐Ÿฎ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ - ๐—ฅ๐˜€ ๐Ÿฏ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ (๐—ถ๐—ฒ ๐—œ๐—ก๐—ฅ ๐Ÿฎ๐Ÿฌ-๐Ÿฏ๐Ÿฌ ๐—Ÿ๐—ฃ๐—”) Experience: 3+ yrs Location: Remote As a Data Engineer, you will design, build, and maintain scalable data pipelines and analytics platforms that drive business insights and product innovations. Leveraging your expertise in Python and SQL, you will transform raw data into clean, structured datasets, enabling data scientists and product teams to accelerate experimentation. You will integrate Posthog for behavioral analytics, employ deepeval for model validation workflows, and use Streamlit and LangChain to create interactive data tools and prompt-based applications. Your role will ensure data quality, performance, and compliance across the organization while collaborating closely with cross-functional stakeholders to translate data needs into technical solutions. Requirements ๐—ž๐—ฒ๐˜† ๐—ฅ๐—ฒ๐˜€๐—ฝ๐—ผ๐—ป๐˜€๐—ถ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐—ถ๐—ฒ๐˜€ โ€ข Design and implement robust ETL pipelines that ingest, transform, and store data from diverse sources into a unified data warehouse. โ€ข Build and maintain dashboards and data visualizations using Streamlit to provide realโ€‘time insights for product, marketing, and engineering teams. โ€ข Integrate Posthog event data into the analytics pipeline and create segmented user funnels for product optimization. โ€ข Develop and maintain LangChain workflows to power conversational AI features that interact with structured data. โ€ข Employ deepeval to automate evaluation of machine learning models, ensuring model performance aligns with business KPIs. โ€ข Optimize SQL queries and database schemas for speed, reliability, and scalability across large datasets. โ€ข Collaborate with data scientists to provision and manage queryable data lakes and data marts. โ€ข Implement data governance, security, and privacy controls to comply with industry regulations. โ€ข Monitor pipeline health, troubleshoot failures, and iterate on performance enhancements. โ€ข Document data architecture, pipeline logic, and best practices for internal and external stakeholders. ๐—ช๐—ต๐—ฎ๐˜ ๐— ๐—ฎ๐—ธ๐—ฒ๐˜€ ๐—ฌ๐—ผ๐˜‚ ๐—ฎ ๐—š๐—ฟ๐—ฒ๐—ฎ๐˜ ๐—™๐—ถ๐˜ โ€ข 3+ years of professional experience building data pipelines and analytics platforms in a production environment. โ€ข Strong programming skills in Python, with extensive experience in writing reusable, testable code. โ€ข Deep knowledge of SQL and experience with modern database systems such as PostgreSQL, BigQuery, or Snowflake. โ€ข Proven track record of integrating Posthog for behavioral data ingestion and analysis. โ€ข Handsโ€‘on experience with deepeval or similar model evaluation frameworks. โ€ข Familiarity with LangChain for building LLMโ€‘driven data workflows and prompt engineering. โ€ข Solid understanding of Streamlit or comparable openโ€‘source toolkits for building interactive dashboards. โ€ข Ability to collaborate effectively with crossโ€‘functional teams in a remote, agile environment. โ€ข Strong problemโ€‘solving mindset, with the capacity to troubleshoot complex data issues under tight deadlines. โ€ข Commitment to code quality, documentation, and continuous learning in the fastโ€‘moving data engineering landscape.

via Workable

Skills

  • ETL
  • Python
  • SQL
  • PostHog
  • Model Evaluation
  • LangChain
  • Data Warehousing
  • Machine Learning
  • Scalability
  • PostgreSQL
  • BigQuery
  • Snowflake
  • Large Language Models
  • Prompt Engineering

About Weekday

Everything else Weekday has open, where they are hiring and what those postings say they pay.

Weekday on hyr
This role is in
India

More at Weekday

All roles
Apply

Weโ€™d like to use analytics to improve hyr. Your job search data is never included. Cookie policy