About the role
West 4th Strategy is hiring a Data Engineer to support the National Guard Bureau’s Minuteman project team. The role designs, develops, and maintains data pipelines and infrastructure for the NGB’s enterprise data environment, while supporting data processing, analysis, and governance. Responsibilities Designs, develops, and implements end to end data pipelines utilizing ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQLWorks closely with cross functional teams to understand data requirements and design optimal data models and architecturesCreates and optimizes data pipelines from scratch, ensuring scalability, reliability, and high performance processingPerforms data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasetsLeverages big data technologies to efficiently process and analyze large datasetsCollaborates with data scientists, analysts, and stakeholders to provide