Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, SQL, and Spark-based technologies.
• Serve as an advocate for AI-native engineering workflows, demonstrating how tools such as Claude Code, Codex, GitHub Copilot, Databricks Genie and related assistants can improve developer productivity, code quality, and operational efficiency.
• Build and support data ingestion frameworks leveraging APIs, SFTP, cloud storage, databases, and third-party integrations.
• Develop and maintain data products within a modern Data Lakehouse architecture, following Medallion (Raw, Bronze, Silver, Gold) design principles.
• Create and optimize data workflows, orchestration processes, and monitoring solutions to ensure pipeline reliability, performance, and scalability.
• Manage cloud-based data infrastructure and storage solutions across platforms such as Databricks, AWS, Snowflake, and Google Cloud.
• Build operational tooling and monitoring dashboards to track pipeline health, resource utilization, uptime, and system performance.
• Collaborate with Data Science, Analytics, Product, and Engineering teams to deliver trusted and scalable data assets.
• Maintain source control, CI/CD processes, repository standards, and deployment best practices across data platforms.

Requirements

• 3–5 years of experience in Data Engineering, Analytics Engineering, or related disciplines.
• Experience with cloud-based data platforms such as Databricks, AWS, Snowflake, or Google Cloud.
• Familiarity with integrating AI and automation tools (e.g., GitHub Copilot, Natural Language Query tools) to enable you to move faster and deliver higher quality code.
• Strong proficiency in SQL and Python.
• Experience with Spark and distributed data processing (PySpark preferred).
• Strong experience with data pipelines (ETL/ELT, event-driven, or workflow-based systems)
• Understanding of Data Lake, Lakehouse, and Medallion architecture concepts.
• You must be work authorized in the United States without the need for employer sponsorship.

Benefits

• Flexible time off without the hassle of accrual
• A generous number of paid holidays
• Company-sponsored team-building events
• An Employee Referral Program
• Annual recognition awards
• Hybrid work arrangements for optimal work-life balance
• Parental bonding leave
• Backup care options for children and elders
• An employee discount program
• International SOS program for global support